Data Engineering Specialist

3 days ago

Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 1,70,00,000

Job Title: Data Engineering Specialist

 

At our organization, we are seeking a highly skilled data engineering specialist with 4+ years of experience in designing, building, and optimizing ETL pipelines, working with Databricks, and managing large-scale data processing workflows.

Key Responsibilities:

  • Design, develop, and maintain scalable ETL pipelines for batch data ingestion and egress using Azure Data Factory, Databricks, and Spark.
  • Implement data transformation workflows using PySpark and Scala Spark for high-performance data processing.
  • Work extensively with Azure Cloud services including Azure Data Lake, Azure Data Factory, Azure Databricks, Azure SQL Database, and related services.
  • Troubleshoot, debug, and resolve job failures by identifying root causes.
  • Optimize data processing jobs for performance and cost efficiency.
  • Collaborate with business and technical teams to gather requirements and translate them into effective data solutions.
  • Develop reusable and efficient data engineering solutions following best practices.
  • Maintain detailed documentation for solutions, processes, and troubleshooting guides.

 

Required Skills and Qualifications:

  • Microsoft Certified: Azure Fundamentals (preferred)
  • Microsoft Certified: Azure Data Engineer Associate (preferred)
  • Strong programming skills in Python and Scala.
  • Hands-on experience with Spark (PySpark & Scala Spark).
  • Proficiency in SQL for data querying and transformation.
  • Good knowledge of Azure Cloud, Azure Data Factory (ADF), and Azure Databricks.
  • Strong understanding of ETL pipeline design and implementation.
  • Proven ability to troubleshoot jobs and analyze root causes effectively.

 

Benefits:

  1. Opportunity to work on large-scale data processing projects.
  2. Chance to collaborate with business and technical teams.
  3. Professional growth and development opportunities.

  • Data Engineering Specialist

    3 days ago

    Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Data Engineering SpecialistWe are seeking a skilled Data Engineering Specialist to join our team and contribute to the development of real-time data processing solutions.

  • Data Engineer

    20 hours ago

    Bengaluru, Karnataka, India Data Analytics Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Get to Know the Team Grab has been expanding into multiple lines of businesses. The Grab Data Warehouse team builds business intelligence systems using data from all business lines to provide insights to key stakeholders across the company. Get to Know the Role We are looking for a Lead Data Engineer to lead the design and enhancement of our data...

  • Data Engineer

    21 hours ago

    Bengaluru, Karnataka, India Ascendion Engineering Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Role & responsibilitiesData Products Enhancement: Collaborate with cross-functional teams to agentify current Data Products, enabling intelligent and adaptive data flows that support evolving business needs.Agentification of ETL Pipelines: Transformation of existing ETL and data ingestion pipelines by embedding agentic architectures. This involves...

  • Data Engineering Specialist

    6 days ago

    Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    **Job Title:** Data Engineering SpecialistAs a seasoned data engineer, you will play a pivotal role in designing, developing, and maintaining high-performance data pipelines and ETL processes on Databricks. You will lead the architecture and implementation of scalable, secure, and efficient data solutions.

  • Data Engineering Specialist

    1 day ago

    Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Data Engineering SpecialistAs a data engineering specialist, you will be responsible for designing and developing end-to-end data pipelines and analytical solutions within the Palantir platform.You will design and implement robust data integration strategies from various sources, develop and optimize complex data models to ensure data quality,...

  • Digital Engineering Networking Engineer Specialist

    7 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Req ID 336414 NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Digital Engineering Networking Engineer Specialist to join our team in Bangalore Karn taka IN-KA India IN At...

  • Data Engineering and Programming Specialist

    2 days ago

    Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title:Data Engineering and Programming Specialist">About the Job:We are seeking a highly skilled Data Engineering and Programming Specialist with 3-4 years of experience. The ideal candidate will have a strong foundation in programming and a passion for working with data to solve business problems.">Key Responsibilities:\\Assist in the design,...

  • Digital Engineering Networking Engineer Specialist

    3 weeks ago

    Bengaluru, Karnataka, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Networking Engineer Specialist to join our team in Bangalore, Karntaka (IN-KA), India (IN).At NTT...

  • Data Engineering Specialist

    1 day ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Title: Data Engineering SpecialistWe are seeking a highly skilled Data Engineering Specialist to join our team. This role will be responsible for designing, building, and maintaining large-scale data processing systems.Key Responsibilities:Data Ingestion: Develop and implement data ingestion pipelines using Azure Databricks (ADB) and Azure Data Factory...

  • Data Engineering Specialist

    3 days ago

    Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 17,32,500 - ₹ 25,95,000

    Job Title:Data Engineering Specialist">This is a challenging opportunity for a skilled Data Engineering Specialist to join our team. As a key member of our data architecture team, you will be responsible for designing and implementing cutting-edge data solutions that drive business growth and improvement.">The ideal candidate will have a deep understanding...