Data Pipeline Engineer

6 days ago

Noida, Uttar Pradesh, India beBeeETL Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

We are seeking an experienced Senior ETL Developer to fill a key role in our team.

Job Overview:

The ideal candidate will have a minimum of 5 years of hands-on experience developing scalable data pipelines and ETL workflows using modern tools and frameworks. Our team relies on efficient data integration, transformation, and loading processes to drive business decisions.

Key Responsibilities:
  • Design and develop ETL pipelines using PySpark and Python for large-scale data processing.
  • Implement validation logic as part of ETL workflows.
  • Work with relational databases (e.g., Oracle, PostgreSQL, SQL Server) to extract, transform, and load data efficiently.
  • Develop and optimize data pipelines on cloud platforms (AWS) using Spark-based frameworks (Data Frames).
Requirements:
  • At least 5 years of experience in ETL development with a strong foundation in data integration, transformation, and loading.
  • Proven experience writing efficient code in PySpark and Python, especially for large-scale data sets.
  • Hands-on experience with creating ETL workflows.
  • Strong experience working with relational databases and writing complex SQL queries.
Preferred Qualifications:
  • Experience with data orchestration tools like Apache Airflow or similar.
  • Familiarity with data governance and security best practices.
  • Experience in Agile/Scrum environments.

The ideal candidate will ensure data integrity, performance, and quality in all ETL processes and participate in code reviews, testing, and deployment of data solutions.

  • Data Engineer

    2 weeks ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    Req ID 303115NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Data Engineer to join our team in Noida Uttar Pradesh IN-UP India IN Job Duties As a data engineer you will have a...

  • Cloud Data Pipelines Specialist

    4 days ago

    Noida, Uttar Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 28,00,000

    Cloud Data Pipeline EngineerJob DescriptionAn SRE with expertise in data engineering will manage, maintain and troubleshoot cloud data pipelines. Ideal candidates have extensive experience in cloud data engineering, cloud platform services and data pipeline architecture.Key Responsibilities:Manage, maintain and troubleshoot cloud data pipelinesLeverage...

  • Data Pipeline Architect

    2 weeks ago

    Noida, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 1,80,00,000

    Job Overview">Design, Develop & Optimize Data PipelinesWe are seeking a skilled professional to join our team as a Data Engineer. In this role, you will be responsible for designing, developing, and optimizing scalable data pipelines that meet the needs of our business.">Key Responsibilities">Design and develop efficient data ingestion pipelines to collect...

  • Data Pipeline Engineer

    1 week ago

    Noida, Uttar Pradesh, India beBeeETLDuty Full time ₹ 18,00,000 - ₹ 25,00,000

    Job OpportunityWe are seeking a highly skilled ETL Developer to join our team. The ideal candidate will have extensive experience in designing, developing, and maintaining ETL processes to manage data pipelines in cloud-based environments.Design and automate ETL processes using industry-standard tools and technologies.Develop and maintain data pipelines to...

  • Senior Pipeline Engineer

    1 week ago

    Noida, Uttar Pradesh, India beBeePipelineEngineering Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Title: Senior Pipeline EngineerPipeline engineers design, construct and operate pipelines that transport oil, gas, water and other fluids. This is a critical role in the energy industry as it ensures the safe and efficient transportation of these vital resources.About the RoleThis senior pipeline engineer position involves working on high-profile...

  • Senior Data Engineer

    2 weeks ago

    Noida, Uttar Pradesh, India beBeeData Full time ₹ 1,04,000 - ₹ 1,30,878

    Job DescriptionWe are seeking a skilled professional to lead our data engineering initiatives. As an ETL Developer, you will be responsible for designing and implementing efficient data pipelines using various tools and technologies.Your primary focus will be on extracting, transforming, and loading data to meet the needs of our end-users. You will work...

  • Data Pipeline Specialist

    2 weeks ago

    Noida, Uttar Pradesh, India beBeeDataPipeline Full time ₹ 10,00,000 - ₹ 15,00,000

    The role of a Data Pipeline Specialist involves providing critical support for data processing pipelines. This position requires troubleshooting skills to identify and resolve issues related to data processing.Collaboration with development teams is essential to resolve incidents and implement patches in a timely manner. System performance monitoring and...

  • Data Pipeline Specialist

    6 days ago

    Noida, Uttar Pradesh, India beBeeData Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Overview As a key member of our team, you will be responsible for designing, building and maintaining scalable data pipelines to drive business growth.Design and implement efficient data pipelines that can handle large volumes of dataCollaborate with cross-functional teams to ensure seamless integration and alignmentRequirementsTo succeed in this role,...

  • Data Pipeline Specialist

    2 weeks ago

    Noida, Uttar Pradesh, India beBeeData Full time ₹ 10,00,000 - ₹ 16,00,000

    Job Title: Data Pipeline SpecialistWe are seeking a skilled data pipeline specialist to oversee the maintenance and development of data processing pipelines on Unix platforms.Troubleshoot issues related to Talend and ServiceNow.Collaborate with development teams to resolve incidents and implement patches in a timely manner.Monitor system performance and...

  • Data Pipeline Engineer

    1 week ago

    Greater Noida, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Summary:">We are seeking a skilled professional to design, develop, and maintain data pipelines in Amazon Web Services (AWS).The ideal candidate will have experience with ETL tools, database management, big data analytics, and AWS services.">Key Responsibilities:">Designing and building ETL processes using AWS services like Apache Sqoop, AWS S3, Hue, AWS...