Data Pipeline Engineer

3 days ago

Greater Noida, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

Job Summary:

">
  • We are seeking a skilled professional to design, develop, and maintain data pipelines in Amazon Web Services (AWS).
  • The ideal candidate will have experience with ETL tools, database management, big data analytics, and AWS services.
">

Key Responsibilities:

">
  • Designing and building ETL processes using AWS services like Apache Sqoop, AWS S3, Hue, AWS CLI, Amazon EMR, Amazon MSK, Amazon Sagemaker, and Apache Spark.
  • Developing and maintaining data pipelines to move and transform data from diverse sources into data warehouses or data lakes.
  • Ensuring data quality and integrity through validation, cleansing, and monitoring ETL processes.
  • Optimizing ETL workflows for performance, scalability, and cost efficiency within the AWS environment.
  • Troubleshooting and resolving issues related to data processing and ETL workflows.
">

Requirements:

">
  • Strong experience with ETL tools and technologies such as Talend.
  • Proficiency in big data tools and AWS services including Apache Sqoop, AWS S3, Hue, AWS CLI, Amazon EMR, Amazon MSK, Amazon Sagemaker, and Apache Spark.
  • Strong SQL skills for querying databases and manipulating data during the transformation process.
  • Programming and scripting proficiency primarily in Python for automating tasks, developing custom transformations, and interacting with AWS services via SDKs and APIs.
  • Data warehousing and modeling expertise including understanding data warehousing concepts, dimensional modeling, and schema design to optimize data storage and retrieval.
  • Good to have experience with insurance domain.
">

Benefits:

">
  • Opportunity to work with cutting-edge technologies and innovative projects.
  • Chance to contribute to the growth and success of the organization.
  • A dynamic and supportive work environment.

  • Data Engineering

    2 days ago

    Greater Noida, Uttar Pradesh, India Etelligens Technologies Pvt. Ltd. Full time US$ 1,00,000 - US$ 1,50,000 per year

    We are looking for a Data Engineering Lead with deep expertise in AWS, Python, and modern data engineering practices to architect and deliver scalable, secure, and efficient data solutions. In this role, you'll lead the design and development of ETL pipelines, implement robust data warehousing solutions, and support machine learning workflows across various...

  • Data Engineer

    5 days ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    Req ID 303115NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Data Engineer to join our team in Noida Uttar Pradesh IN-UP India IN Job Duties As a data engineer you will have a...

  • Data Pipeline Architect

    7 days ago

    Noida, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 1,80,00,000

    Job Overview">Design, Develop & Optimize Data PipelinesWe are seeking a skilled professional to join our team as a Data Engineer. In this role, you will be responsible for designing, developing, and optimizing scalable data pipelines that meet the needs of our business.">Key Responsibilities">Design and develop efficient data ingestion pipelines to collect...

  • Data Pipeline Engineer

    3 days ago

    Noida, Uttar Pradesh, India beBeeETLDuty Full time ₹ 18,00,000 - ₹ 25,00,000

    Job OpportunityWe are seeking a highly skilled ETL Developer to join our team. The ideal candidate will have extensive experience in designing, developing, and maintaining ETL processes to manage data pipelines in cloud-based environments.Design and automate ETL processes using industry-standard tools and technologies.Develop and maintain data pipelines to...

  • Data Engineer

    2 days ago

    Greater Noida, Uttar Pradesh, India Etelligens Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Responsibilities:5+ years of hands-on experience in data engineering, particularly with Python, PySpark, and SQL.Proven experience building ETL pipelines using AWS services (Glue, Lambda, S3, Athena, Step Functions).Strong knowledge of Data Warehousing concepts, SCD Types (Type 1, Type 2), and Medallion Architecture.Solid understanding of data modeling,...

  • Senior Pipeline Engineer

    3 days ago

    Noida, Uttar Pradesh, India beBeePipelineEngineering Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Title: Senior Pipeline EngineerPipeline engineers design, construct and operate pipelines that transport oil, gas, water and other fluids. This is a critical role in the energy industry as it ensures the safe and efficient transportation of these vital resources.About the RoleThis senior pipeline engineer position involves working on high-profile...

  • Senior Data Engineer

    5 days ago

    Noida, Uttar Pradesh, India beBeeData Full time ₹ 1,04,000 - ₹ 1,30,878

    Job DescriptionWe are seeking a skilled professional to lead our data engineering initiatives. As an ETL Developer, you will be responsible for designing and implementing efficient data pipelines using various tools and technologies.Your primary focus will be on extracting, transforming, and loading data to meet the needs of our end-users. You will work...

  • Data Pipeline Specialist

    6 days ago

    Noida, Uttar Pradesh, India beBeeDataPipeline Full time ₹ 10,00,000 - ₹ 15,00,000

    The role of a Data Pipeline Specialist involves providing critical support for data processing pipelines. This position requires troubleshooting skills to identify and resolve issues related to data processing.Collaboration with development teams is essential to resolve incidents and implement patches in a timely manner. System performance monitoring and...

  • Gcp Data Engineer

    2 days ago

    Greater Noida, Uttar Pradesh, India Coforge Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    About the Role:We are looking for a highly skilled Data Engineer with strong expertise in Google Cloud Platform (GCP) services, DBT, SQL/Python, and GitLab. The ideal candidate will be responsible for building scalable data pipelines, enabling analytics, and ensuring efficient data integration across platforms.Key Responsibilities:Design, build, and optimize...

  • Data Pipeline Architect

    1 week ago

    Noida, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 1,94,40,000 - ₹ 2,59,20,000

    Senior Data Engineering ExpertWe are seeking a seasoned data engineering expert to join our team.Job Description:The Senior Data Engineering Expert will be responsible for designing, building, and maintaining robust data pipelines using Python and SQL.They will develop reusable scripts for data extraction from various structured and semi-structured file...