Cloud Data Engineer Lead

3 days ago


Gurgaon, Haryana, India beBeeBigDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

Big Data and Cloud Engineering Lead

">

As a Big Data and Cloud Engineering Lead, you will play a key role in designing, developing, and maintaining large-scale data pipelines using Spark DataFrames and Hadoop ecosystem components. Your primary responsibility will be to develop and optimize PySpark (SparkSQL) jobs for efficient data processing.

">

You will work closely with cross-functional teams to contribute to migration projects within the Hadoop environment. Your expertise in automation will be invaluable as you develop scripts using Shell scripting and Python to improve data pipeline efficiency.

">

In addition to your technical skills, you will collaborate with Agile development teams to stay updated on emerging technologies and improve system performance.

">

Key Responsibilities:

">

Design, develop, and maintain large-scale data pipelines using Spark DataFrames and Hadoop ecosystem components.

">

Develop and optimize PySpark (SparkSQL) jobs for efficient data processing.

">

Work on cloud-based solutions using AWS / Azure / GCP.

">

Contribute to migration projects within the Hadoop environment.

">

Develop automation scripts using Shell scripting and Python to improve data pipeline efficiency.

">

Stay updated on emerging technologies to improve system performance.

">

Required Skills and Qualifications:

">

Strong experience in Spark DataFrames and Hadoop ecosystem.

">

Hands-on experience with AWS / Azure / GCP cloud platforms.

">

Proficiency in PySpark and SQL.

">

Knowledge of Shell scripting and Python.

">

Experience with workflow/scheduling tools like Oozie or Autosys.

">

Knowledge of Agile development processes.

">

Benefits:

">

Work on cutting-edge Big Data & Cloud projects.

">

Opportunity to innovate and explore automation in large-scale systems.

">

Collaborative and agile work environment with continuous learning.



  • Gurgaon, Haryana, India BeBeeDataEngineering Full time

    Job Overview We are seeking a skilled Data Engineering Manager to lead the development of scalable data pipelines and infrastructure. Key Responsibilities: Design, develop, and implement cloud-native data solutions using AWS services Mentor junior engineers and collaborate with technical area leads, solution architects, and product owners Define best...


  • Gurgaon, Haryana, India BeBeeDataEngineering Full time

    Job Overview We are seeking a skilled Data Engineering Manager to lead the development of scalable data pipelines and infrastructure.Key Responsibilities: Design, develop, and implement cloud-native data solutions using AWS services Mentor junior engineers and collaborate with technical area leads, solution architects, and product owners Define best...


  • Gurgaon, Haryana, India beBeeEngineering Full time US$ 15,00,000 - US$ 20,00,000

    Leadership Opportunity: Cloud Data EngineeringWe are seeking a highly skilled and experienced Data Engineering Manager to lead the development of scalable data pipelines and infrastructure. Develop and implement cloud-based data engineering solutions that meet business needs. Manage cross-functional teams to deliver high-quality data products. Maintain and...


  • Gurgaon, Haryana, India CoPoint Data Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    About CoPoint DataCoPoint Data is a specialized consulting firm focused on transforming businesses through process improvement, data insights, and technology-driven innovation. We leverage AI technologies, Microsoft cloud platforms, and modern web development frameworks to deliver intelligent, scalable solutions that drive measurable impact for our clients....

  • Cloud Data Engineer

    5 days ago


    Gurgaon, Haryana, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Cloud Data EngineerWe are seeking a highly skilled Cloud Data Engineer to design and develop scalable data pipelines using cloud-based technologies.The ideal candidate will have strong experience in AWS Glue, Databricks, Apache Spark, and Python, with a proven track record of delivering high-quality data solutions.Design and Develop Scalable ETL Pipelines:...


  • Gurgaon, Haryana, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job OverviewWe are seeking a skilled Data Engineering Manager to lead the development of scalable data pipelines and infrastructure.Key Responsibilities:Design, develop, and implement cloud-native data solutions using AWS servicesMentor junior engineers and collaborate with technical area leads, solution architects, and product ownersDefine best practices,...

  • Lead Data Engineer

    3 days ago


    Gurgaon, Haryana, India United Airlines Full time US$ 1,50,000 - US$ 2,00,000 per year

    Achieving our goals starts with supporting yours. Grow your career, access top-tier health and wellness benefits, build lasting connections with your team and our customers, and travel the world using our extensive route network.Come join us to create what's next. Let's define tomorrow, together.DescriptionDescription - ExternalUnited's Digital Technology...

  • Cloud Engineer

    4 days ago


    Gurgaon, Haryana, India beBeeTechnical Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Overview :We are seeking an experienced and highly skilled technical leader to drive the development and enhancement of a large-scale data observability solution built on AWS.This platform delivers monitoring, reporting, and actionable insights across the client's data landscape. The successful candidate will lead end-to-end feature delivery, mentor...


  • Gurgaon, Haryana, India beBeeData Full time ₹ 15,00,000 - ₹ 28,00,000

    Unlock Your Career as a Cloud Data Engineering Expert!Key Responsibilities:Design and implement scalable data pipelines using Cloud-based solutions.Integrate data from diverse sources, including on-premise and cloud-based systems.Develop high-performance data models in BigQuery, ensuring cost efficiency and scalability.Implement Terraform for provisioning...


  • Gurgaon, Haryana, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    Cloud Data EngineerWe are seeking experienced Cloud Data Engineers to join our data-driven teams. If you're passionate about building scalable data pipelines, enabling advanced analytics, and solving real-world data challenges in a cloud-first environment, this is the right role for you.Key Responsibilities :Design, develop, and maintain large-scale,...