Lead Cloud Data Engineer

3 weeks ago

Gurugram, India upGrad Full time

About the Job :

We're hiring an cloud data engineering (preferably Azure) data pipelines and Spark.


- Work with Databricks platform using Spark for big data processing and analytics.


- Write optimized and efficient code using PySpark, Spark SQL and Python.


- Develop and maintain ETL processes using Databricks notebooks and workflows.


- Implement and optimize data pipelines for data transformation and integration.


- Knowledge of one or more SQL variant, preferably PL/SQL and Spark SQL.


- Write complex SQL queries for data retrieval, manipulation, and analysis.


- Debugging code when required and troubleshooting any Python, Pyspark or SQL related queries.


- Good Experience with version control (Git) and ci/cd.


- Excellent problem-solving ability with solid communication and collaboration skills

Key Responsibilities :

- Work with Databricks platform using Spark for big data processing and analytics.


- Write optimized and efficient code using PySpark, Spark SQL and Python.


- Develop and maintain ETL processes using Databricks notebooks and workflows.


- Implement and optimize data pipelines for data transformation and integration.


- Knowledge of one or more SQL variant, preferably PL/SQL and Spark SQL.


- Write complex SQL queries for data retrieval, manipulation, and analysis.


- Debugging code when required and troubleshooting any Python, Pyspark or SQL related queries.


- Good Experience with version control (Git) and ci/cd.


- Excellent problem-solving ability with solid communication and collaboration skills

Technical Requirements :

- 7 to 12 years of experience as a Data Engineer or related role

- Strong expertise with Databricks platform using Spark for big data processing

- Proficiency in Python programming and data manipulation libraries like Pandas, PySpark

- Strong working knowledge of SQL for data querying and transformations

- Solid understanding of ETL design patterns and data warehousing principles

- Azure Data Engineer certification is a plus

(ref:hirist.tech)

  • Lead/Principal Data Consultant

    2 weeks ago

    Gurugram, Gurugram, India Eucloid Data Solutions Full time

    Job Description Key Responsibilities: - Drive the definition, design and delivery of new data products within the customer's Data Platform and related applications, reporting directly to the Director. Create product strategy documents/PRDs that describe business cases, high-level use cases, technical requirements and ROI Develop, update and implement...

  • Principal Software/Data Engineering

    3 weeks ago

    Gurugram, India CoPoint Data Full time

    About CoPoint Data CoPoint Data is a specialized consulting firm focused on transforming businesses through process improvement, data insights, and technology-driven innovation. We leverage AI technologies, Microsoft cloud platforms, and modern web development frameworks to deliver intelligent, scalable solutions that drive measurable impact for our clients....

  • Senior/Lead Data Engineer

    3 weeks ago

    Gurugram, India Srijan Technologies Pvt Ltd Full time

    About US:- We turn customer challenges into growth opportunities. Material is a global strategy partner to the world's most recognizable brands and innovative companies. Our people around the globe thrive by helping organizations design and deliver rewarding customer experiences. We use deep human insights, design innovation and data to create experiences...

  • Data Engineering Lead

    1 week ago

    Gurugram, India Metyis Full time

    What we offer Interact with C-level at our clients on regular basis to drive their business towards impactful change.  Lead your team in creating new business solutions.  Seize opportunities at the client and at Metyis in our entrepreneurial environment.  Become part of a fast-growing international and diverse team. What you will do Independently...

  • Senior Web Developer and Data Engineer

    3 weeks ago

    Gurugram, India CoPoint Data Full time

    About CoPoint AI CoPoint AI is a specialized consulting firm focused on transforming businesses through process improvement, data insights, and technology-driven innovation. We leverage AI technologies, Microsoft cloud platforms, and modern web development frameworks to deliver intelligent, scalable solutions that drive measurable impact for our clients. Our...

  • Lead Engineer, Data Migration

    1 week ago

    Gurugram, India MongoDB Full time

    MongoDB’s mission is to empower innovators to create, transform, and disrupt industries by unleashing the power of software and data. We enable organizations of all sizes to easily build, scale, and run modern applications by helping them modernize legacy workloads, embrace innovation, and unleash AI. Our industry-leading developer data platform, MongoDB...

  • Lead Engineer, Data Migration

    1 week ago

    Gurugram, India MongoDB Full time

    MongoDB’s mission is to empower innovators to create, transform, and disrupt industries by unleashing the power of software and data. We enable organizations of all sizes to easily build, scale, and run modern applications by helping them modernize legacy workloads, embrace innovation, and unleash AI. Our industry-leading developer data platform, MongoDB...

  • Data Engineer

    3 weeks ago

    Gurugram, India Techno Wise Full time

    Job Title : GCP Data EngineerLocation : Gurugram / Gurgaon - HybridExperience : 4-9Job Type : Full-TimeAbout the Role :We are looking for a skilled GCP Data Engineer with strong expertise in Python, SQL, and Google Cloud Platform (GCP) tools. The ideal candidate will be responsible for building, maintaining, and optimizing data pipelines and ensuring smooth...

  • Lead Data Engineer

    3 weeks ago

    Gurugram, India CBRE Full time

    Gurgaon - Haryana - India, Hyderabad - Telangana - India, Noida - Uttar Pradesh - India About The RoleAs a Senior Lead Data Engineer, you will play a crucial role in designing, building, and optimizing our data pipeline and infrastructure. You will work closely with stakeholders, analysts, and other to ensure data integrity, availability, and security. This...

  • Data Engineer/Lead

    1 week ago

    Gurugram, India WMGO Full time

    Job Description :At Our Client, we are seeking a Data Engineer - Lead to architect and scale enterprise-grade data platforms, manage and mentor a growing team, and drive the design and implementation of high-performance, cloud-native data solutions that power advanced analytics and AI initiatives.Requirements : - 7+ years of experience in data engineering,...