Lead Cloud Data Engineer

1 day ago

Gurugram, India upGrad Full time

About the Job :

We're hiring an cloud data engineering (preferably Azure) data pipelines and Spark.


- Work with Databricks platform using Spark for big data processing and analytics.


- Write optimized and efficient code using PySpark, Spark SQL and Python.


- Develop and maintain ETL processes using Databricks notebooks and workflows.


- Implement and optimize data pipelines for data transformation and integration.


- Knowledge of one or more SQL variant, preferably PL/SQL and Spark SQL.


- Write complex SQL queries for data retrieval, manipulation, and analysis.


- Debugging code when required and troubleshooting any Python, Pyspark or SQL related queries.


- Good Experience with version control (Git) and ci/cd.


- Excellent problem-solving ability with solid communication and collaboration skills

Key Responsibilities :

- Work with Databricks platform using Spark for big data processing and analytics.


- Write optimized and efficient code using PySpark, Spark SQL and Python.


- Develop and maintain ETL processes using Databricks notebooks and workflows.


- Implement and optimize data pipelines for data transformation and integration.


- Knowledge of one or more SQL variant, preferably PL/SQL and Spark SQL.


- Write complex SQL queries for data retrieval, manipulation, and analysis.


- Debugging code when required and troubleshooting any Python, Pyspark or SQL related queries.


- Good Experience with version control (Git) and ci/cd.


- Excellent problem-solving ability with solid communication and collaboration skills

Technical Requirements :

- 7 to 12 years of experience as a Data Engineer or related role

- Strong expertise with Databricks platform using Spark for big data processing

- Proficiency in Python programming and data manipulation libraries like Pandas, PySpark

- Strong working knowledge of SQL for data querying and transformations

- Solid understanding of ETL design patterns and data warehousing principles

- Azure Data Engineer certification is a plus

(ref:hirist.tech)

  • Cloud Data Engineer

    3 days ago

    Pune, Gurgaon / Gurugram, India beBeeDataEngineer Full time ₹ 8,00,000 - ₹ 25,00,000

    Job Summary:Cloud Data Engineer RoleThe Cloud Data Engineer role requires expertise in designing, building, and maintaining large-scale data systems on cloud platforms. The successful candidate will have a deep understanding of data engineering principles, including data processing, storage, and analytics.This role offers significant opportunities for growth...

  • Lead Data Engineer

    1 day ago

    Gurugram, India SUPERSOURCING TECHNOLOGIES PRIVATE LIMITED Full time

    About the Role:We are looking for an experienced Lead Data Engineer with deep expertise in Big Data technologies, particularly within the Google Cloud Platform (GCP) ecosystem. The ideal candidate should have a strong command of PySpark/Spark, SQL, and Python, and a proven track record in building, optimizing, and managing large- scale data pipelines and...

  • Data Engineer Lead

    2 weeks ago

    Bengaluru, Gurugram, India Metyis Full time US$ 90,000 - US$ 1,20,000 per year

    Metyis is a Netherlands based fast-growing international company with a diverse team of over 700+ professionals with a mix of Analytics, Data Science and Technology Team.We are looking for an experienced Data Engineer to join our team with below requirements:Responsibilities:Independently lead & manage execution of data engineering projectsEngineer complete...

  • Lead Data Engineer

    1 day ago

    Gurugram, India Zealant Consulting Group Full time

    Role Overview : The Lead Data Engineer will define and drive the technical architecture for migrating Azure SQL databases to Google BigQuery and integrating Looker as the enterprise BI platform. This role requires leadership in data engineering best practices, pipeline optimization, governance enforcement, and mentoring the engineering team to deliver a...

  • Salesforce Technical Lead

    1 day ago

    Gurugram, Gurugram, India 360 Degree Cloud Full time

    Job Description Company Description At 360 Degree Cloud, our mission is to help businesses unlock the true power of Salesforce, transforming the way they operate, innovate, and grow. As a Salesforce Summit Partner, we are enablers of digital excellence, helping organizations maximize their Salesforce investment through expertise, automation, and AI-driven...

  • Data Engineering Lead

    6 days ago

    Delhi, Gurugram, NCR, Noida, India Bounteous x Accolite Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Role & responsibilitiesSkill - Data engineer python AWSExp - 10+Location - GurugramNP - only immediate joiners neededPreferred candidate profileWe are seeking an experienced Lead Data Engineer with strong expertise in Python, AWS cloud services, ETL pipelines, and system integrations. The ideal candidate will lead the design, development, and optimization of...

  • Data Engineer

    1 day ago

    Gurugram, India Mobile Programming LLC Full time

    Job Title : Data Engineer (GCP)Location : Pune, Mumbai, Bangalore, Gurgaon, Panchkula, MohaliExperience : 3+ yearsNotice period : Immediate joinerJob Description :We are looking for a skilled and passionate Data Engineer with hands-on experience working on Google Cloud Platform (GCP). The ideal candidate will have expertise in building and maintaining data...

  • Lead Data Engineer

    2 weeks ago

    Bengaluru, Gurugram, India Rackspace Technology Full time US$ 1,00,000 - US$ 1,50,000 per year

    The Data engineer is responsible for managing and operating upon Tableau, Tableau bridge server, Databricks, Dbt, SSRS, SSIS, AWS DWS, AWS APP Flow, PowerBI. The engineer will work closely with the customer and team to manage and operate cloud data platform.Job DescriptionLeads operational coverage:Resolving pipeline issues / Proactive monitoring for...

  • Oracle Service Cloud

    3 days ago

    Gurugram, Haryana, India NTT DATA Full time

    **Req ID**: 272749 We are currently seeking a Oracle Service Cloud to join our team in Gurugram, Haryāna (IN-HR), India (IN). Experience: 2 to 5 Years Work location: Chennai/Gurgaon Shift timings: 12 PM to 9 PM **Responsibilities**: Responsible for the functional specification, technical design, implementation, and support of Service Cloud Solutions. -...

  • Senior Cloud Engineer

    2 weeks ago

    Noida, Gurgaon / Gurugram, Indore, India beBeeCloud Full time US$ 60,000 - US$ 1,20,000

    Senior Cloud Engineer & Data ScientistWe are seeking a highly skilled and experienced Senior Cloud Engineer & Data Scientist to join our team. As a key member of our engineering team, you will be responsible for designing, developing, and deploying cloud-native solutions using Azure.Job DescriptionThe ideal candidate will have a strong background in software...