Lead Cloud Data Engineer

3 weeks ago


Noida, Uttar Pradesh, India upGrad Full time

About the Job :

We're hiring an cloud data engineering (preferably Azure) data pipelines and Spark.

- Work with Databricks platform using Spark for big data processing and analytics.

- Write optimized and efficient code using PySpark, Spark SQL and Python.

- Develop and maintain ETL processes using Databricks notebooks and workflows.

- Implement and optimize data pipelines for data transformation and integration.

- Knowledge of one or more SQL variant, preferably PL/SQL and Spark SQL.

- Write complex SQL queries for data retrieval, manipulation, and analysis.

- Debugging code when required and troubleshooting any Python, Pyspark or SQL related queries.

- Good Experience with version control (Git) and ci/cd.

- Excellent problem-solving ability with solid communication and collaboration skills

Key Responsibilities :

- Work with Databricks platform using Spark for big data processing and analytics.

- Write optimized and efficient code using PySpark, Spark SQL and Python.

- Develop and maintain ETL processes using Databricks notebooks and workflows.

- Implement and optimize data pipelines for data transformation and integration.

- Knowledge of one or more SQL variant, preferably PL/SQL and Spark SQL.

- Write complex SQL queries for data retrieval, manipulation, and analysis.

- Debugging code when required and troubleshooting any Python, Pyspark or SQL related queries.

- Good Experience with version control (Git) and ci/cd.

- Excellent problem-solving ability with solid communication and collaboration skills

Technical Requirements :

- 7 to 12 years of experience as a Data Engineer or related role

- Strong expertise with Databricks platform using Spark for big data processing

- Proficiency in Python programming and data manipulation libraries like Pandas, PySpark

- Strong working knowledge of SQL for data querying and transformations

- Solid understanding of ETL design patterns and data warehousing principles

- Azure Data Engineer certification is a plus

(ref:hirist.tech)
  • Cloud Engineer

    3 weeks ago


    Noida, Uttar Pradesh, India NTT DATA Full time

    Req ID 274327NTT DATA Services strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Cloud Engineer to join our team in Noida Uttar Pradesh IN-UP India IN At NTT DATA we know that with the...

  • Senior Data Engineer

    4 weeks ago


    Noida, Uttar Pradesh, India A Data Science Company Full time

    Company DescriptionA fast-growing data-science company, serving clients across industries and geographies.Position: Senior Data Engineer (Azure)Experience : 5y to 10yLocation : NOIDAWork Mode : In Office onlyInterview Process : 3 Tech rounds, Fitment round, HR round.Joining : Immediate to 30 daysCTC Offered: Based on skillset and experienceRole...


  • Noida, Uttar Pradesh, India NTT Data Full time

    Job DescriptionReq ID:304573NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Cloud Engineer Advisor to join our team in Noida, Uttar Pradesh (IN-UP), India (IN).Preferred...


  • Noida, Uttar Pradesh, India NTT DATA Full time

    Req ID 309491NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a AWS Azure Cloud Engineer to join our team in Noida Uttar Pradesh IN-UP India IN Position s General Duties and Tasks...

  • Cloud Data Engineer

    2 days ago


    Noida, Uttar Pradesh, India beBeeDataEngineer Full time US$ 80,000 - US$ 1,20,000

    Job Title: Data Engineer for Cloud PlatformsDescription:We are seeking a seasoned Data Engineer to join our team. The ideal candidate will have expertise in designing, developing, and maintaining robust ETL/ELT pipelines using tools like Apache Spark, Airflow, or similar.Responsibilities:Design and develop data architectures on cloud platforms such as AWS,...

  • Lead Data Engineer

    4 weeks ago


    Noida, Uttar Pradesh, India SUPERSOURCING TECHNOLOGIES PRIVATE LIMITED Full time

    About the Role:We are looking for an experienced Lead Data Engineer with deep expertise in Big Data technologies, particularly within the Google Cloud Platform (GCP) ecosystem. The ideal candidate should have a strong command of PySpark/Spark, SQL, and Python, and a proven track record in building, optimizing, and managing large- scale data pipelines and...


  • Noida, Uttar Pradesh, India Coforge Full time

    We're Hiring: AWS Cloud Data Migration Engineer Location: Greater Noida Work Mode: Full-time | Onsite (5 days/week at our ODC) Experience: 8–12 Years Coforge Ltd. is looking for an experienced AWS Cloud Data Migration Engineer to lead enterprise-level data transformation initiatives. If you have a strong background in legacy data systems,...


  • Noida, Uttar Pradesh, India Coforge Full time

    We're Hiring: AWS Cloud Data Migration Engineer Location: Greater Noida Work Mode: Full-time | Onsite (5 days/week at our ODC) Experience: 8–12 Years Coforge Ltd. is looking for an experienced AWS Cloud Data Migration Engineer to lead enterprise-level data transformation initiatives. If you have a strong background in legacy data systems,...


  • Noida, Uttar Pradesh, India Coforge Full time

    We're Hiring: AWS Cloud Data Migration Engineer Location: Greater Noida Work Mode: Full-time | Onsite (5 days/week at our ODC) Experience: 8–12 YearsCoforge Ltd. is looking for an experienced AWS Cloud Data Migration Engineer to lead enterprise-level data transformation initiatives.If you have a strong background in legacy data systems, cloud-based...


  • Noida, Uttar Pradesh, India Coforge Full time

    We're Hiring: AWS Cloud Data Migration Engineer Location: Greater Noida Work Mode: Full-time | Onsite (5 days/week at our ODC) Experience: 8–12 YearsCoforge Ltd. is looking for an experienced AWS Cloud Data Migration Engineer to lead enterprise-level data transformation initiatives.If you have a strong background in legacy data systems, cloud-based...