Lead Azure Data Engineer

3 weeks ago

Delhi, Delhi, India Celebal Technologies Full time
Job Title: Lead Data Engineer

Experience Level: Mid - Senior Level

Location: Delhi

Duration: Fulltime

Experience Required: 6-8+ Years

Description: We are seeking a highly skilled and experienced Lead Azure Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, with a focus on working with Databricks, PySpark, Scala-Spark, and advanced SQL. This role requires hands-on experience in implementing or migrating projects to Unity Catalog, optimizing performance on Databricks Spark, and orchestrating workflows using various tools.

Key Responsibilities:

Data engineering and analytics project delivery experience Minimum 7 years

Min. 2 project done in past of Databricks Migration (Ex. Hadoop to Databricks, Teradata to Databricks, Oracle to Databricks, Talend to Databricks etc)

Hands on with Advanced SQL and Pyspark and/or Scala Spark

Min 3 project done in past on Databricks where performance optimization activity was done

• Design, develop, and optimize data pipelines and ETL processes using Databricks and Apache Spark.

Implement and optimize performance on Databricks Spark, ensuring efficient data processing and management.

Develop and validate data formulation and data delivery for Big Data projects.

Collaborate with cross-functional teams to define, design, and implement data solutions that meet business requirements.

Conduct performance tuning and optimization of complex queries and data models.

• Manage and orchestrate data workflows using tools such as Databricks Workflow, Azure Data Factory (ADF), Apache Airflow, and/or AWS Glue.

Maintain and ensure data security, quality, and governance throughout the data lifecycle.

Technical Skills:

• Extensive experience with PySpark and Scala-Spark.

• Advanced SQL skills for complex data manipulation and querying.

• Proven experience in performance optimization on Databricks Spark across at least three projects.

• Hands-on experience with data formulation and data delivery validation in Big Data projects.

• Experience in data orchestration using at least two of the following: Databricks Workflow, Azure Data Factory (ADF), Apache Airflow, AWS Glue.

• Experience in Azure Synapse

  • Lead Azure Data Engineer

    3 weeks ago

    Delhi, Delhi, India Celebal Technologies Full time

    Job Title: Lead Azure Data Engineer Experience Level: Mid - Senior Level Location: Delhi Duration: Fulltime Experience Required: 6-8+ Years Job Summary: We are looking for a Tech Lead – Data Engineering with 6+ years of hands-on experience in designing and building robust data pipelines and architectures on the Azure cloud platform. The ideal...

  • Lead Azure Data Engineer

    4 weeks ago

    Delhi, Delhi, India Celebal Technologies Full time

    Job Title: Lead Azure Data EngineerExperience Level: Mid - Senior LevelLocation: DelhiDuration: FulltimeExperience Required: 6-8+ YearsJob Summary:We are looking for a Tech Lead – Data Engineering with 6+ years of hands-on experience in designing and building robust data pipelines and architectures on the Azure cloud platform. The ideal candidate should...

  • Senior Azure Data Engineer

    2 weeks ago

    Delhi, Delhi, India Programmers Full time

    Job Title: Senior Azure Data EngineerJob Location: RemoteSkills Required: Power BI, Synapse, Azure Data Factory, Azure Databricks, and ADLS Gen2, PySpark, SQLShift Timings: General ShiftExperience Range: 12–15 YearsJob Summary:We are seeking a highly skilled and experienced Senior Azure Data Engineer to join our team. The ideal candidate will have deep...

  • Azure Data Engineer

    4 weeks ago

    Delhi, Delhi, India Redihire Global Services Pvt Ltd Full time

    Duration : 6 monthsLocation : RemoteTimings : Full Time (As per company timings)Notice Period : (Immediate Joiner - Only)Experience : 3-6 YearsJD : The role will leverage & enhance existing technologies in the area of Data and analytics Solutions like Power BI, Azure data engineering technologies, Teradata/Snowflake, and other Azure services. The role will...

  • Azure data Engineer Trainer(Online)

    1 week ago

    Delhi, Delhi, India Coding Superstar Full time

    Job Title: Azure Data Engineering Trainer (Online)Location: Remote (India)Type: Part-time / Freelance / Weekend availability preferredCompany: Coding SuperstarAbout Us:Coding Superstar is a leading edtech company offering job-oriented IT training focused on real-world projects and high-conversion placement support. We are looking for passionate trainers...

  • Engineering Manager – Big Data, Azure

    4 weeks ago

    Delhi, Delhi, India DataE2E Technologies Full time

    Job Title: Engineering Manager – Big Data, Azure & DatabricksLocation: RemoteEmployment Type: Full-timeDepartment: Data Engineering / TechnologyExperience: 8+ years (3+ years in a managerial role)About the Role:We are seeking a highly experienced and strategic Engineering Manager with deep expertise in Big Data platforms , Microsoft Azure , and ...

  • Senior Azure Data Engineer

    3 weeks ago

    Delhi, Delhi, India Xpetize Technology Solutions Full time

    Job Title : Senior Azure Data EngineerExperience : 8+ YearsLocation : Summary : We are looking for a highly skilled and experienced Azure Data Engineer with over 8 years of expertise in data engineering and a strong background in Azure cloud services. The ideal candidate will be responsible for designing, developing, and optimizing data pipelines and...

  • Senior Azure Data Engineer

    4 weeks ago

    Delhi, Delhi, India Shadow Placements Full time

    Job Title : Senior Azure Data EngineerLocation : RemoteTimings : UK Shift & US Shift timingsiO Associates is seeking a Senior Data Engineer skilled in building and managing robust ETL/data pipelines across diverse data sources and formats using Databricks, Python, and Scala.Strong expertise in data modelling, data warehousing, and CI/CD practices.Proficient...

  • Azure Databricks Engineer

    3 days ago

    Delhi, Delhi, India Proso Full time

    Proso AI is Hiring – Azure Databricks Engineer (Contract Role)We are looking for an experienced Azure Databricks Engineer for a short-term role (3–4 months).Experience Required: 7+ yearsKey Skills & Responsibilities:Create/modify Azure Data Factory pipelinesDevelop and optimize Databricks notebooks using SQL & PythonWork with file formats: Parquet,...

  • Azure Infrastructure Engineer

    4 weeks ago

    Delhi, Delhi, India KK Software Associates (Global) Pvt Ltd Full time

    Role Overview :We are seeking a highly skilled Azure Infrastructure Engineer based in India to support a major enterprise cloud and data modernization initiative. The engineer will be responsible for designing, deploying, and managing secure, scalable, and resilient Azure infrastructure to support modern data services, including a Profisee-based Master Data...