Lead Azure Data Engineer

3 weeks ago

GTB Nager, India Celebal Technologies Full time

Job Title: Lead Data Engineer

Experience Level: Mid - Senior Level

Location: Delhi

Duration: Fulltime

Experience Required: 6-8+ Years

Description: We are seeking a highly skilled and experienced Lead Azure Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, with a focus on working with Databricks, PySpark, Scala-Spark, and advanced SQL. This role requires hands-on experience in implementing or migrating projects to Unity Catalog, optimizing performance on Databricks Spark, and orchestrating workflows using various tools.

Key Responsibilities:

Data engineering and analytics project delivery experience Minimum 7 years

Min. 2 project done in past of Databricks Migration (Ex. Hadoop to Databricks, Teradata to Databricks, Oracle to Databricks, Talend to Databricks etc)

Hands on with Advanced SQL and Pyspark and/or Scala Spark

Min 3 project done in past on Databricks where performance optimization activity was done


• Design, develop, and optimize data pipelines and ETL processes using Databricks and Apache Spark.

Implement and optimize performance on Databricks Spark, ensuring efficient data processing and management.

Develop and validate data formulation and data delivery for Big Data projects.

Collaborate with cross-functional teams to define, design, and implement data solutions that meet business requirements.

Conduct performance tuning and optimization of complex queries and data models.


• Manage and orchestrate data workflows using tools such as Databricks Workflow, Azure Data Factory (ADF), Apache Airflow, and/or AWS Glue.

Maintain and ensure data security, quality, and governance throughout the data lifecycle.

Technical Skills:


• Extensive experience with PySpark and Scala-Spark.


• Advanced SQL skills for complex data manipulation and querying.


• Proven experience in performance optimization on Databricks Spark across at least three projects.


• Hands-on experience with data formulation and data delivery validation in Big Data projects.


• Experience in data orchestration using at least two of the following: Databricks Workflow, Azure Data Factory (ADF), Apache Airflow, AWS Glue.


• Experience in Azure Synapse

  • Lead Azure Data Engineer

    4 weeks ago

    GTB Nager, India Celebal Technologies Full time

    Job Title: Lead Azure Data Engineer Experience Level: Mid - Senior Level Location: Delhi Duration: Fulltime Experience Required: 6-8+ Years Job Summary: We are looking for a Tech Lead – Data Engineering with 6+ years of hands-on experience in designing and building robust data pipelines and architectures on the Azure cloud platform. The ideal candidate...

  • Lead Azure Data Engineer

    4 weeks ago

    GTB Nager, India Celebal Technologies Full time

    Job Title: Lead Azure Data EngineerExperience Level: Mid - Senior LevelLocation: DelhiDuration: FulltimeExperience Required: 6-8+ YearsJob Summary:We are looking for a Tech Lead – Data Engineering with 6+ years of hands-on experience in designing and building robust data pipelines and architectures on the Azure cloud platform. The ideal candidate should...

  • Data Engineer

    4 weeks ago

    GTB Nager, India R Systems Full time

    We are looking for an experienced Data Engineer with strong expertise in Databricks and Azure Data Factory (ADF) to design, build, and manage scalable data pipelines and integration solutions. The ideal candidate will have a solid background in big data technologies, cloud platforms, and data processing frameworks to support enterprise-level data...

  • Data Engineer

    2 weeks ago

    GTB Nager, India R Systems Full time

    We are looking for an experienced Data Engineer with strong expertise in Databricks and Azure Data Factory (ADF) to design, build, and manage scalable data pipelines and integration solutions. The ideal candidate will have a solid background in big data technologies, cloud platforms, and data processing frameworks to support enterprise-level data...

  • GenAI Lead Engineer

    6 hours ago

    GTB Nager, India Vichara Technologies Full time

    We are seeking a highly skilled GenAI Lead Engineer to design and implement advanced frameworks for alternate data analysis in the investment management domain. The candidate will leverage LLM APIs (GPT, LLaMA, etc.), build scalable orchestration pipelines, and architect cloud/private deployments to power next-generation AI-driven investment insights. This...

  • Data Engineer

    4 days ago

    GTB Nager, India Marktine Technology Solutions Pvt Ltd Full time

    Position: Senior Data EngineerExp: 12-15 YearsLocation: RemoteWe are seeking a Senior Data Engineer. The ideal candidate will be based in India and work remotely. This role requires a blend of design and implementation expertise.Key Responsibilities:Design and bootstrap data solutions, including setting up Snowflake for a large, complex conglomerate.Utilize...

  • Machine Learning Engineer

    4 weeks ago

    GTB Nager, India ThoughtSol Infotech Pvt. Ltd Full time

    Designation: - ML / MLOPs EngineerLocation: - Noida (Sector- 132)Key Responsibilities:• Model Development & Algorithm Optimization: Design, implement, and optimize MLmodels and algorithms using libraries and frameworks such as TensorFlow, PyTorch, andscikit-learn to solve complex business problems.• Training & Evaluation: Train and evaluate models using...

  • Data Engineer

    4 weeks ago

    GTB Nager, India EnableMining Full time

    Job Title: Data EngineerCompany: EnableminingLocation: RemoteEmployment Type: Full-timeSeniority Level: Mid-LevelExperience: Minimum 2 yearsEducation: BE/BTech or MCAAbout UsEnablemining is a global mining consultancy headquartered in Australia. We specialize in strategy, mine planning, and technical evaluations for coal and metalliferous mines. Our work is...

  • Data Engineer

    2 weeks ago

    GTB Nager, India EnableMining Full time

    Job Title: Data Engineer Company: Enablemining Location: Remote Employment Type: Full-time Seniority Level: Mid-Level Experience: Minimum 2 years Education: BE/BTech or MCA About Us Enablemining is a global mining consultancy headquartered in Australia. We specialize in strategy, mine planning, and technical evaluations for coal and metalliferous...

  • Data Engineer

    2 weeks ago

    GTB Nager, India SMC Global Securities Ltd. Full time

    JD for Data Engineer : Hiring : Mid-Level Data Engineer Location : Delhi Experience Required : 4 -10 years Job Type : Full-Time Key Skills Required : - Strong proficiency in SQL and Python - Hands-on experience with AWS services, including : Athena, Redshift, EC2, EMR, Lambda, S3, Glue - Proven experience in building and maintaining batch & real-time data...