Lead Azure Data Engineer

12 hours ago

India RandomTrees Full time

Immediate #HIRING for a highly motivated and experienced Lead Azure Data Engineer to join our growing team.

We're a leading software company specializing in Artificial Intelligence, Machine Learning, Data Analytics, Innovative data solutions, Cloud-based technologies

If you're passionate about building robust applications and thrive in a dynamic environment, please share your resume at

Overview

We are looking for a highly skilled Lead Data Engineer with deep hands-on expertise in Azure and Databricks . This is a senior technical role with high expectations. The consultant must be extremely hands-on, technically strong in Azure and Databricks, and capable of delivering high-quality solutions with speed and precision.

The ideal candidate is a hands-on problem solver who ensures efficiency in his own work while also helping the wider team become more productive and technically stronger.

Key Responsibilities

  • Design, develop, and optimize data pipelines using Azure and Databricks .
  • Hands-on work with Databricks Asset Bundles (DABs) for CI/CD and environment management.
  • Build and manage scalable ELT/ETL workflows with Databricks, Delta Lake, ADF, and other Azure services.
  • Continuously adopt and apply new Databricks features to accelerate delivery.
  • Optimize Spark, SQL, and Python code for performance and scalability .
  • Apply software engineering best practices (e.g., TDD, CI/CD, modular design, code reviews) to ensure a robust, maintainable, and strategic data ecosystem .
  • Mentor team members to improve overall team productivity and technical capability .
  • Deliver in a fast-paced environment with quick turnaround expectations .

Required Skills & Experience

  • 8+ years in Data Engineering with at least 5 years hands-on in Azure & Databricks .
  • Strong expertise in:
  • Databricks (Delta Lake, Databricks SQL, Workflows, Databricks Asset Bundles , MLflow basics, unity catalog)
  • Azure Data Services (ADF, Azure Synapse (good to have), Azure Data Lake, Azure SQL)
  • Python, SQL, Spark (with proven performance optimization skills)
  • Strong knowledge of modern data architectures (Lakehouse, governance).
  • Track record of efficient delivery and helping teams accelerate execution.

Soft Skills & Attributes

  • Efficiency-driven mindset – focused on speeding up both personal and team delivery.
  • Strong communicator within the team , able to share knowledge and mentor effectively.
  • Highly motivated, proactive, and results-oriented .
  • Ability to work in a fast-paced environment with quick turnarounds .
  • Team-first approach – drives collective improvement and efficiency .

Preferred Skills

  • Experience with AI-driven development (e.g., Cursor.ai, GitHub Copilot, or similar tools) to accelerate coding, improve productivity, and maintain high-quality implementations.
  • Exposure to Generative AI in Databricks (LLMOps, Model Serving, MosaicML, vector search) – good to have.

Work Hours

  • Must have 5–6 hours daily overlap with USA team (EST time zone) for collaboration.

  • Senior Azure Databricks Engineer

    4 weeks ago

    India Quant-data Full time

    We're Hiring: Senior Azure Databricks Engineer (Remote | Full-Time) Join us to build scalable, cloud-native data solutions using cutting-edge technologiesWe're looking for an experienced and driven Senior Azure Databricks Engineer to join our growing team. This role is ideal for professionals with 6–10 years of experience in the data engineering space,...

  • Azure Data Engineer

    3 weeks ago

    India MindBrain Full time

    Position: Azure Data Engineer Location: Remote Experience: 4+ Years Notice Period: Immediate Joiners Only Overview: We are looking for an experienced Azure Data Engineer to work in a hybrid Developer + Support role.The position involves enhancing and supporting existing Data & Analytics solutions using Azure technologies, ensuring performance, scalability,...

  • Azure Data Engineer

    3 weeks ago

    India MindBrain Full time

    Position: Azure Data Engineer Location: Remote Experience: 4+ Years Notice Period: Immediate Joiners OnlyOverview: We are looking for an experienced Azure Data Engineer to work in a hybrid Developer + Support role. The position involves enhancing and supporting existing Data & Analytics solutions using Azure technologies, ensuring performance, scalability,...

  • Azure Data Engineer

    3 weeks ago

    India Bloom Consulting Services Full time

    Module Lead Experience Range 6 Years Primary Must have skills - To be Screened by TA Team 3 years of experience in Azure Databricks with PySpark 2 years of experience in Databricks workflow Unity catalog 2 years of experience in ADF Azure Data Factory 2 years of experience in ADLS Gen 22 years of experience in Azure SQL 3 years of...

  • Sr. Azure Data Engineer

    4 weeks ago

    India Mindfire Solutions Full time

    About the JobWe are seeking a highly skilled and motivated Senior Azure Data Engineer to join our growing data team. The ideal candidate will have a strong background in cloud-based data engineering with hands-on experience across a variety of Azure services. This role will play a critical part in designing, building, optimizing, and maintaining scalable...

  • Azure Databricks Lead Engineer

    4 weeks ago

    India Alcor Solutions, Inc. Full time

    Alcor Solutions is a leading digital transformation and cloud consulting firm, enabling enterprises to leverage modern data platforms, cloud-native solutions, and emerging technologies to drive innovation and business outcomes.We are seeking an Azure Databricks Lead Engineer to architect, administer, and scale our enterprise Databricks environment while...

  • Only 24h Left: Lead Azure Data Engineer

    1 day ago

    India RandomTrees Full time

    Immediate #HIRING for a highly motivated and experienced Lead Azure Data Engineer to join our growing team.We're a leading software company specializing in Artificial Intelligence, Machine Learning, Data Analytics, Innovative data solutions, Cloud-based technologiesIf you're passionate about building robust applications and thrive in a dynamic environment,...

  • Sr Azure Data Engineer

    4 weeks ago

    India Techolution Full time

    We are seeking a skilled Sr Azure Data Engineer with hands-on experience in modern data engineering tools and platforms within the Azure ecosystem .The ideal candidate will have a strong foundation in data integration, transformation, and migration , along with a passion for working on complex data migration projects . Job Title: Sr.Azure Data Engineer...

  • Azure data Engineer Trainer(Online)

    3 weeks ago

    India Coding Superstar Full time

    Job Title: Azure Data Engineering Trainer (Online)Location: Remote (India)Type: Part-time / Freelance / Weekend availability preferredCompany: Coding SuperstarAbout Us:Coding Superstar is a leading edtech company offering job-oriented IT training focused on real-world projects and high-conversion placement support. We are looking for passionate trainers who...

  • Engineering Manager – Big Data, Azure

    4 weeks ago

    India DataE2E Technologies Full time

    Job Title: Engineering Manager – Big Data, Azure & DatabricksLocation: RemoteEmployment Type: Full-timeDepartment: Data Engineering / TechnologyExperience: 8+ years (3+ years in a managerial role)About the Role:We are seeking a highly experienced and strategic Engineering Manager with deep expertise in Big Data platforms, Microsoft Azure, and Databricks....