Lead Azure Data Engineer

3 weeks ago

Gandhinagar, Gujarat, India RandomTrees Full time

Immediate #HIRING for a highly motivated and experienced Lead Azure Data Engineer to join our growing team.

We're a leading software company specializing in Artificial Intelligence, Machine Learning, Data Analytics, Innovative data solutions, Cloud-based technologies

If you're passionate about building robust applications and thrive in a dynamic environment, please share your resume at rizwana@randomtrees.com.

Overview

We are looking for a highly skilled Lead Data Engineer with deep hands-on expertise in Azure and Databricks. This is a senior technical role with high expectations. The consultant must be extremely hands-on, technically strong in Azure and Databricks, and capable of delivering high-quality solutions with speed and precision.

The ideal candidate is a hands-on problem solver who ensures efficiency in his own work while also helping the wider team become more productive and technically stronger.

Key Responsibilities

  • Design, develop, and optimize data pipelines using Azure and Databricks.
  • Hands-on work with Databricks Asset Bundles (DABs) for CI/CD and environment management.
  • Build and manage scalable ELT/ETL workflows with Databricks, Delta Lake, ADF, and other Azure services.
  • Continuously adopt and apply new Databricks features to accelerate delivery.
  • Optimize Spark, SQL, and Python code for performance and scalability.
  • Apply software engineering best practices (e.g., TDD, CI/CD, modular design, code reviews) to ensure a robust, maintainable, and strategic data ecosystem.
  • Mentor team members to improve overall team productivity and technical capability.
  • Deliver in a fast-paced environment with quick turnaround expectations.

Required Skills & Experience

  • 8+ years in Data Engineering with at least 5 years hands-on in Azure & Databricks.
  • Strong expertise in:
  • Databricks (Delta Lake, Databricks SQL, Workflows, Databricks Asset Bundles, MLflow basics, unity catalog)
  • Azure Data Services (ADF, Azure Synapse (good to have), Azure Data Lake, Azure SQL)
  • Python, SQL, Spark (with proven performance optimization skills)
  • Strong knowledge of modern data architectures (Lakehouse, governance).
  • Track record of efficient delivery and helping teams accelerate execution.

Soft Skills & Attributes

  • Efficiency-driven mindset – focused on speeding up both personal and team delivery.
  • Strong communicator within the team, able to share knowledge and mentor effectively.
  • Highly motivated, proactive, and results-oriented.
  • Ability to work in a fast-paced environment with quick turnarounds.
  • Team-first approach – drives collective improvement and efficiency.

Preferred Skills

  • Experience with AI-driven development (e.g., Cursor.ai, GitHub Copilot, or similar tools) to accelerate coding, improve productivity, and maintain high-quality implementations.
  • Exposure to Generative AI in Databricks (LLMOps, Model Serving, MosaicML, vector search) – good to have.

Work Hours

  • Must have 5–6 hours daily overlap with USA team (EST time zone) for collaboration.

  • Lead Azure Migration Specialist

    2 weeks ago

    Gandhinagar, Gujarat, India beBeeAzure Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Azure Data EngineerWe are seeking a skilled Azure Data Engineer with hands-on experience in modern data engineering tools and platforms within the Azure ecosystem.The ideal candidate will have a strong foundation in data integration, transformation, and migration, along with a passion for working on complex data migration projects.Key...

  • Lead Data Engineering Specialist

    2 weeks ago

    Gandhinagar, Gujarat, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Data Engineer Job DescriptionWe are seeking a highly skilled Senior Data Engineer to lead our data engineering efforts. The ideal candidate will have expertise in cloud platforms, ETL processes, data warehousing, and big data technologies.Job RequirementsTo design, deploy, and maintain large-scale data platforms with high efficiency and scalability.To...

  • Azure Devops Engineer

    1 week ago

    Gandhinagar, Gujarat, India Prometheantech Full time

    We re on the lookout for experienced Azure DevOps Engineer to join our dynamic team Position Overview As an Azure DevOps Engineer at PrometheanTech you will play a crucial role in designing implementing and maintaining our continuous integration and continuous delivery CI CD pipelines You will work closely with our development and operations...

  • Cloud-Native Data Engineer

    2 weeks ago

    Gandhinagar, Gujarat, India beBeeDataEngineer Full time ₹ 60,00,000 - ₹ 1,00,00,000

    Unlock the Power of Data Engineering with AzureWe are seeking an experienced data professional to lead the design, development, and optimization of cloud-native data engineering frameworks, leveraging Microsoft Azure.This pivotal role will play a key part in building scalable data pipelines, implementing enterprise-grade data governance, security, and...

  • Azure DevOps Engineer

    15 hours ago

    Gandhinagar, Gujarat, India Prometheantech Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    We're on the lookout for experienced Azure DevOps Engineer to join our dynamic teamPosition Overview:As an Azure DevOps Engineer at PrometheanTech, you will play a crucial role in designing, implementing, and maintaining our continuous integration and continuous delivery (CI/CD) pipelines. You will work closely with our development and operations teams to...

  • Senior Data Engineer Position

    2 weeks ago

    Gandhinagar, Gujarat, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Description:As a senior data engineer, you will be responsible for designing and developing large-scale data pipelines using Azure Data Factory and Databricks. This role involves collaborating with cross-functional teams to identify business requirements and develop data-driven solutions.The ideal candidate will have a strong understanding of data...

  • Senior Lead Data Engineering Specialist

    2 weeks ago

    Gandhinagar, Gujarat, India beBeeDataEngineer Full time ₹ 25,00,000 - ₹ 35,00,000

    Data Engineer Role Summary:We are seeking a seasoned and innovative data expert to lead the development of our enterprise data strategy.Key Responsibilities:Design, architect, and optimize complex data pipelines using Databricks and Azure Data Services.Develop scalable data solutions using Python, PySpark, and distributed computing frameworks.Maintain...

  • Senior Data Engineer

    2 weeks ago

    Gandhinagar, Gujarat, India beBeeDataEngineering Full time ₹ 26,81,351 - ₹ 31,35,817

    Our Ideal CandidateWe are seeking an accomplished Data Engineering Leader to spearhead the development of our self-service data platform. The ideal candidate will have a strong background in designing scalable data solutions, leveraging technologies such as Databricks, SQL, Python, Spark, and Delta Lake on Azure.Key Responsibilities:Design and implement data...

  • Azure Power Platform Solutions Architect

    2 weeks ago

    Gandhinagar, Gujarat, India beBeeDataEngineer Full time US$ 8,00,000 - US$ 10,00,000

    Job TitleA pioneering role awaits an exceptional Data and AI Platform Engineer to lead the design, implementation, and operation of Azure + Power Platform solutions. About the RoleThis is a pivotal opportunity to shape the enterprise Market Management pilot by architecting and delivering a cutting-edge Azure + Power Platform stack. The successful candidate...

  • Data Engineering Solutions Specialist

    2 weeks ago

    Gandhinagar, Gujarat, India beBeeDataEngineering Full time ₹ 18,66,000 - ₹ 25,18,000

    Job Description:We are seeking a highly skilled Data Engineering Solutions Specialist to join our team. In this role, you will be responsible for designing, developing, and managing data pipelines and transformation frameworks that enable analytics, reporting, and business intelligence capabilities across the enterprise.You will work closely with data...