Lead Azure Data Engineer

4 weeks ago

India RandomTrees Full time

Immediate #HIRING for a highly motivated and experienced Lead Azure Data Engineer to join our growing team.


We’re a leading software company specializing in Artificial Intelligence, Machine Learning, Data Analytics, Innovative data solutions, Cloud-based technologies


If you're passionate about building robust applications and thrive in a dynamic environment, please share your resume at rizwana@randomtrees.com.


Overview

We are looking for a highly skilled Lead Data Engineer with deep hands-on expertise in Azure and Databricks. This is a senior technical role with high expectations. The consultant must be extremely hands-on, technically strong in Azure and Databricks, and capable of delivering high-quality solutions with speed and precision.

The ideal candidate is a hands-on problem solver who ensures efficiency in his own work while also helping the wider team become more productive and technically stronger.

Key Responsibilities

  • Design, develop, and optimize data pipelines using Azure and Databricks.
  • Hands-on work with Databricks Asset Bundles (DABs) for CI/CD and environment management.
  • Build and manage scalable ELT/ETL workflows with Databricks, Delta Lake, ADF, and other Azure services.
  • Continuously adopt and apply new Databricks features to accelerate delivery.
  • Optimize Spark, SQL, and Python code for performance and scalability.
  • Apply software engineering best practices (e.g., TDD, CI/CD, modular design, code reviews) to ensure a robust, maintainable, and strategic data ecosystem.
  • Mentor team members to improve overall team productivity and technical capability.
  • Deliver in a fast-paced environment with quick turnaround expectations.

Required Skills & Experience

  • 8+ years in Data Engineering with at least 5 years hands-on in Azure & Databricks.
  • Strong expertise in:
  • Databricks (Delta Lake, Databricks SQL, Workflows, Databricks Asset Bundles, MLflow basics, unity catalog)
  • Azure Data Services (ADF, Azure Synapse (good to have), Azure Data Lake, Azure SQL)
  • Python, SQL, Spark (with proven performance optimization skills)
  • Strong knowledge of modern data architectures (Lakehouse, governance).
  • Track record of efficient delivery and helping teams accelerate execution.

Soft Skills & Attributes

  • Efficiency-driven mindset – focused on speeding up both personal and team delivery.
  • Strong communicator within the team, able to share knowledge and mentor effectively.
  • Highly motivated, proactive, and results-oriented.
  • Ability to work in a fast-paced environment with quick turnarounds.
  • Team-first approach – drives collective improvement and efficiency.

Preferred Skills

  • Experience with AI-driven development (e.g., Cursor.ai, GitHub Copilot, or similar tools) to accelerate coding, improve productivity, and maintain high-quality implementations.
  • Exposure to Generative AI in Databricks (LLMOps, Model Serving, MosaicML, vector search) – good to have.

Work Hours

  • Must have 5–6 hours daily overlap with USA team (EST time zone) for collaboration.

  • Azure Data Engineer

    4 days ago

    Pune, India Fragma Data Systems Full time

    Job Description Technology Skills - Building and operationalizing large scale enterprise data solutions and applications using one or more of AZURE data and analytics services in combination with custom solutions - Azure Synapse/Azure SQL DWH, Azure Data Lake, Azure Blob Storage, Spark, HDInsights, Databricks, CosmosDB, EventHub/IOTHub. - Experience in...

  • Azure Data Engineer

    2 weeks ago

    Hyderabad, India Fragma Data Systems Full time

    Job Description Must-Have Skills - Good experience in Pyspark - Including Dataframe core functions and Spark SQL - Good experience in SQL DBs - Be able to write queries including fair complexity. - Should have excellent experience in Big Data programming for data transformation and aggregations - Good at ELT architecture. Business rules processing and data...

  • Azure Data Architect

    4 weeks ago

    Bengaluru, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Azure Data Architect to join our team in Bangalore, Karntaka (IN-KA), India (IN). Azure - Architect Job...

  • Lead azure data engineer

    3 weeks ago

    India RandomTrees Full time

    Immediate #HIRING for a highly motivated and experienced Lead Azure Data Engineer to join our growing team. We’re a leading software company specializing in Artificial Intelligence, Machine Learning, Data Analytics, Innovative data solutions, Cloud-based technologies If you're passionate about building robust applications and thrive in a dynamic...

  • Azure Data Engineer Lead

    7 days ago

    Bengaluru, Karnataka, India, Karnataka Creative Synergies Group Full time

    Creative Synergies Group OverviewCreative is a leading Global Technology Services firm delivering innovative solutions that build upon synergies between our Deep Engineering Domain Expertise and Digital Engineering ServicesWe work with clients across the Global Transportation, Energy/Process, Industrial Products, Hi-Tech, and EdTech verticalsCreative’s...

  • Lead Azure Data Engineer

    4 weeks ago

    India RandomTrees Full time

    Immediate #HIRING for a highly motivated and experienced Lead Azure Data Engineer to join our growing team. We’re a leading software company specializing in Artificial Intelligence, Machine Learning, Data Analytics, Innovative data solutions, Cloud-based technologies If you're passionate about building robust applications and thrive in a dynamic...

  • Lead Azure Data Engineer

    4 weeks ago

    India RandomTrees Full time

    Immediate #HIRING for a highly motivated and experienced Lead Azure Data Engineer to join our growing team. We’re a leading software company specializing in Artificial Intelligence, Machine Learning, Data Analytics, Innovative data solutions, Cloud-based technologies If you're passionate about building robust applications and thrive in a...

  • Azure Data Architect

    3 weeks ago

    Bengaluru, India NTT DATA North America Full time

    Job Description Req ID: 341135 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Azure Data Architect to join our team in Bangalore, Karntaka (IN-KA), India (IN). Azure -...

  • Mid-Level Azure Stack Engineer

    2 weeks ago

    India NTT DATA Full time US$ 1,04,000 - US$ 1,30,878 per year

    Req ID: 336843NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Mid-Level Azure Stack Engineer to join our team in Remote, Karnātaka (IN-KA), India (IN). Job Title: Mid-Level Azure...

  • Azure data engineer

    3 weeks ago

    India RapidBrains Full time

    Position – Senior Azure Data Engineer Location: PAN India Employment Type: Full-time Notice Period - Immediate Joiners Only About the Role We are seeking an experienced Senior Data Engineer to join our IT division and play a pivotal role in supporting the company’s global operations across diverse sectors. The ideal candidate will have strong...