Lead Azure Data Engineer

11 hours ago

bangalore, India RandomTrees Full time

Immediate #HIRING for a highly motivated and experienced Lead Azure Data Engineer to join our growing team.


We’re a leading software company specializing in Artificial Intelligence, Machine Learning, Data Analytics, Innovative data solutions, Cloud-based technologies


If you're passionate about building robust applications and thrive in a dynamic environment, please share your resume at rizwana@randomtrees.com.


Overview

We are looking for a highly skilled Lead Data Engineer with deep hands-on expertise in Azure and Databricks. This is a senior technical role with high expectations. The consultant must be extremely hands-on, technically strong in Azure and Databricks, and capable of delivering high-quality solutions with speed and precision.

The ideal candidate is a hands-on problem solver who ensures efficiency in his own work while also helping the wider team become more productive and technically stronger.

Key Responsibilities

  • Design, develop, and optimize data pipelines using Azure and Databricks.
  • Hands-on work with Databricks Asset Bundles (DABs) for CI/CD and environment management.
  • Build and manage scalable ELT/ETL workflows with Databricks, Delta Lake, ADF, and other Azure services.
  • Continuously adopt and apply new Databricks features to accelerate delivery.
  • Optimize Spark, SQL, and Python code for performance and scalability.
  • Apply software engineering best practices (e.g., TDD, CI/CD, modular design, code reviews) to ensure a robust, maintainable, and strategic data ecosystem.
  • Mentor team members to improve overall team productivity and technical capability.
  • Deliver in a fast-paced environment with quick turnaround expectations.

Required Skills & Experience

  • 8+ years in Data Engineering with at least 5 years hands-on in Azure & Databricks.
  • Strong expertise in:
  • Databricks (Delta Lake, Databricks SQL, Workflows, Databricks Asset Bundles, MLflow basics, unity catalog)
  • Azure Data Services (ADF, Azure Synapse (good to have), Azure Data Lake, Azure SQL)
  • Python, SQL, Spark (with proven performance optimization skills)
  • Strong knowledge of modern data architectures (Lakehouse, governance).
  • Track record of efficient delivery and helping teams accelerate execution.

Soft Skills & Attributes

  • Efficiency-driven mindset – focused on speeding up both personal and team delivery.
  • Strong communicator within the team, able to share knowledge and mentor effectively.
  • Highly motivated, proactive, and results-oriented.
  • Ability to work in a fast-paced environment with quick turnarounds.
  • Team-first approach – drives collective improvement and efficiency.

Preferred Skills

  • Experience with AI-driven development (e.g., Cursor.ai, GitHub Copilot, or similar tools) to accelerate coding, improve productivity, and maintain high-quality implementations.
  • Exposure to Generative AI in Databricks (LLMOps, Model Serving, MosaicML, vector search) – good to have.

Work Hours

  • Must have 5–6 hours daily overlap with USA team (EST time zone) for collaboration.

  • Senior Azure Data Engineer

    12 hours ago

    bangalore, India Programmers.io Full time

    Job Title: Senior Azure Data EngineerJob Location: RemoteSkills Required: Azure Synapse, Azure Data Factory, Azure Databricks, and ADLS Gen2, PySpark, SQL,Microsoft Fabrics.Shift Timings: General ShiftExperience Range: 12–15 YearsJob Summary:We are seeking a highly skilled and experienced Senior Azure Data Engineer to join our team. The ideal candidate...

  • Azure Data Engineering Consultant

    1 day ago

    Bangalore, India Infosys Consulting Full time

    Infosys Consulting, the management consulting business of Infosys, is looking to hire Data Engineer. You should have between 3 to 10 years of Data Engineering experience. Successful candidates will be part of a specialized customer-facing Advanced Analytics team in our rapidly expanding Automation & Artificial Intelligence Consulting Practice. They will...

  • Azure Data Engineering Consultant

    10 hours ago

    bangalore, India Infosys Consulting Full time

    Infosys Consulting, the management consulting business of Infosys, is looking to hire Data Engineer. You should have between 3 to 10 years of Data Engineering experience.Successful candidates will be part of a specialized customer-facing Advanced Analytics team in our rapidly expanding Automation & Artificial Intelligence Consulting Practice. They will work...

  • Azure Data Engineering Consultant

    4 hours ago

    Bangalore, India Infosys Consulting Full time

    Infosys Consulting, the management consulting business of Infosys, is looking to hire Data Engineer. You should have between 3 to 10 years of Data Engineering experience. Successful candidates will be part of a specialized customer-facing Advanced Analytics team in our rapidly expanding Automation & Artificial Intelligence Consulting Practice. They will...

  • Azure Data Engineer

    1 week ago

    Bangalore South, India ANRGI TECH Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Job Title: Azure data engineer Locations: Bangalore, Pune. Hyderabad, Chennai, Gurugaon We are looking for a Senior Data Engineer with strong expertise in SQL, Python, Azure Synapse, Azure Data Factory, Snowflake, and Databricks. The ideal candidate should have a solid understanding of SQL (DDL, DML, query optimization) and ETL pipelines while...

  • Azure Fabric Data Engineer

    7 hours ago

    Bangalore, India Jobted IN C2 Full time

    Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations unlock the value of...

  • Azure Data Engineer

    10 hours ago

    bangalore, India Xebia Full time

    🚀 We’re Hiring | Azure Data Engineer | Bangalore (Hybrid) 🚀We are looking for immediate joiners (6–10 years experience) with strong expertise in building end-to-end data pipelines and delivering scalable data solutions on Azure.📍 Location: Bangalore (Hybrid, 3 days office/week) 🕒 Notice Period: Immediate to 2 weeks – only apply if you can...

  • Azure Data Engineer

    10 hours ago

    bangalore, India Tata Consultancy Services Full time

    Greetings from TCS!Job Title: Azure Data EngineerRequired Skillset: Azure Databricks(Strong),scala(strong), Pyspark(Good to have)Location: PAN INDIAExperience Range: 4-10 yearsJob Description4 or more years of experience working on Azure Databricks using Scala, PySpark4 or more years of experience on Azure Cloud platform4 or more years of full Software...

  • Azure Data Engineer

    11 hours ago

    bangalore, India iO Associates Full time

    Azure Data Engineer - Databricks ExpertREMOTEFull-timeShift Timings: 2 pm - 11 pm IST Our client is a leading AI-driven tech company transforming global enterprises with innovative solutions in data intelligence, automation, and responsible AI. With a mission to help enterprises modernize and scale, they focus on delivering intelligent, future-ready...

  • Azure Data Engineering Lead

    6 days ago

    Kolkata, Bengaluru / Bangalore, Hyderabad / Secunderabad, Telangana, India beBeeData Full time ₹ 7,00,000 - ₹ 10,00,000

    Job Title: Azure Data EngineerLocation State: Karnataka, Telangana, West Bengal, Orissa.Location City: Bangalore, Hyderabad, Kolkata, Bhubaneswar.Experience Required: 5 to 8 years.Essential Job Functions:Azure Data Factory ETL Pipeline Specialist.Minimum 5-6 years of hands-on experience in designing and implementing large-scale data integration using Azure...