Lead Azure Data Engineer

2 weeks ago

Lucknow, India RandomTrees Full time

Immediate #HIRING for a highly motivated and experienced Lead Azure Data Engineer to join our growing team.


We’re a leading software company specializing in Artificial Intelligence, Machine Learning, Data Analytics, Innovative data solutions, Cloud-based technologies


If you're passionate about building robust applications and thrive in a dynamic environment, please share your resume at rizwana@randomtrees.com.


Overview

We are looking for a highly skilled Lead Data Engineer with deep hands-on expertise in Azure and Databricks. This is a senior technical role with high expectations. The consultant must be extremely hands-on, technically strong in Azure and Databricks, and capable of delivering high-quality solutions with speed and precision.

The ideal candidate is a hands-on problem solver who ensures efficiency in his own work while also helping the wider team become more productive and technically stronger.

Key Responsibilities

  • Design, develop, and optimize data pipelines using Azure and Databricks.
  • Hands-on work with Databricks Asset Bundles (DABs) for CI/CD and environment management.
  • Build and manage scalable ELT/ETL workflows with Databricks, Delta Lake, ADF, and other Azure services.
  • Continuously adopt and apply new Databricks features to accelerate delivery.
  • Optimize Spark, SQL, and Python code for performance and scalability.
  • Apply software engineering best practices (e.g., TDD, CI/CD, modular design, code reviews) to ensure a robust, maintainable, and strategic data ecosystem.
  • Mentor team members to improve overall team productivity and technical capability.
  • Deliver in a fast-paced environment with quick turnaround expectations.

Required Skills & Experience

  • 8+ years in Data Engineering with at least 5 years hands-on in Azure & Databricks.
  • Strong expertise in:
  • Databricks (Delta Lake, Databricks SQL, Workflows, Databricks Asset Bundles, MLflow basics, unity catalog)
  • Azure Data Services (ADF, Azure Synapse (good to have), Azure Data Lake, Azure SQL)
  • Python, SQL, Spark (with proven performance optimization skills)
  • Strong knowledge of modern data architectures (Lakehouse, governance).
  • Track record of efficient delivery and helping teams accelerate execution.

Soft Skills & Attributes

  • Efficiency-driven mindset – focused on speeding up both personal and team delivery.
  • Strong communicator within the team, able to share knowledge and mentor effectively.
  • Highly motivated, proactive, and results-oriented.
  • Ability to work in a fast-paced environment with quick turnarounds.
  • Team-first approach – drives collective improvement and efficiency.

Preferred Skills

  • Experience with AI-driven development (e.g., Cursor.ai, GitHub Copilot, or similar tools) to accelerate coding, improve productivity, and maintain high-quality implementations.
  • Exposure to Generative AI in Databricks (LLMOps, Model Serving, MosaicML, vector search) – good to have.

Work Hours

  • Must have 5–6 hours daily overlap with USA team (EST time zone) for collaboration.

  • Azure Data Engineer

    3 weeks ago

    Lucknow, Uttar Pradesh, India techolution Full time

    We are seeking a skilled Azure Data Engineer with hands-on experience in modern data engineering tools and platforms within the Azure ecosystem . The ideal candidate will have a strong foundation in data integration, transformation, and migration , along with a passion for working on complex data migration projects . Job Title: Sr. Azure Data Engineer ...

  • Azure DevOps

    2 weeks ago

    Lucknow, India Carnation Infotech Full time

    Role: Azure DevOps & Infrastructure Engineer Permanent Remote WFH Experience: 6 to 8 yrs (Min. 5+ yrs Relevant) Work Timing: Monday to Friday (1:30 PM to 10:30 PM IST) About the Role We are looking for an Azure DevOps / Infrastructure Engineer to design, build, and maintain data ops processes and support warehouse infrastructure on Microsoft Azure. You will...

  • Azure DevOps

    2 weeks ago

    Lucknow, India Carnation Infotech Full time

    We are looking for an Azure DevOps / Infrastructure Engineer to design, build, and maintain data ops processes and support warehouse infrastructure on Microsoft Azure. You will be responsible for implementing DevOps best practices, automating deployments, and supporting a modern data ecosystem that leverages Azure Data Factory, Azure Databricks, Azure...

  • Azure DevOps

    6 days ago

    Lucknow, Uttar Pradesh, India Carnation Infotech Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    We are looking for an Azure DevOps / Infrastructure Engineer to design, build, andmaintain data ops processes and support warehouse infrastructure on Microsoft Azure.You will be responsible for implementing DevOps best practices, automating deployments,and supporting a modern data ecosystem that leverages Azure Data Factory, AzureDatabricks, Azure Functions...

  • AI Engineer – Azure AI

    3 weeks ago

    Lucknow, Uttar Pradesh, India Apidel Technologies Full time

    We are seeking an experienced and highly skilled AI Engineer to design, configure, and optimize enterprise-grade AI solutions using Microsoft Azure AI services. The ideal candidate will have hands-on experience building Retrieval-Augmented Generation (RAG) applications and intelligent agents, integrating services like Azure OpenAI, Cognitive Search, Speech,...

  • Data Engineer

    2 weeks ago

    Lucknow, India Carnation Infotech Full time

    Title Data Engineer 100% Work from Home / Remote Work Timings - 1:30 PM – 10:30 PM Fulltime Role Job Summary As a Data Engineer , you will be responsible for designing, building, and maintaining the infrastructure and tools that enable the organization to collect, store, and analyze large volumes of data. You will work closely with data scientists,...

  • Senior Data Engineer

    4 weeks ago

    Lucknow, Uttar Pradesh, India EXL Full time

    About the RoleWe are seeking a highly skilled Data Engineer with deep expertise in Microsoft Azure to design, build, and optimize scalable data pipelines and Lakehouse architectures. You will work closely with cross-functional teams to provide thought leadership deliver robust, secure, and high-performance data solutions that empower analytics and data...

  • 11-Sep-25_Virtual Drive_Azure Data Engineer

    3 weeks ago

    Lucknow, Uttar Pradesh, India Tata Consultancy Servicess Full time

    Hello,Good day11-Sep-25_virtual Drive_Azure Data EngineerJD Orientation: -Mandatory Skill Set:Extensive expertise in designing and implementing data load processes using Azure Data Factory, Azure Databricks, Delta Lake, Azure Delta Lake Storage and Python/PySpark.Proficient with Databricks & Python.Senior developers with Full Database/ Datawarehouse/...

  • Data/ml engineer

    2 weeks ago

    Lucknow, India Gleantap Full time

    About GleantapGleantap is a customer engagement platform powering fitness, wellness, and service businesses. We’re evolving into an AI-native platform, where intelligent agents predict churn, upsell opportunities, and automate member engagement.We’re looking for a Data/ML Engineer who can bridge the gap between data engineering and applied machine...

  • Principal Data Engineer

    2 weeks ago

    Lucknow, India Xebia Full time

    🚀 We’re Hiring: Principal Data Engineer | Any Xebia Location (Hybrid, 3 days in office per week)📍 Location: Any Xebia Location (Hybrid – 3 days in office per week)💼 Experience Level: 10+ years of Data Engineering with 4+ years team leadership experience📅 Start Date: Immediate to end of SeptemberAbout the Team:As a Principal Data Engineer in...