Lead Azure Data Engineer

3 weeks ago

Malappuram, Kerala, India RandomTrees Full time

Immediate #HIRING for a highly motivated and experienced Lead Azure Data Engineer to join our growing team.

We're a leading software company specializing in Artificial Intelligence, Machine Learning, Data Analytics, Innovative data solutions, Cloud-based technologies

If you're passionate about building robust applications and thrive in a dynamic environment, please share your resume at rizwana@randomtrees.com.

Overview

We are looking for a highly skilled Lead Data Engineer with deep hands-on expertise in Azure and Databricks. This is a senior technical role with high expectations. The consultant must be extremely hands-on, technically strong in Azure and Databricks, and capable of delivering high-quality solutions with speed and precision.

The ideal candidate is a hands-on problem solver who ensures efficiency in his own work while also helping the wider team become more productive and technically stronger.

Key Responsibilities

  • Design, develop, and optimize data pipelines using Azure and Databricks.
  • Hands-on work with Databricks Asset Bundles (DABs) for CI/CD and environment management.
  • Build and manage scalable ELT/ETL workflows with Databricks, Delta Lake, ADF, and other Azure services.
  • Continuously adopt and apply new Databricks features to accelerate delivery.
  • Optimize Spark, SQL, and Python code for performance and scalability.
  • Apply software engineering best practices (e.g., TDD, CI/CD, modular design, code reviews) to ensure a robust, maintainable, and strategic data ecosystem.
  • Mentor team members to improve overall team productivity and technical capability.
  • Deliver in a fast-paced environment with quick turnaround expectations.

Required Skills & Experience

  • 8+ years in Data Engineering with at least 5 years hands-on in Azure & Databricks.
  • Strong expertise in:
  • Databricks (Delta Lake, Databricks SQL, Workflows, Databricks Asset Bundles, MLflow basics, unity catalog)
  • Azure Data Services (ADF, Azure Synapse (good to have), Azure Data Lake, Azure SQL)
  • Python, SQL, Spark (with proven performance optimization skills)
  • Strong knowledge of modern data architectures (Lakehouse, governance).
  • Track record of efficient delivery and helping teams accelerate execution.

Soft Skills & Attributes

  • Efficiency-driven mindset – focused on speeding up both personal and team delivery.
  • Strong communicator within the team, able to share knowledge and mentor effectively.
  • Highly motivated, proactive, and results-oriented.
  • Ability to work in a fast-paced environment with quick turnarounds.
  • Team-first approach – drives collective improvement and efficiency.

Preferred Skills

  • Experience with AI-driven development (e.g., Cursor.ai, GitHub Copilot, or similar tools) to accelerate coding, improve productivity, and maintain high-quality implementations.
  • Exposure to Generative AI in Databricks (LLMOps, Model Serving, MosaicML, vector search) – good to have.

Work Hours

  • Must have 5–6 hours daily overlap with USA team (EST time zone) for collaboration.

  • Azure Data Engineer

    2 weeks ago

    Malappuram, Kerala, India Peoplefy Full time

    Job Title: Azure Data EngineerLocation: Bengaluru - OnsiteJob Description:We are looking for a skilled Operations Engineer to support our Azure-based Data Engineering platform powered by Databricks. This role blends DevOps practices, system reliability, and security auditing to ensure our data infrastructure is robust, secure, and scalable. You'll be...

  • Azure Data Engineer Leader

    1 week ago

    Malappuram, Kerala, India beBeeDataEngineering Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job Title: Azure Data Engineering LeadDescriptionWe are seeking a highly skilled and experienced leader to oversee the development of data pipelines using Azure and Databricks.The ideal candidate will have deep hands-on expertise in Azure, Databricks, Delta Lake, and other related technologies.Key Responsibilities:Design, develop, and optimize data pipelines...

  • Data Engineering Lead

    1 week ago

    Malappuram, Kerala, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Job DescriptionWe are seeking an experienced Data Engineer to lead the implementation of infrastructure via code and provide strategic advice/recommendations for the development and advancement of Microsoft Azure technologies.The ideal candidate will have a strong background in Big Data solutions, with experience working as a Data engineer on Azure Cloud.You...

  • Azure Data Engineer

    3 weeks ago

    Malappuram, Kerala, India LTIMindtree Full time

    Role: Azure DataBricks Developer Location: Nagpur/Bhubaneshwar/Kolkata About LTIMindtree: LTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to...

  • Azure Data Migration Specialist

    2 weeks ago

    Malappuram, Kerala, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Azure Data Migration ExpertWe are seeking an experienced Azure data migration expert to lead and execute large-scale data migration projects from on-premises to cloud platforms.

  • Lead Enterprise Data Architect

    2 weeks ago

    Malappuram, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Lead Data EngineerWe are seeking a skilled professional to lead the design, development, and optimization of scalable data projects. This role will involve driving initiatives to improve the Data/AI Practice.Design, build, and optimize data pipelines for large-scale structured and unstructured datasets.Implement ETL/ELT processes using SQL and...

  • Cloud Data Engineering Specialist

    2 weeks ago

    Malappuram, Kerala, India beBeeAzure Full time ₹ 10,00,000 - ₹ 20,00,000

    Job Title: Cloud Data Engineering SpecialistWe are seeking a highly skilled professional with extensive experience in data engineering tools and platforms within the Azure ecosystem.The ideal candidate will have a solid foundation in data integration, transformation, and migration, along with a passion for working on complex data migration projects.Lead the...

  • Cloud Data Engineering Manager

    2 weeks ago

    Malappuram, Kerala, India beBeeCloudDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Cloud Data Engineering LeadWe are seeking a highly skilled and experienced Cloud Data Engineering Lead to drive the migration of an on-premises Enterprise Data Warehouse to a modern cloud-based data platform utilizing Azure Cloud data tools and Snowflake.The successful candidate will be responsible for managing and leading the migration process, ensuring...

  • Highly Experienced Cloud Data Engineer Wanted

    2 weeks ago

    Malappuram, Kerala, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Engineer Lead for Azure SolutionsWe seek a seasoned Data Engineer to lead our team in designing and implementing scalable data solutions on the Azure platform.This is an opportunity for a technical leader who can architect, develop, and deliver high-quality data engineering projects leveraging Azure services.To be successful, you will have extensive...

  • Strategic Data Engineering Project Lead

    2 weeks ago

    Malappuram, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Technical Project ManagerAbout the Role: We are seeking a skilled Technical Project Manager to lead and deliver projects in data engineering and analytics. The successful candidate will manage cross-functional teams to execute data platform, pipeline, and analytics initiatives, ensuring alignment with business objectives and timely...