Lead Azure Data Engineer

5 days ago

Alappuzha, India RandomTrees Full time

Immediate #HIRING for a highly motivated and experienced Lead Azure Data Engineer to join our growing team.


We’re a leading software company specializing in Artificial Intelligence, Machine Learning, Data Analytics, Innovative data solutions, Cloud-based technologies


If you're passionate about building robust applications and thrive in a dynamic environment, please share your resume at rizwana@randomtrees.com.


Overview

We are looking for a highly skilled Lead Data Engineer with deep hands-on expertise in Azure and Databricks. This is a senior technical role with high expectations. The consultant must be extremely hands-on, technically strong in Azure and Databricks, and capable of delivering high-quality solutions with speed and precision.

The ideal candidate is a hands-on problem solver who ensures efficiency in his own work while also helping the wider team become more productive and technically stronger.

Key Responsibilities

  • Design, develop, and optimize data pipelines using Azure and Databricks.
  • Hands-on work with Databricks Asset Bundles (DABs) for CI/CD and environment management.
  • Build and manage scalable ELT/ETL workflows with Databricks, Delta Lake, ADF, and other Azure services.
  • Continuously adopt and apply new Databricks features to accelerate delivery.
  • Optimize Spark, SQL, and Python code for performance and scalability.
  • Apply software engineering best practices (e.g., TDD, CI/CD, modular design, code reviews) to ensure a robust, maintainable, and strategic data ecosystem.
  • Mentor team members to improve overall team productivity and technical capability.
  • Deliver in a fast-paced environment with quick turnaround expectations.

Required Skills & Experience

  • 8+ years in Data Engineering with at least 5 years hands-on in Azure & Databricks.
  • Strong expertise in:
  • Databricks (Delta Lake, Databricks SQL, Workflows, Databricks Asset Bundles, MLflow basics, unity catalog)
  • Azure Data Services (ADF, Azure Synapse (good to have), Azure Data Lake, Azure SQL)
  • Python, SQL, Spark (with proven performance optimization skills)
  • Strong knowledge of modern data architectures (Lakehouse, governance).
  • Track record of efficient delivery and helping teams accelerate execution.

Soft Skills & Attributes

  • Efficiency-driven mindset – focused on speeding up both personal and team delivery.
  • Strong communicator within the team, able to share knowledge and mentor effectively.
  • Highly motivated, proactive, and results-oriented.
  • Ability to work in a fast-paced environment with quick turnarounds.
  • Team-first approach – drives collective improvement and efficiency.

Preferred Skills

  • Experience with AI-driven development (e.g., Cursor.ai, GitHub Copilot, or similar tools) to accelerate coding, improve productivity, and maintain high-quality implementations.
  • Exposure to Generative AI in Databricks (LLMOps, Model Serving, MosaicML, vector search) – good to have.

Work Hours

  • Must have 5–6 hours daily overlap with USA team (EST time zone) for collaboration.

  • Artificial Intelligence Architect

    6 days ago

    Alappuzha, India CONNECTING 2 WORK Full time

    Responsibilities:As an Architect, you drive by Conversational AI & Data Analytics products and solution development. In a typical product lifecycle, you will be working as the technology lead with a sound understanding of the business drivers and the capabilities of IT and how these can contribute to run an organization better or differently. You will lead a...

  • Lead Engineer for Instrument Cluster design

    24 hours ago

    Alappuzha, India Alp Consulting Ltd. Full time

    Job Title: Instrument Cluster Design - Lead EngineerQualification: B.E/ B Tech in Electronics/ E&TCExperience: 8 to 10 YearsLocation: BangaloreResponsibilities:Complete Design and development of Instrument clusters for 2 wheeler/3wheeler/4 wheelers.Preparation of Technical specification document based on inputs from CFT.Interaction with suppliers for...

  • Senior Interface Engine Developer

    5 days ago

    Alappuzha, India IKS Health Full time

    About IKS HealthIKS Health enables the enhanced delivery of exceptional healthcare for today’s practicing clinicians, medical groups and health systems. Supporting healthcare providers through every function of the patient visit, IKS Health is a go-to resource for organizations looking to effectively scale, improve quality and achieve cost savings through...

  • Apply in 3 Minutes: Associate Vice President(Practice Lead)

    20 hours ago

    Alappuzha, India QBurst Full time

    Description We are seeking a dynamic Practice Lead – Quality Engineering to drive the strategic growth of our QE practice. This role combines deep expertise in quality engineering with a strong focus on Go-to-Market (GTM) strategy, business development, and market positioning. The Practice Lead will be responsible for shaping the QE service portfolio,...

  • AI Tech Lead

    6 days ago

    Alappuzha, India CONNECTING 2 WORK Full time

    Job Description Qualification Requirements We are seeking skilled, experienced engineers to join our bourgeoning conversational AI practice and help us build high-quality solutions for our customers. The right candidate will have an understanding of conversational AI (i.e., chatbots, intelligent chat, virtual assistants), natural language processing (NLP),...

  • Senior Test Engineer

    5 days ago

    Alappuzha, India Lucidity Full time

    Role : Senior SDETLocation : Bangalore /RemoteExperience : 3-6 YearsPosition : Full TimeAbout usLucidity is a rapidly growing company with a first of its kind and impactful product in the cloud storage. Joining Lucidity offers the opportunity to work on cutting-edge technology, solve real-world problems for major enterprises, and be part of a company that is...

  • Quality assurance automation engineer

    5 days ago

    Alappuzha, India TestGrid.io Full time

    Job Title: Quality Assurance Automation EngineerLocation: Remote (India)Employment Type: Full-timeJob Description Company Description Test Grid is a leading provider of end-to-end automation cloud and on-premise testing solutions. The company focuses on simplifying the testing process with innovative AI-powered technology to help organizations achieve time...

  • ▷ [Urgent Search] Salesforce QA (Direct Consultant role for 6 Months)

    20 hours ago

    Alappuzha, India Reflections Technologies Full time

    We are 4 to 6 years of experience in QA and minimum 4+ years in Salesforce application. Job Location: Remote Mode: Contract (6 Months duration) Job Description - Experience in QA and Salesforce application. - Agile Development: Experience working in Agile/Scrum teams, sprint planning, and estimation. - Salesforce Platform Knowledge – Understanding of...

  • Technical Service Engineer

    5 days ago

    Alappuzha, India SOFAR Full time

    Looking for an experienced and energetic professional interested in joining a fast-growing and diverse team aimed at provide better Smart Energy solutions to our customers. The individual should be self-driving, responsible, a quick learner and a problem solver. If you are this unique individual, we’d love to meet you.【Location】: Jaipur/Koltotta/Indore...

  • MS dynamics 365 CRM

    24 hours ago

    Alappuzha, India Runmap Infotech Private Ltd. Full time

    📢 Open Positions – D365 CRM & Power PlatformWe are looking for strong D365 CRM & Power Platform professionals across multiple levels.📍 Location: Remote🚀 Availability: Immediate Joiner PreferredExperince required- 3 to 10+ years (Depends on below mention requirement)Job Title:D365 CRM & Power Platform – ArchitectD365 CRM & Power Platform – Tech...