Lead Data Engineer

2 hours ago

Pune Maharashtra India, Maharashtra EXL Full time

About the Role

We are seeking a highly skilled Lead Data Engineer to drive end-to-end data engineering initiatives, lead cross-functional teams, and deliver scalable, cloud-based data solutions. The ideal candidate will bring deep technical expertise, strong leadership, and the ability to collaborate effectively with global stakeholders in a fast-paced environment.


Key Responsibilities

Leadership & Team Management

  • Lead and mentor a team of onshore and offshore data engineers to ensure high-quality deliverables.
  • Provide technical direction, coaching, and knowledge sharing to foster team growth and capability building.
  • Establish and enforce engineering best practices, coding standards, and reusable frameworks.
  • Champion innovation, continuous learning, and thought leadership within the data engineering function.

Project Delivery & Execution

  • Oversee end-to-end project delivery, ensuring timely, high-quality execution aligned with project objectives.
  • Define high-level solution designs, data architectures, and ETL/ELT frameworks for cloud-based data platforms.
  • Drive development, code reviews, unit testing, and deployment to production environments.
  • Ensure optimal performance, scalability, and reliability across data pipelines and systems.

Stakeholder Communication & Collaboration

  • Collaborate with clients, product owners, business leaders, and offshore teams to gather requirements and define technical solutions.
  • Communicate project updates, timelines, risks, and technical concepts effectively to both technical and non-technical stakeholders.
  • Act as the primary point of contact for client technical discussions, solution design workshops, and progress reviews.

Risk & Issue Management

  • Proactively identify project risks, dependencies, and issues; develop and execute mitigation plans.
  • Ensure governance, compliance, and alignment with organizational standards and methodologies.


Must-Have Skills

  • 12+ years of experience in Data Engineering with proven experience in delivering enterprise-scale projects.
  • Strong expertise in Big Data concepts, distributed systems, and cloud-native architectures.
  • Proficiency in Snowflake, SQL, and a wide range of AWS services (Glue, EMR, S3, Aurora, RDS, Lambda, Step Functions).
  • Hands-on experience with Python, PySpark, and building cloud-based microservices.
  • Strong problem-solving, analytical skills, and end-to-end ownership mindset.
  • Proven ability to work in Agile/Scrum environments with iterative delivery cycles.
  • Exceptional communication, leadership, and stakeholder management skills.
  • Demonstrated capability in leading onshore–offshore teams and coordinating multi-region delivery efforts.


Good-to-Have Skills

  • Experience with DevOps tools (Jenkins, Git, GitHub/GitLab) and CI/CD pipeline implementation.
  • Experience with cloud migration and large-scale modernization projects.
  • Familiarity with the US insurance/reinsurance domain + P&C Insurance knowledge
  • Knowledge of Data Vault 2.0 and modern data modeling techniques.

  • Lead Data Engineer

    1 hour ago

    Pune, Maharashtra, India, Maharashtra Searce Inc Full time

    Who we are?Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’. It signifies our way of working: To improve to the finest degree of excellence, ‘solving for better’ every time. Searcians are passionate improvers & solvers who love to question the status quo.The primary purpose of all of us, at Searce, is driving...

  • Lead Data Engineer

    2 hours ago

    Pune, Maharashtra, India, Maharashtra ITC Infotech Full time

    Lead Data EngineerLocation: Banglore/Pune (Hybrid)Mode: HybridShift Timing: 2 PM to 11 PMExperience: 7-12 years. 3+ years in cloud data platforms and Databricks. Purpose: We are seeking a hands-on Technical Lead to drive the ingestion of high-volume mainframe RPC data into Databricks, enabling scalable machine learning workflows. This role is critical to...

  • Data Privacy Consultant

    2 hours ago

    Pune, Maharashtra, India, Maharashtra Data > Nuance. Full time

    About Data>Nuance Data>Nuance is a global privacy, data protection, and AI governance consultancy, trusted by 1,000+ organizations worldwide.We operate across Barcelona, Bangalore, and Dubai (expanding soon), with a dedicated team of data protection, governance, and regulatory specialists.We specialize in:Outsourced DPO ServicesData Protection Consultancy &...

  • Data and Analytics Engineering Lead

    1 hour ago

    Pune, Maharashtra, India, Maharashtra Orbia Pune Full time

    We are currently looking for Data and Analytics Engineering Lead to join a fast growing product based Organisation in Pune.If you are someone who can develop a comprehensive technical plan for the migration, including data ingestion, transformation, storage, and access control in Azure's Data Factory and data lake! We'd love to hear from you.Role: Data and...

  • Google Cloud Data engineering Practice Lead

    2 hours ago

    Pune, Maharashtra, India, Maharashtra Evonence Full time

    Company DescriptionEvonence is a Google Cloud partner company founded in 2014 and located in Pune. As one of the fastest-growing partners in the Google Cloud ecosystem, we provide Google Cloud solutions specifically tailored to the mid-market across North America. With a customer base of over 1000 clients, we have deep technical expertise in Google...

  • Lead

    2 hours ago

    Pune, Maharashtra, India, Maharashtra Yotta Data Services Private Limited Full time

    Yotta Data Services | Powering Digital Transformation with Scalable Cloud, Colocation, and Managed Services. Yotta Data Services offers a comprehensive suite of cloud, data center, and managed services designed to accelerate digital transformation for businesses of all sizes. With state-of-the-art infrastructure, cutting-edge AI capabilities, and a...

  • Data Practice Lead

    1 hour ago

    Pune, Maharashtra, India, Maharashtra Opus Technologies Full time

    Job Title: Data Practice LeadLocation: Pune (Preferred) / BengaluruExperience: 15+ YearsEmployment Type: Full-TimePrimary Skills: Data Engineering, Data Platforms, Competency Building, Practice Growth, Consulting/Advisory, Delivery/Operational Excellence, CoE, Team Building, Databricks, SnowflakeJob Scope: We are seeking a dynamic Data Engineering...

  • Lead Data Engineer

    6 days ago

    Pune, Maharashtra, India EXL Talent Acquisition Team Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Lead Data Engineer Job DescriptionRole Overview:We are looking for a skilled Lead Data Engineer to design, build, and manage scalable data pipelines and architectures. You will lead a team of data engineers, collaborate with cross-functional stakeholders, and drive best practices in data engineering to support data-driven decision-making.Key...

  • Lead Data Engineer

    1 hour ago

    Pune, Maharashtra, India, Maharashtra Bajaj Technology Services Full time

    Experience: 9-12 YearsDomain: eCommerce / Financial ReconciliationBrief JD:We are seeking a Sr. Data Engineer own and operate a large-scale data processing and reconciliation platform for an eCommerce enterprise. The role involves execution, support and enhancement of real-time data ingestion and batch processing ETL dataflows (SQL, Python, PySpark, Hive),...

  • Lead Data Scientist

    1 hour ago

    Pune, Maharashtra, India, Maharashtra Ishan Technologies Full time

    Job Title: Lead Data ScientistLocation: PuneSalary: Upto 22 LPAJob Summary:We are seeking a highly experienced and visionary Lead Data Scientist to spearhead our data-driven initiatives and guide a team of data professionals in developing scalable, impactful solutions. The ideal candidate will have deep expertise in machine learning, predictive analytics,...