Technical Lead: Open Source Data Engineering Platform

6 days ago

Pune, Maharashtra, India BAJAJ FINSERVE Full time ₹ 5,00,000 - ₹ 8,00,000 per year

Role & responsibilities

We are looking for an accomplished Technical Lead - Data Engineering to design and develop of a cloud-agnostic, open-source data ingestion and processing solution that will be embedded within a larger Low-Code platform to strengthen the overall low code platform capabilities.

The ideal candidate will bring deep expertise in large-scale Data Engineering platforms design, development and execution experience, with hands-on experience in ETL, Real Time Streaming, Distributed Data Processing, Python, Spark, and will have the ability to guide a product development team through the entire lifecycle - from concept to deployment.

This role involves architecting and delivering a robust, scalable, and future-ready data ingestion and processing framework, leveraging strong technical proficiency in Open Source Softwares along with modern data engineering best practices.

Preferred candidate profile

Experience Required:

  • Overall 8+ Years of experience in Data Engineering domain
  • Ability to lead the team to develop a cloud-agnostic, open-source data engineering platform
  • Hands on Architecture, Design and Programming skills to develop an Open Source based Data Engineering Application and Framework within a larger Enterprise Application product suite.
  • Strong Hands On experience in Python, Spark, API and preferably with other open source product like Apache Nifi etc.
  • Hands on experience in Java is preferrable
  • Strong experience in ETL/ELT pipelines, data streaming, CDC etc.
  • Design and implement real-time data streaming solutions as a part of product feature
  • Design and develop robust data quality assurance, failure logging features
  • Design and develop Monitoring, diagnostic and logging features to maintain production and non-production systems proactively
  • Develop automation scripts/tools (Python, Perl, Shell) to eliminate manual tasks and accelerate issue resolution
  • Engage with stakeholders to continuously enhance the product
  • Capture user feedback and translate it into actionable architecture or support initiatives.
  • Maintain structured documentation, including performance metrics and enhancement logs.

  • Technical Lead

    2 weeks ago

    Pune, Maharashtra, India NCS Group Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    1 Designing and implementing data ingestion pipelines from multiple sources using Azure Databricks2 Ensure data pipelines run smoothly and efficiently3 Developing scalable and re-usable frameworks for ingesting of data sets4 Integrating the end-to-end data pipeline - to take data from source systems to target data repositories ensuring the quality and...

  • Technical Lead

    2 days ago

    Pune, Maharashtra, India Ishan Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Role Overview : - We are urgently seeking a highly technical and experienced Tech Lead to be the lead player-coach for our AI & Data Services practice. - This role is for a deeply technical expert who loves to solve complex problems, write code, and lead by example. - You will be responsible for architecting and building sophisticated AI/ML...

  • Data Engineer

    1 week ago

    Pune, Maharashtra, India Data Axle Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    About Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary...

  • Senior Databricks Engineer/Technical Lead/Data Architect

    1 week ago

    Pune, Maharashtra, India Zorba Consulting Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Primary Roles And Responsibilities : Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack. Ability to provide solutions that are forward-thinking in data engineering and analytics space. Collaborate with DW/BI leads to understand new ETL pipeline development requirements. Triage issues to find gaps in existing pipelines and...

  • Platform Engineering Lead

    2 weeks ago

    Pune, Maharashtra, India Barclays Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Date live:08/19/2025Business Area:Customer Digital and DataArea of Expertise:TechnologyContract:PermanentReference Code:JR Join us as a Platform Engineering Lead at Barclays, where you will be responsible for supporting the successful delivery of location strategy projects to plan, budget, agreed quality and governance standards. You'll spearhead the...

  • Data Engineer Lead

    2 days ago

    Pune, Maharashtra, India Mappy Global Resources Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Greetings for the DayScouting for a Director, Data Engineering Lead to be associated with a Global Digital Media Agency.Location: PuneShift: EMEARole & responsibilitiesDirector, Data Engineering Lead, you will drive the architecture, design, and implementation of enterprise-scale data platforms and pipelines. You will lead a high-performing team of data...

  • Technical Lead

    3 days ago

    Pune, Maharashtra, India NCSI Technologies Full time ₹ 1,20,000 - ₹ 3,00,000 per year

    1 Designing and implementing data ingestion pipelines from multiple sources using Azure Databricks 2 Ensure data pipelines run smoothly and efficiently 3 Developing scalable and re-usable frameworks for ingesting of data sets 4 Integrating the end-to-end data pipeline - to take data from source systems to target data repositories ensuring the quality and...

  • Platform Engineer Job Details

    4 days ago

    Pune, Maharashtra, India Lubrizol Corporation Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Job Description Platform Engineer Date: Aug 20, 2025Location: Pune, MH, IN, 411001Company: Lubrizol CorporationJob Summary We are seeking a highly skilled and innovative Platform Engineer to implement end-to-end data and analytics solutions using the Microsoft Fabric platform. This role is ideal for someone with technical expertise in Microsofts data...

  • Technical Data Lead

    4 days ago

    Pune, Maharashtra, India Roche Full time US$ 1,25,000 - US$ 1,75,000 per year

    At Roche you can show up as yourself, embraced for the unique qualities you bring. Our culture encourages personal expression, open dialogue, and genuine connections, where you are valued, accepted and respected for who you are, allowing you to thrive both personally and professionally. This is how we aim to prevent, stop and cure diseases and ensure...

  • Azure Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Capgemini Engineering Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world's most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&D and...