Lead Data Engineer

7 days ago

Pune, India Corporate Steps Full time

Description : This role is for a highly skilled and experienced Data Pipeline Architect/Lead Engineer responsible for setting the technical direction and leading the development of robust, scalable, and optimized data solutions. The ideal candidate will possess deep expertise in distributed computing, data warehousing, and modern data architectures, with a focus on Databricks and Spark environments.Key Responsibilities and Duties : Data Pipeline Leadership & Design :- Lead the design, development, and optimization of complex, high-volume data pipelines (ETL/ELT) using technologies like Databricks, Apache Spark, and advanced SQL.- Ensure data pipelines are scalable, efficient, fault-tolerant, and meet strict performance requirements for real-time and batch processing.Architectural Strategy & Governance : - Drive and influence architectural decisions for the data platform, advocating for best-in-class solutions (e.g., Lakehouse architecture).- Establish and enforce engineering best practices, coding standards, and quality assurance processes for data processing and data modeling.- Evaluate and implement new technologies and tools to enhance data platform capabilities and performance.Technical Mentorship & Team Leadership :- Act as a subject matter expert in distributed data processing, data warehousing, and cloud-native data services.- Mentor and guide junior and mid-level engineers on Spark tuning, Databricks features, data modeling techniques, and performance optimization.- Contribute to the continuous improvement of development and deployment processes (CI/CD) for data solutions.Cross-Functional Collaboration & Delivery : - Collaborate closely with cross-functional partners (Data Scientists, Analytics Teams, Product Managers) to translate complex business requirements into high-quality, reliable, and secure data solutions.- Ensure the delivered data solutions accurately support critical analytics, reporting, and machine learning initiatives.- Own the technical delivery and stability of core data assets, ensuring data quality, governance, and reliability.Required Skills and Qualifications : - Experience : 5+ years of experience in data engineering, software engineering, or a related field, with 5+ years focused on distributed data processing leadership/architecture.- Technical Mastery : Expert-level proficiency in Apache Spark (Scala, Python/PySpark, or Java) and deep practical experience with the Databricks platform (Delta Lake, notebooks, jobs, clusters).- Data Languages : Exceptional command of Advanced SQL for complex data manipulation and performance tuning.- Architecture : Strong understanding of Cloud Data Warehousing concepts (e.g., Snowflake, Google BigQuery, AWS Redshift) and experience implementing Lakehouse patterns.- Cloud Experience : Hands-on experience with at least one major cloud provider (AWS, Azure, or GCP) and their respective data services.- Soft Skills : Excellent communication, collaboration, and problem-solving skills, with a proven ability to lead technical discussions and mentor team members. (ref:hirist.tech)

  • Mid Data Science

    2 weeks ago

    Pune, India NTT DATA Full time

    Job Description Req ID:     NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Mid Data Science & AIML, GenAI Lead/Engineer to join our team in Pune, Mahārāshtra (IN-MH), India...

  • Digital Engineering Lead Engineer

    2 weeks ago

    Pune, India NTT DATA Full time

    Job Description Req ID:     NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Digital Engineering Lead Engineer to join our team in Pune, Mahārāshtra (IN-MH), India (IN)....

  • Senior Data Engineer

    2 weeks ago

    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and...

  • Lead Data Engineer

    6 days ago

    Pune, Maharashtra, India EXL Talent Acquisition Team Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Lead Data Engineer Job DescriptionRole Overview:We are looking for a skilled Lead Data Engineer to design, build, and manage scalable data pipelines and architectures. You will lead a team of data engineers, collaborate with cross-functional stakeholders, and drive best practices in data engineering to support data-driven decision-making.Key...

  • Data Engineering Lead

    2 weeks ago

    Pune, India Ascentt Full time

    Ascentt is building cutting-edge data analytics & AI/ML solutions for global automotive and manufacturing leaders. We turn enterprise data into real-time decisions using advanced machine learning and GenAI. Our team solves hard engineering problems at scale, with real-world industry impact. We're hiring passionate builders to shape the future of industrial...

  • Data Engineering Lead

    1 day ago

    Pune, India Ascentt Full time

    Ascentt is building cutting-edge data analytics & AI/ML solutions for global automotive and manufacturing leaders. We turn enterprise data into real-time decisions using advanced machine learning and GenAI. Our team solves hard engineering problems at scale, with real-world industry impact. We're hiring passionate builders to shape the future of industrial...

  • Lead Data Engineer

    3 weeks ago

    Pune, India Jobted IN C2 Full time

    Responsibilities: What You'll do: Seeking a Lead Data Engineer with demonstrated ability guiding a team, developing platforms, and aligning strategy with goals. You'll have Opportunit to: - Lead the technical direction and strategy for data engineering projects - Lead a team of data engineers, providing technical mentorship and guidance - Establish and...

  • Lead Data Engineer

    4 days ago

    Pune, Maharashtra, India Jet2 Travel Technologies Pvt Ltd. Full time ₹ 25,00,000 - ₹ 1,00,00,000 per year

    Job Title: Lead Data EngineerJob Type: PermanentRelevant Experience: 8+ years experience  in a data-related role with recent experience in the field of cloud data engineering. Experience of cloud data analytics and data warehousing would be an advantage.Reports to: Engineering Manager – Data & AnalyticsJob Description:We, at Jet2 (UK's third largest...

  • Data Engineer Lead

    1 week ago

    Pune, Maharashtra, India Mappy Global Resources Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Greetings for the DayScouting for a Director, Data Engineering Lead to be associated with a Global Digital Media Agency.Location: PuneShift: EMEARole & responsibilitiesDirector, Data Engineering Lead, you will drive the architecture, design, and implementation of enterprise-scale data platforms and pipelines. You will lead a high-performing team of data...

  • Lead Software Engineer

    1 week ago

    pune, India Data Direct Networks Full time

    OverviewThis is an incredible opportunity to be part of a company that has been at the forefront of AI and high-performance data storage innovation for over two decades. DataDirect Networks (DDN) is a global market leader renowned for powering many of the world's most demanding AI data centers, in industries ranging from life sciences and healthcare to...