Senior Data Engineering Lead

19 hours ago


Pune, Maharashtra, India Sampoorna Consultants Pvt. Ltd Full time
Job Title: Senior Data Engineering Lead

Sampoorna Consultants Pvt. Ltd is looking for a highly skilled Senior Data Engineering Lead to lead our data engineering team. If you have a strong background in data engineering, data quality, and data validation, and experience with data processing concepts like mapping documents and complex data relationships, we encourage you to apply.

About the Role:

This senior-level role comes with an estimated annual salary of ₹1500000, based on your qualifications and experience.

The ideal candidate will have 7-8 years of experience in data engineering, data quality, and data validation, with a strong understanding of data warehouse/data lake architecture and development. They will also have hands-on experience with Python and libraries like Pandas, Spark, and NumPy, as well as working experience with relational and NOSQL databases.

The successful candidate will be able to work collaboratively with cross-functional teams to ensure quality and timely delivery of products, and lead the development and execution of data quality frameworks, solutions, and automated test cases for software applications to ensure the reliability of data pipelines and data transformations.

Responsibilities:
  • Collaborate with cross-functional teams to ensure quality and timely delivery of products.
  • Lead the development and execution of data quality frameworks, solutions and automated test cases for software applications to ensure the reliability of data pipelines and data transformations.
  • Identify areas of improvement in data quality processes and propose solutions to enhance data accuracy and reliability and create test strategies.
  • Collaborate with the Data Delivery technology teams and architects to define and develop solutions.
  • Collaborate with data engineering and development teams to implement data quality best practices and optimize data workflows.
  • End to end integration testing between multiple independent systems and interfaces (flat files, APIs (ETL)) etc.
  • Utilize AWS services (EC2, Glue, Athena etc. to test data integration and migration processes.
  • Conduct functional, integration, regression, and performance testing of database systems using industry standard technologies (SQL, NOSQL, Python, etc.)
  • Create and maintain documentation of test plans, test cases and testing results, data quality issues, testing procedures, and resolutions.


  • Pune, Maharashtra, India Data Labs Full time

    Job Title: Senior Software Engineer LeadWe are seeking an experienced Senior Software Engineer Lead to join our team at Data Labs. This is a full-time position based in Pune.About the Role:As a Senior Software Engineer Lead, you will be responsible for leading the frontend development team and collaborating with the backend team to deliver high-quality...


  • Pune, Maharashtra, India NTT DATA Full time

    About the RoleWe are seeking a highly skilled Senior Data Protection Engineer to join our team at NTT DATA. This is an exciting opportunity to work with a leading global innovator of business and technology services.Key Responsibilities:Implement and maintain data protection systems, ensuring high levels of security and efficiency.Configure and manage data...


  • Pune, Maharashtra, India Synechron Full time

    We are seeking a seasoned Senior Data Engineering Lead to spearhead the design and implementation of complex data processing applications within our organization. With 7 to 10 years of hands-on experience in Ab Initio and Apache Spark, you will be an expert in leveraging these technologies to deliver scalable and performance-driven data solutions.This senior...


  • Pune, Maharashtra, India Synechron Full time

    Job OverviewWe are seeking a highly skilled Senior Data Engineering Lead to lead the design and development of complex data processing applications within our organization.The ideal candidate will have 7 to 10 years of experience in leveraging the strengths of both Ab Initio and Apache Spark to deliver scalable and performance-driven data solutions.


  • Pune, Maharashtra, India Data Dynamics Full time

    About Data Dynamics">Data Dynamics is a leading data-driven company that leverages cutting-edge technologies to drive business growth. Our team of experts collaborates with clients across various industries to deliver innovative solutions.Job Summary">We are seeking an experienced Senior Machine Learning Specialist to join our team. As a key member, you will...


  • Pune, Maharashtra, India NTT DATA Full time

    Senior Quality Engineer at NTT DATAWe are seeking an exceptional Senior Quality Engineer to join our team in Pune, Mahārāshtra (IN-MH), India (IN). As a key member of our team, you will play a vital role in ensuring the quality of our software solutions.About the Role:Develop and execute comprehensive test automation frameworks and suites to ensure...


  • Pune, Maharashtra, India Virtusa Full time

    About This RoleVirtusa is looking for a skilled Senior Data Architect Lead to join our team. The ideal candidate will have 10+ years of experience in data engineering, with a strong background in designing and implementing large-scale data systems.


  • Pune, Maharashtra, India AEXONIC TECHNOLOGIES PRIVATE LIMITED Full time

    Data Engineer Job Description:AEXONIC TECHNOLOGIES PRIVATE LIMITED is hiring a Senior Big Data Engineer to join our team. This individual will work on designing and optimizing Big Data pipelines with Hadoop, Hive, PySpark, and Google BigQuery. As a key member of our team, you will be responsible for ensuring data quality, integrity, and security across...


  • Pune, Maharashtra, India HARMAN International Full time

    Job SummaryWe are seeking a highly skilled Senior Data Science Lead to join our team at HARMAN International. As a Senior Data Science Lead, you will be responsible for leading the development and implementation of advanced data science solutions that drive business growth and improvement.Key ResponsibilitiesLead the analysis, design, development,...

  • Senior Data Engineer

    4 weeks ago


    Pune, Maharashtra, India PubMatic Full time

    Join PubMatic as a Senior Data Engineer and be part of our team developing cutting-edge data analytics solutions. We are looking for an experienced professional to join our engineering team.About the RoleWe are seeking a skilled Senior Data Engineer to lead the development of our data analytics platform. The ideal candidate will have experience in big data...


  • Pune, Maharashtra, India Where U Elevate Full time

    Job Title: Senior Data EngineerWe are looking for an experienced Senior Data Engineer to join our team at Where U Elevate. As a senior engineer, you will play a key role in designing and implementing large-scale data processing systems that meet our customers' needs.About the Company:Where U Elevate is a leading provider of data engineering services. We are...


  • Pune, Maharashtra, India Tata Consultancy Services Full time

    We are seeking an experienced Cloud Data Engineering Lead to join our team at Tata Consultancy Services. This is a challenging and rewarding role that requires strong technical expertise, excellent communication skills, and the ability to lead cross-functional teams.About the RoleThis is a senior leadership position responsible for overseeing the development...


  • Pune, Maharashtra, India NTT DATA Full time

    Job OverviewWe are seeking an experienced L3 Network Engineer to lead our network operations, driving the design, implementation, and optimization of network solutions.About NTT DATANTT DATA is a global leader in business and technology services, serving 75% of the Fortune Global 100 companies. We invest over $3.6 billion each year in R&D to help...


  • Pune, Maharashtra, India Capgemini Engineering Full time

    At Capgemini Engineering, we're seeking a highly skilled Mule Developer to join our team. As a Senior Mulesoft Engineer, you'll play a critical role in designing and implementing enterprise-level integration solutions using MuleSoft.With 10 years of experience in software development, you'll have a strong background in developing applications with Batch...

  • Data Engineer Lead

    20 hours ago


    Pune, Maharashtra, India RS Consultants Full time

    Senior Data EngineerWe are seeking a skilled Senior Data Engineer to design, develop and optimize scalable data systems and pipelines.The ideal candidate will have strong expertise in cloud platforms, Snowflake, Databricks and Apache Spark, combined with a solid background in SQL, Python and Java.Key Responsibilities:Design, develop and maintain ETL/ELT...


  • Pune, Maharashtra, India Data Axle Full time

    About Data AxleData Axle Inc. is a leading provider of data, marketing solutions, sales and research with 50 years of experience in the US.Our strategic global centre of excellence in Pune delivers mission critical data services to our global customers using our proprietary cloud-based technology platform and leveraging our proprietary business & consumer...


  • Pune, Maharashtra, India Synechron Full time

    Job DescriptionWe are seeking a highly skilled Data Engineering Lead to lead the design and development of complex data processing applications within our organization. The ideal candidate will have 7 to 10 years of experience in leveraging Ab Initio and Apache Spark to deliver scalable and performance-driven data solutions.This senior role requires a...


  • Pune, Maharashtra, India Synechron Full time

    Job Title: Senior Big Data EngineerEstimated Salary: ₹1,500,000 - ₹2,000,000 per annumAt Synechron, we are looking for a highly skilled Senior Big Data Engineer to join our team. The ideal candidate will have a solid understanding of big data technologies and be able to design and implement scalable data solutions using AWS services.About the Role:We are...


  • Pune, Maharashtra, India NTT DATA Full time

    About NTT DATANTT DATA is a leading provider of digital and AI infrastructure in the world. Our mission is to help organizations innovate, optimize, and transform for long-term success.Job DescriptionWe are seeking a Senior Quality Assurance and Testing Specialist to join our team in Pune, India. As a key member of our Quality Engineering practice, you will...


  • Pune, Maharashtra, India NTT DATA Full time

    Job Summary: We are seeking a seasoned Digital Engineering Lead Engineer to spearhead our team's technical strategy in Pune, India. About NTT DATA As a trusted global innovator of business and technology services, we serve 75% of the Fortune Global 100. Our commitment is to help clients innovate, optimize, and transform for long-term success. Salary:...