Senior Data Engineering Lead

2 days ago

Nashik, Maharashtra, India beBeeData Full time ₹ 35,00,000 - ₹ 40,00,000
Job Title: Senior Manager, Data Engineering Lead

We are seeking a seasoned leader to head our data engineering initiatives. As Senior Manager, Data Engineering Lead, you will be responsible for overseeing the design and implementation of comprehensive testing strategies for complex data pipelines and product delivery projects.

Your key responsibilities will include designing and implementing end-to-end testing frameworks for data pipelines, ETL/ELT processes, and analytics platforms. You will also ensure test coverage across ETL/ELT, data transformation, lineage, and consumption layers. Additionally, you will develop integrated testing strategies spanning multiple systems, APIs, and data sources, and establish testing standards, methodologies, and best practices across the organization.

Data Engineering Testing:
  • Create comprehensive test suites for data ingestion, transformation, and output validation
  • Design data quality checks, schema validation, and performance testing for large-scale datasets
  • Implement automated testing for streaming and batch data processing workflows
  • Validate data integrity across multiple environments and systems and against business rules

Cross-Functional Coordination:
  • Collaborate with data engineers, software developers, product managers, and DevOps teams
  • Coordinate testing activities across multiple product streams and release cycles
  • Manage testing dependencies and critical path items in complex delivery timelines

Quality Assurance & Process Improvement:
  • Establish metrics and KPIs for testing effectiveness and product quality to drive continuous improvement in testing processes and tooling
  • Lead root cause analysis for production issues and testing gaps

Technical Leadership:
  • Mentor junior QA engineers and promote testing best practices
  • Evaluate and implement new testing tools and technologies
  • Design scalable testing infrastructure and CI/CD integration

Key Skills:
We are looking for someone with 10+ years of experience in software testing, including at least 3 years in leadership roles. You should have 8+ years of experience testing data engineering systems, ETL pipelines, or analytics platforms, as well as a proven track record with complex, multi-system integration testing. Experience in agile/scrum environments with rapid delivery cycles is essential. Strong SQL skills with major databases (Redshift, BigQuery, etc.) are required, along with experience with cloud platforms (AWS, GCP) and their data services. Knowledge of data pipeline tools (Apache Airflow, Kafka, Confluent, Spark, dbt, etc.) and proficiency in scripting languages (Python, Java, bash) for test automation are also necessary.

  • Senior Data Engineering Specialist

    2 hours ago

    Nashik, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Senior Data Engineer - SQLThe role of a Senior Data Engineer involves leading the design, development, and implementation of large-scale data systems.Lead cross-functional teams in implementing scalable data architectures.Design and develop complex database schemas using relational databases like MySQL or PostgreSQL.Develop advanced SQL queries...

  • Senior Data Engineer

    3 weeks ago

    Nashik, Maharashtra, India SPIRO Full time

    Position: Senior Data Engineer Location: Pune Experience: 5+ yearsJob Summary:We are seeking an experienced Senior Data Engineer with a strong background in PySpark, Spark, and Big Data technologies. The ideal candidate will have over five years of hands-on experience designing, building, and optimizing large-scale data processing systems and pipelines.Key...

  • Senior Data Quality Engineer

    4 days ago

    Nashik, Maharashtra, India beBeeData Full time ₹ 12,00,000 - ₹ 20,00,000

    Senior Data Quality EngineerThis is a contract to hire position for an experienced Senior Data Quality Engineer with hands-on expertise in Databricks, Python scripting, and strong SQL skills. The ideal candidate will be responsible for validating data pipelines and transformations, debugging data issues, and working with large datasets in cloud...

  • Senior Team Facilitator in Data Engineering

    5 days ago

    Nashik, Maharashtra, India beBeeFacilitation Full time ₹ 15,00,000 - ₹ 22,00,000

    Senior Team Facilitator in Data EngineeringAs a seasoned facilitator in the field of Data Engineering, your primary responsibility will be to oversee and optimize team collaboration. Your main objective is to ensure that all team members work together seamlessly towards project goals.Key Responsibilities:Plan, coordinate, and lead strategic meetingsEliminate...

  • Senior Data Engineer Position

    2 weeks ago

    Nashik, Maharashtra, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job OverviewWe are seeking a skilled professional to assume the role of senior data engineer.Key Responsibilities:Design and implement scalable data pipelines using industry-leading tools such as FiveTran, DBT Cloud, and custom frameworks.Develop and maintain ETL pipelines, implementing client-specific data transformations and supporting data ingestion and...

  • Senior Data Engineer Project Lead

    3 days ago

    Nashik, Maharashtra, India beBeeProjectManagement Full time ₹ 15,00,000 - ₹ 25,00,000

    About the RoleWe are seeking a seasoned Data Engineering Project Manager to lead and deliver projects in data engineering and analytics.The ideal candidate will have strong technical project management skills, with experience in leading cross-functional teams and executing complex data platform initiatives.Familiarity with cloud data platforms (AWS, GCP,...

  • Senior Data Architect

    1 week ago

    Nashik, Maharashtra, India beBeeDataEngineer Full time ₹ 1,86,00,000 - ₹ 2,61,00,000

    Job Title: Senior Data Engineer - Technical LeadAs a senior data engineer, you will lead the development of large-scale data engineering solutions. Your role encompasses designing and implementing sophisticated data pipelines while mentoring junior engineers.Design and implement data pipelines using Snowflake and other technologies to streamline business...

  • Senior Data Analytics Lead

    7 days ago

    Nashik, Maharashtra, India beBeeDataAnalytics Full time ₹ 15,00,000 - ₹ 35,00,000

    Job TitleA Senior Data Analytics Lead is required to spearhead our analytics initiatives and drive business growth through data-driven insights.

  • Mastering Data Engineering Solutions

    5 days ago

    Nashik, Maharashtra, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Senior Data Engineer">Description:As a Senior Data Engineer, you will play a crucial role in shaping the foundation of our project. You will work closely with other teams to design, develop, and implement data engineering solutions.Leading technical teams, mentoring engineers, and providing thought leadership within the engineering team are key...

  • Big Data Engineering Lead

    5 days ago

    Nashik, Maharashtra, India beBeeDataEngineering Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Job Overview:We are seeking an experienced Big Data Engineering Lead to lead our data engineering teams and drive the development of scalable data infrastructure. The successful candidate will be responsible for managing cross-functional collaboration, developing data pipelines, and provisioning data infrastructure.About You:You have 7-12 years of experience...