Senior Data Pipeline Validator

3 days ago

Tiruppur, Tamil Nadu, India beBeeDataQuality Full time ₹ 18,00,000 - ₹ 22,00,000
ETL Data Quality Engineer

We are seeking a meticulous ETL Data Quality Engineer with expertise in testing large-scale data pipelines and ensuring data accuracy, consistency, and throughput in event-driven systems.

Key Responsibilities:
  • Test ETL processes and perform data reconciliation across systems to guarantee seamless data flow.
  • Validate Kafka/Redpanda pipelines (producers, consumers, topics, schema registry, Avro/JSON) for optimal performance.
  • Ensure data quality by verifying accuracy, consistency, and high throughput, reducing errors and improving overall system efficiency.
  • Write and run MongoDB queries for comprehensive data checks and validation.
  • Develop and maintain test cases, defect reports, and collaborate closely with developers/product teams to resolve issues efficiently.
Requirements:
  • Minimum 2+ years of experience as a QA Engineer.
  • Familiarity/experience with process methodologies used in the software industry.
Desirable Skills:
  • Strong knowledge of ETL testing, data validation, and reconciliation techniques.
  • Hands-on experience with Kafka/Redpanda and other associated tools.
  • Good understanding of throughput, consistency, and defect tracking concepts.
  • Familiarity with Git, CI/CD, and tools like JIRA or Azure DevOps.
Why This Role Matters:

This role is crucial to our organization's success as it ensures the integrity and reliability of our data. If you're passionate about data quality and want to make a real impact, we encourage you to apply.

  • Senior Data Validation Specialist

    2 days ago

    Tiruppur, Tamil Nadu, India beBeeDataValidation Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data Validation ExpertThe ideal candidate will have strong experience in data analysis, with a solid understanding of validation processes.Key Responsibilities:Design and execute automated test cases for data validation and transformation processes.Validate data integrity across various sources including APIs, databases.Collaborate with data...

  • Senior Data Validation Specialist

    3 days ago

    Tiruppur, Tamil Nadu, India beBeeTester Full time ₹ 12,00,000 - ₹ 20,00,000

    Seeking a detail-oriented ETL Tester to validate data pipelines and transformations using Databricks, Python scripting, and strong SQL skills.Your expertise in ETL testing methodologies, debugging data issues, and working with large datasets in cloud environments will drive success.We are looking for an experienced individual with hands-on experience...

  • Data Pipeline Assurance Professional

    10 hours ago

    Tiruppur, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Data Pipeline Integrity Specialist">We are seeking a skilled Data Pipeline Integrity Specialist to ensure the accuracy, completeness, and performance of our data pipelines. This role involves analyzing source data, identifying discrepancies, and collaborating with developers and data engineers for resolution.Key Responsibilities:Data Profiling:...

  • Data Pipeline Specialist

    7 hours ago

    Tiruppur, Tamil Nadu, India beBeeDataStage Full time ₹ 18,00,000 - ₹ 24,00,000

    Job Title: Teradata with DataStage DeveloperWe are seeking a skilled professional to fill the role of Teradata and DataStage developer. The ideal candidate will have expertise in ETL development and data warehousing concepts, with hands-on experience in designing, building, and optimizing data pipelines using IBM DataStage.The successful candidate will...

  • Advanced Data Validation Specialist

    10 hours ago

    Tiruppur, Tamil Nadu, India beBeeDataValidation Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Position OverviewWe are seeking an experienced data validation specialist to fill a challenging role within our organization.Key Responsibilities:Conduct thorough testing of complex data pipelines and enterprise-grade data systems using ETL principles.Develop and execute advanced SQL queries for data validation, reconciliation, and transformation...

  • ETL Data Validation Specialist

    1 week ago

    Tiruppur, Tamil Nadu, India beBeeDataPipeline Full time ₹ 30,00,000 - ₹ 50,00,000

    Job SummaryWe are seeking an experienced Data Pipeline Tester to join our team. As a Data Pipeline Tester, you will be responsible for designing and executing test cases to validate Databricks tables across various layers.A strong foundation in ETL Testing concepts is essential for this role. You should be able to design and execute test cases that...

  • Senior Cloud Validation Engineer

    2 days ago

    Tiruppur, Tamil Nadu, India beBeeCertification Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Summary:We are seeking a Senior Infrastructure Engineer to lead our Zero-Touch Validation, Upgrade, and Certification automation of our on-prem GPU cloud platform. This role focuses on ensuring the stability, performance, and conformance of the entire stack—from hardware to Kubernetes—using automated, GitOps-based validation pipelines.Key...

  • Senior Data Pipeline Developer

    1 week ago

    Tiruppur, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Key Role: Building End-to-End Data Solutions on AzureWe are seeking an expert professional to design, develop, and run comprehensive data pipelines. This position involves handling data validation, transformation, and warehousing.Main Responsibilities:Develop scalable data solutions using Azure technologiesCollaborate with stakeholders for business insights...

  • Chief Data Pipeline Architect

    6 days ago

    Tiruppur, Tamil Nadu, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 25,00,000

    Data Engineering OpportunityWe are looking for a skilled professional to lead our data engineering efforts. As a data engineer, you will be responsible for designing and implementing scalable data pipelines using modern tools and technologies.About the Role:Develop and maintain large-scale data processing systems using Spark and Databricks.Implement CI/CD...

  • Data Pipeline Architect

    2 days ago

    Tiruppur, Tamil Nadu, India beBeeData Full time ₹ 18,00,000 - ₹ 23,10,000

    Senior Data Engineer Job DescriptionWe are seeking a seasoned data engineer to design and optimize complex data pipelines. The ideal candidate will have a strong background in ETL, Cloud, Data Warehousing, and Big Data ecosystems.Key Responsibilities:Design and Optimize Data Pipelines: Build ETL/ELT workflows using AWS Glue, Airflow, Databricks, StreamSets,...