Data Pipeline Validation Specialist

13 hours ago


Vellore, Tamil Nadu, India beBeeetl Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

We are seeking a seasoned ETL testing expert to spearhead data pipeline validation and reconciliation.

Key Responsibilities:
  • Data Pipeline Validation: Perform thorough ETL testing across complex data pipelines and enterprise-grade data systems, ensuring seamless data flow and integrity.
  • Advanced SQL Query Development: Develop and execute advanced SQL queries for data validation, reconciliation, and transformation checks, utilizing large-scale data operations expertise.
  • Automation Frameworks: Build and maintain data validation automation frameworks using Python, integrating with CI/CD pipelines for streamlined testing and deployment.
  • Collaboration and Automation: Collaborate with DevOps teams to design and implement automation workflows, contributing to version-controlled repositories on GitHub for enhanced collaboration and version control.
  • Performance Monitoring and Assurance: Participate in performance testing and monitoring, ensuring data integrity across structured and semi-structured data sets.
Required Skills and Qualifications:
  • ETL Testing Expertise: Strong hands-on experience in ETL testing is mandatory, with expertise in advanced SQL for large-scale data operations.
  • Automation and CI/CD Tools: Proven ability to automate data validation using Python, with exposure to CI/CD tools and GitHub, including seamless integration and deployment.
Preferred Skills:
  • CLOUD SERVICES: Working knowledge of AWS cloud services, especially S3 and Airflow, is highly desirable.
  • DATABASE MANAGEMENT: Experience with PostgreSQL, Oracle, or SQL Server databases is also preferred.


  • Vellore, Tamil Nadu, India beBeeData Full time ₹ 18,00,000 - ₹ 22,00,000

    Reliable AI Model Specialist\AI model reliability is driving mission-driven projects.\You will be responsible for developing automated pipelines that ensure the reliability, safety, and relevance of training datasets.\A strong understanding of large language models (LLMs) and their evaluation frameworks, proficiency in Python, PyTorch, Hugging Face, and...


  • Vellore, Tamil Nadu, India beBeeDataQualityEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Data Quality EngineerWe are seeking a highly skilled and motivated professional to join our team as a Data Quality Engineer. This role will play a key part in ensuring the accuracy and reliability of our data pipelines, analytics platforms, and reporting systems.This individual will combine their expertise in test automation with hands-on...


  • Vellore, Tamil Nadu, India beBeeETLPipeliningEngineer Full time ₹ 18,00,000 - ₹ 22,00,000

    Job Title: Data Pipelining Engineer.We are seeking a skilled Data Pipelining Engineer to join our data engineering team. The successful candidate will be responsible for designing, developing, and maintaining scalable and efficient data pipelines using IBM DataStage (on Cloud Pak for Data), AWS Glue, and Snowflake.Key Responsibilities: Design and develop...


  • Vellore, Tamil Nadu, India beBeeDataIntegration Full time ₹ 12,00,000 - ₹ 15,00,000

    Job Title:Data Integration SpecialistJob Description:We are seeking a skilled Data Integration Specialist with expertise in ETL development and data warehousing concepts.The ideal candidate will have hands-on experience in designing, building, and optimizing data pipelines using IBM DataStage, along with strong SQL skills for Teradata.Key...


  • Vellore, Tamil Nadu, India beBeeDataEngineer Full time ₹ 80,00,000 - ₹ 1,50,00,000

    Job TitleWe are seeking an experienced Freelance Data Engineer to design, build, and optimize large-scale data pipelines. The consultant will collaborate with internal teams and clients to ensure robust, scalable, and high-performance data solutions.Key Responsibilities:Design, develop, and maintain ETL/ELT pipelines using PySpark, AWS, and...


  • Vellore, Tamil Nadu, India beBeeDataValidator Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Job Description">We are seeking a skilled professional to join our team as a Data Validator - CPC Operations. As a key member of the Payments Ops department, you will be responsible for ensuring the accuracy and efficiency of our data validation processes.">Key Responsibilities:">">Validate migrated data from GTS Matrix to OBLM in production">Perform User...


  • Vellore, Tamil Nadu, India beBeeEtl Full time ₹ 15,90,000 - ₹ 19,90,000

    We are seeking a skilled ETL developer to join our team. The ideal candidate will have experience in designing and optimizing complex data pipelines, debugging, and deployment using Talend.**Position Details:**- **Role:** ETL Developer- **Experience:** 8 to 10 years- **Work Timings:** Flexible schedule with evening shifts- **Duration:** 3 Months (Contract)-...


  • Vellore, Tamil Nadu, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Azure Data EngineerWe are seeking a skilled Azure Data Engineer to fill this key role in our organization.Key Responsibilities:Design and implement data pipelines using PySpark, SQL, and Azure Data Factory (ADF)Collaborate with stakeholders to deliver scalable data-driven outcomesWork in Agile teams to handle data validation, transformation, and...


  • Vellore, Tamil Nadu, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,09,00,000

    About Us:We're a leading provider of telenutrition and foodcare solutions. Our platform empowers healthier food choices, drives lasting behavior change, and delivers long-term health outcomes.Our highly personalized digital platform guides users on a tailored journey to eating well while saving time and money.We integrate dietary assessments and nutrition...


  • Vellore, Tamil Nadu, India beBeeData Full time ₹ 12,00,000 - ₹ 18,00,000

    Job DescriptionWe are seeking a skilled Data Specialist to design and implement robust data pipelines that transform large, complex datasets into high-quality structured information.The primary focus is to:Extract key attributes from unstructured/semi-structured documents using advanced automation techniques.Validate and check data quality with automated...