Data Pipeline Specialist

9 hours ago

Aligarh, Uttar Pradesh, India beBeeData Full time ₹ 9,00,000 - ₹ 15,00,000

System Tester Job Description

Job Title:

ETL Tester

About the Role:

We are seeking a highly skilled QA Engineer with expertise in ETL testing, Kafka/Redpanda, and MongoDB.

The role involves testing large-scale data pipelines, ensuring data accuracy, consistency, and throughput in event-driven systems.

Key Responsibilities:
  • Test ETL processes and perform data reconciliation across systems.
  • Validate Kafka/Redpanda pipelines (producers, consumers, topics, schema registry, Avro/JSON).
  • Ensure data quality in terms of accuracy, consistency, and high throughput.
  • Write and run MongoDB queries for data checks.
  • Create and maintain test cases, defect reports, and collaborate with developers/product teams.
Requirements:
  • Minimum 2 plus years of experience as a QA engineer.
  • Familiarity/experience with process methodologies used in the software industry.
Technical Skills:
  • Strong knowledge of ETL testing, data validation, and reconciliation.
  • Hands-on experience with Kafka/Redpanda.
  • Good understanding of throughput, consistency, and defect tracking.
  • Familiar with Git, CI/CD, and tools like JIRA or Azure DevOps.
Nice to Have:
  • Scripting skills in Python/Java for automation.
  • Knowledge of cloud platforms (Azure, AWS, GCP) and Docker/Kubernetes.
  • Exposure to Flink/Spark or other streaming frameworks.
Work Environment:
  • Ability to work in a remote and/or office setting.
  • Work in shifts would be 2 pm to 10 pm.
  • Work in an on-call mode to support as required.
  • Fast-paced environment with tight deadlines.
  • Support offshore hours/multiple time zones.
  • Flexibility with working hours based on team and client needs.

  • Data Ingestion Pipeline Specialist

    1 week ago

    Aligarh, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 8,00,000 - ₹ 15,00,000

    Highly skilled Data Engineers with a strong focus on data ingestion are sought after to develop scalable and efficient ingestion workflows.Data Ingestion EngineerWe are seeking an experienced professional to lead the design, development, and optimization of data pipelines for integrating multiple sources into Databricks.Design, implement, and maintain data...

  • Pipeline Operations Specialist

    2 days ago

    Aligarh, Uttar Pradesh, India beBeePipeline Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Pipeline Operations SpecialistThis role involves conducting hot tapping and pipeline isolation services, ensuring safe and efficient operations while adhering to industry standards and regulations.Perform site inspections and prepare technical reportsCoordinate with clients to meet their requirementsThe ideal candidate will have experience in hot...

  • Senior Data Pipeline Specialist

    6 days ago

    Aligarh, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 24,00,000

    Data Engineer PositionAs a senior data engineer, you will play a critical role in designing and implementing data pipelines that drive business growth. Your expertise in Python and AWS will enable you to develop scalable and efficient solutions for large datasets.The ideal candidate will have strong knowledge of ETL tools such as Glue and Talend, as well as...

  • Senior Data Pipeline Specialist

    2 weeks ago

    Aligarh, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    We are currently seeking an experienced Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and optimizing data processing pipelines using Azure Cloud technologies.Key ResponsibilitiesDesign, develop, and maintain scalable ETL pipelines for batch data ingestion and egress using Azure Data Factory,...

  • Data Pipeline Validator

    10 hours ago

    Aligarh, Uttar Pradesh, India beBeeETL Tester Full time ₹ 9,00,000 - ₹ 12,00,000

    Job OpportunityWe are seeking a skilled professional to validate data pipelines and transformations in Databricks, utilizing Python scripting and strong SQL skills.About the Role:This role involves working with complex data sets, identifying discrepancies, and implementing corrective actions to ensure seamless data flow.Key Responsibilities:

  • Machine Learning Data Pipeline Specialist

    4 days ago

    Aligarh, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Data Engineer PositionAbout us:We're a customer engagement platform empowering fitness, wellness, and service businesses.We are evolving into an AI-native platform where intelligent agents predict churn, upsell opportunities, and automate member engagement.Job Overview:We're looking for a data engineer who can bridge the gap between data engineering and...

  • Data Pipeline Developer Opportunity

    2 days ago

    Aligarh, Uttar Pradesh, India beBeeDataPipelineDeveloper Full time ₹ 25,00,000 - ₹ 35,00,000

    Data Pipeline Developer OpportunityWe are seeking a seasoned data pipeline developer to join our team and drive the design, development, and implementation of cutting-edge data pipelines.The ideal candidate will have 3–12 years of experience in building and managing large-scale data systems, including data lakes, data warehouses, and data pipelines.A...

  • Freelance Cloud Architect – Data Pipelines Specialist

    5 days ago

    Aligarh, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 16,00,000 - ₹ 22,00,000

    Job Description:">As a Freelance Data Engineer with expertise in Python, you will play a pivotal role in designing and developing data pipelines using AWS services. Your primary objective will be to create efficient and scalable data workflows that cater to the evolving needs of our organization.">Key Responsibilities:">Develop robust data pipelines...

  • #Data Engineering: Scalable Data Ingestion Pipelines

    2 weeks ago

    Aligarh, Uttar Pradesh, India beBeeDataIngestion Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    For a highly skilled Data Ingestion Expert, we are seeking an accomplished Data Pipeline Engineer to create and manage data ingestion pipelines. The successful candidate will design and develop scalable data ingestion workflows for integrating multiple sources into Databricks.The ideal candidate will have hands-on experience with CI/CD tools, such as GitHub...

  • Chief Data Pipeline Architect

    4 days ago

    Aligarh, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Transform Data into InsightsWe're seeking a skilled Data Engineer to join our team. The ideal candidate has 1–2 years of experience in data engineering and is excited to solve tough data problems in a fast-paced environment.The RoleDesign, build, and maintain production-level data pipelines that handle terabytes of structured and unstructured data.Own...