Data Pipeline Specialist

4 days ago

India beBeeDatabase Full time ₹ 29,40,000 - ₹ 31,20,000

Job Title: Data Engineer

Description:

We are seeking a skilled professional to fill the role of Data Engineer. This is a contract-to-hire opportunity that requires strong experience in ETL testing, database testing, and manual testing.

Key Responsibilities:

- Design and develop data pipelines using ETL concepts and methodologies
- Implement monitoring scripts and run them on a regular basis
- Develop and maintain high-quality automated test scripts for data pipelines
- Collaborate with cross-functional teams to identify business requirements and technical solutions
- Perform source-to-target validation, record count verification, data integrity and validation, transformation logic and job run verification
- Create, review, and execute detailed test cases based on business and technical requirements

Requirements:

  • 5+ years of experience in ETL Testing, Database Testing, and Manual Testing
  • Strong understanding of ETL concepts and data warehouse testing methodologies
  • Proficient in RDBMS: MySQL, Oracle SQL
  • Hands-on experience with SSIS (SQL Server Integration Services)
  • Skilled in UNIX commands (grep, awk, find) for log analysis and job monitoring
  • Advanced SQL skills: joins, group functions, analytical functions, subqueries
  • AWS services: CloudWatch, EventBridge, QuickSight, Batch Jobs, Lambda, S3, Redshift, Glue
  • Experience automating data testing using AI/ML tools (nice to have)

Benefits:

This position offers opportunities for professional growth and development. The ideal candidate will have strong analytical, problem-solving, and communication skills to collaborate effectively with the team.

Qualifications:

  • Requirement analysis and work effort estimation
  • Quality management: defect identification, root cause analysis, corrective measures

  • Data Pipeline Architect

    1 day ago

    India beBeeAzure Full time US$ 1,04,000 - US$ 1,30,878

    Azure Data Factory Specialist We are seeking an experienced Azure Data Factory specialist to join our team. The ideal candidate will have strong hands-on expertise in designing, building, and maintaining scalable and secure data pipelines using Azure ADF. Design, build, and maintain Azure Data Factory pipelines for ETL and ELT processes. Integrate data...

  • Data Pipeline Specialist

    2 days ago

    India beBeeDeveloper Full time US$ 1,04,000 - US$ 1,30,878

    ETL Data Engineer - Scalable Pipeline DeveloperWe are seeking an experienced ETL data engineer to build and maintain scalable data pipelines using IBM DataStage and AWS Glue. As a key member of our data engineering team, you will work collaboratively with architects, business analysts, and data modelers to ensure timely and accurate delivery of critical data...

  • Highly Skilled Data Pipelines Architect

    3 days ago

    India beBeeDataEngineer Full time US$ 1,04,000 - US$ 1,30,878

    Senior Data EngineerAbout the RoleWe are seeking an experienced Senior Data Engineer with in-depth expertise in building data pipelines and integrating healthcare data. You will report to the Head of AI Engineering and be responsible for designing, building, and operating the backbone of our AI-powered applications. This is a critical role where you will...

  • Chief Data Pipeline Architect

    2 days ago

    India beBeeData Full time US$ 1,50,000 - US$ 1,75,000

    Senior Data Engineer PositionWe are seeking a highly skilled Senior Data Engineer with expertise in designing, building, and operating scalable data pipelines that support real-time clinical workflows.The ideal candidate will have 5+ years of experience building and maintaining production-grade data pipelines, strong background in workflow orchestration and...

  • Chief Data Pipeline Architect

    2 days ago

    India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Data Engineering PositionWe are seeking an experienced Data Engineer to design and build scalable data pipelines, manage large datasets using Spark and SQL, and deploy real-time streaming applications.Key Responsibilities:Design and optimize data pipelines and ETL workflows.Manage and process large datasets using Spark, PySpark, and SQL.Build and maintain...

  • Highly Skilled Data Pipelines Specialist

    3 days ago

    India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    We're seeking a skilled Data Engineer to lead the design and development of scalable data pipelines on Databricks. This role requires expertise in cloud platforms, with experience integrating with AWS or Azure and managing data governance using Unity Catalog.Key SkillsDatabricks expertise with hands-on experience working on either AWS or AzureProficiency in...

  • High Performance Data Pipeline Specialist

    2 days ago

    India beBeeDataEngineer Full time ₹ 9,00,000 - ₹ 12,00,000

    Big Data EngineerWe are looking for a talented professional to design, build, and maintain high-performance data pipelines that process terabytes of data. This role is critical in ensuring our data infrastructure can handle increasing volumes of data while maintaining exceptional performance standards.About the JobThis role involves designing and...

  • Optimizing Data Pipeline Architecture

    2 days ago

    India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 21,60,000

    Remote Data EngineerWe are seeking a highly skilled Data Engineer to join our team in a 6-month remote contract based in India. As a key member of our data architecture team, you will play a critical part in designing, maintaining, and optimizing our data pipeline architecture.You will be responsible for managing ELT processes using Stitch, including...

  • Data Ingestion Specialist

    2 days ago

    India beBeeIngestion Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    About this Role:We are seeking a Data Ingestion Specialist to join our team. This is an exciting opportunity for a skilled professional to design, develop, and optimize data ingestion pipelines for integrating multiple sources into Databricks.Key Responsibilities:Design and Develop Pipelines: Design and develop data ingestion pipelines for integrating...

  • Data Integration Specialist

    2 days ago

    India beBeeDataIntegration Full time ₹ 80,00,000 - ₹ 1,20,00,000

    Job OpportunityWe are seeking a skilled Data Integration Specialist to play a key role in designing, developing, and optimizing data pipelines for integrating multiple sources into Databricks.Main Responsibilities:Design and develop data ingestion pipelines to integrate various data sources into DatabricksImplement and maintain continuous...