Data Pipeline Specialist

1 week ago

Ahmedabad, Gujarat, India beBeeetltester Full time ₹ 90,00,000 - ₹ 1,20,00,000

We are seeking an experienced ETL Tester with a strong database engineering background to join our data team.

The ideal candidate will be proficient in writing complex SQL queries, performing data profiling, and testing ETL processes, data migrations, and reporting systems.

  • Data Profiling: Analyze source data to understand data structures, distributions, and anomalies to ensure data quality and readiness for processing.
  • ETL/Data Migration Testing: Validate the extraction, transformation, and loading processes to confirm data accuracy and completeness during migrations or regular ETL runs.
  • Test Strategy Development: Design comprehensive testing plans and strategies for ETL workflows, data migrations, and reporting tools.
  • Report Testing: Validate the accuracy, completeness, and performance of reports generated from the data warehouse, including front-end dashboards and backend reporting systems.
  • Frontend & Backend Testing: Perform end-to-end testing of the interface and backend systems, ensuring consistent data flow and user experience.
  • SQL & Database expertise: Write advanced SQL queries for data validation, reconciliation, and troubleshooting.
  • Issue Identification & Resolution: Detect data discrepancies, performance bottlenecks, and functional issues, and collaborate with developers and data engineers for resolution.

You will play a critical role in ensuring the integrity, accuracy, and performance of our data pipelines and dashboards.

Required Skills and Qualifications:
  • Bachelor's degree in Computer Science, Information Technology, or related field.
  • Proven experience (3+ years) as an ETL Tester, Data QA Analyst, or similar role.
  • Strong proficiency in SQL (write complex, optimized queries, stored procedures, etc.)
  • Hands-on experience with data profiling, data validation, and data migration testing.
  • Familiarity with ETL tools and frameworks is a plus.
  • Experience with testing dashboard frontends and backend services.
  • Knowledge of databases such as SQL Server, Oracle, MySQL, or PostgreSQL.
  • Strong analytical and problem-solving skills.
  • Excellent communication skills to document issues and collaborate with cross-functional teams.

Preferred Attributes:

  • Experience with automating tests and scripts.
  • Knowledge of scripting languages like Python, Shell, or similar.
  • Familiarity with BI tools is a plus.
  • Understanding of data systems.

If you find this opportunity interesting, please share your details below:

  • Total Experience
  • Experience in ETL Testing –
  • Experience in Data profiling–
  • Experience in Test Strategy –
  • Current CTC –
  • Expected CTC–
  • Notice period–
  • Current Location-

Please let us know if you had any previous interactions with our team.

  • Data Pipeline Specialist

    1 week ago

    Ahmedabad, Gujarat, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Key Responsibilities:Design and implement large-scale data pipelines using Python, SQL, PySpark.Collaborate with Data Scientists to develop Machine Learning models and ensure high-quality data.Work with distributed frameworks like Spark, Databricks, and cloud-based data warehousing platforms.Develop tools and libraries used across multiple teams within the...

  • Senior Data Pipeline Specialist

    2 weeks ago

    Ahmedabad, Gujarat, India beBeeData Full time ₹ 8,00,000 - ₹ 12,00,000

    Optimizing data pipelines is key to ensuring seamless data integration. The successful ETL Tester will have strong analytical skills, attention to detail, and excellent problem-solving abilities.The ideal candidate should be proficient in various data transfer tools such as Azure/ADF, SQL, and Python or Java. He/she must be able to identify and troubleshoot...

  • Senior Data Pipeline Quality Assurance Professional

    1 week ago

    Ahmedabad, Gujarat, India beBeeEtlSpecialist Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior ETL Test SpecialistDescription:We're seeking a seasoned ETL test professional to join our organization for an exciting project. As a key member of our testing team, you will play a critical role in ensuring the quality and reliability of our data pipelines.Main Responsibilities:Perform comprehensive ETL testing across complex data pipelines...

  • Senior Data Engineer

    2 weeks ago

    Ahmedabad, Gujarat, India beBeeDataEngineer Full time ₹ 14,68,800 - ₹ 19,12,000

    Job OpportunityA senior data engineer with expertise in Airflow, Python, and Snowflake is required to design, develop, and maintain complex data pipelines.Able to leverage distributed systems, containerization, and cloud-based technologies.The ideal candidate will have experience working on scalable data processing solutions using Apache Airflow, implement...

  • Data Pipeline Engineer

    2 weeks ago

    Ahmedabad, Gujarat, India beBeeBackOffice Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Description">Role OverviewAbout the Role:We are looking for a skilled software engineer to build robust data pipelines and transform raw on-chain data into actionable insights.This role is ideal for someone who enjoys low-level protocol work, understands DeFi mechanics, and can implement pricing logic from decentralized exchanges...

  • Cloud Data Specialist

    1 week ago

    Ahmedabad, Gujarat, India beBeeData Full time ₹ 12,00,000 - ₹ 15,00,000

    Job Title: Cloud Data SpecialistJob Overview:We are seeking a skilled and motivated Cloud Data Specialist with hands-on experience in building scalable data pipelines and cloud-native data solutions. The ideal candidate will be proficient in designing, developing, and optimizing robust data ingestion pipelines using GCP services such as Pub/Sub, Dataflow,...

  • Data Engineer for Large-Scale Data Pipelines

    2 weeks ago

    Ahmedabad, Gujarat, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Data EngineerAbout the RoleWe are seeking an experienced data engineer to design, build and maintain large-scale data pipelines in Google Cloud Platform. The ideal candidate will have a strong background in data engineering with expertise in GCP.The primary responsibility of this role is to develop, construct, test and maintain data acquisition...

  • Cloud Data Pipeline Engineer

    1 week ago

    Ahmedabad, Gujarat, India beBeeBackend Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Cloud Data Pipeline EngineerDevelop scalable data pipelines using Python and Azure Functions/Container Apps or AKS jobs.Design efficient ETL/ELT patterns, implement testability (pytest), and observability (OpenTelemetry).Key Requirements:4+ years of experience in backend/data engineering with a focus on cloud technologies.Expertise in Python,...

  • Chief Data Pipeline Architect

    2 weeks ago

    Ahmedabad, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Job OverviewWe are seeking a skilled Data Engineer to design, build, and optimize scalable data pipelines. As a key member of our team, you will be responsible for managing and processing large datasets, building real-time streaming applications, and collaborating with data scientists to integrate AI/ML models into production.

  • Data Transformation Specialist

    1 week ago

    Ahmedabad, Gujarat, India beBeeDataTransformation Full time ₹ 40,00,000 - ₹ 80,00,000

    Job Title: Data Transformation SpecialistRole OverviewWe are seeking a skilled data transformation specialist to design and develop efficient data pipelines using IBM DataStage and AWS Glue/Lambda for ingestion from various sources.Collaborate with architects, business analysts, and data modelers to ensure timely and accurate delivery of critical data...