Current jobs related to Data Pipeline Specialist - Gulbarga, Karnataka - beBeeValidator


  • Gulbarga, Karnataka, India beBeeAzure Full time ₹ 75,00,000 - ₹ 1,00,00,000

    Job Title: Azure Integration SpecialistOverview:We are seeking a highly skilled Azure Integration Specialist to support our client in Dubai. The ideal candidate will have expertise in designing, developing, and deploying data pipelines using Azure Data Factory.Key Responsibilities:Troubleshoot and resolve issues with Azure Synapse Analytics, Power BI, SQL...


  • Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Developing and Implementing Data PipelinesWe are seeking a skilled professional with proficient knowledge in Spark and SQL to join our dynamic team. The ideal candidate will be responsible for designing, implementing, and optimizing data pipelines on our platform.Key responsibilities include designing, developing, and maintaining scalable data pipelines...


  • Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title:Data Engineer for Financial and Crypto DomainsDescription:We are seeking a skilled data engineer to design, build, and maintain robust data pipelines for high-volume financial data. This role involves collaborating with cross-functional teams to provide clean, structured, and scalable datasets.Design end-to-end data pipelines for stocks, crypto,...


  • Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    As a skilled Data Engineer, you will be responsible for designing and implementing data pipelines, orchestrating workflows, and processing data.This role requires a strong background in data engineering with experience in creating, updating, and downloading jobs in Big Query, as well as working with Pyspark, Dataflows, and Dataproc.Additionally, the ideal...


  • Gulbarga, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Cloud Data Integration SpecialistWe are seeking an experienced professional to support our data integration and ETL needs.The ideal candidate will have strong hands-on expertise in designing, building, and maintaining scalable and secure data pipelines across multiple sources and destinations.Design and Build Pipelines: Create efficient Azure Data Factory...

  • Data Engineer

    1 week ago


    Gulbarga, Karnataka, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job OpportunityWe are seeking a highly skilled professional to join our team in designing, building, and maintaining robust data pipelines. This role requires the ability to curate and ingest data efficiently using Azure cloud services.Key Responsibilities:Design and implement scalable data solutions that meet business requirements.Work with cross-functional...


  • Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 80,00,000 - ₹ 1,60,00,000

    Key Roles and Responsibilities:Data Engineers are required to design, develop, and maintain ETL/ELT data pipelines. They must be able to ingest data from various sources into our data warehouse.This includes databases and flat files. The ideal candidate will have experience with AWS Cloud services, including Lambda, DMS, and Glue.A solid understanding of...


  • Gulbarga, Karnataka, India beBeeDataPipeline Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Title: Data Pipeline TesterData Pipeline Tester Job DescriptionWe are seeking a skilled data pipeline tester to fill this position. As a data pipeline tester, you will be responsible for ensuring the accuracy, consistency, and high throughput of event-driven systems.Key Responsibilities:Test ETL processes and perform data reconciliation across...


  • Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 18,00,000

    Job Title: Data EngineerWe are seeking a skilled Data Engineer to design and implement robust data pipelines using Python and SQL.Key responsibilities include designing, implementing, and managing CI/CD pipelines using GitHub Actions or equivalent tools.Key Responsibilities:Design and implement efficient CI/CD pipelines using GitHub Actions or equivalent...


  • Gulbarga, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 25,10,000

    Role Summary:Developing data pipelines with StreamSets is crucial for integrating AI tools and hybrid cloud environments. Data analytics professionals must bridge the technical and business gaps, effectively communicating complex ideas and results.We are seeking an experienced leader to spearhead our data efforts in this area.Key Responsibilities:Create...

Data Pipeline Specialist

2 weeks ago


Gulbarga, Karnataka, India beBeeValidator Full time ₹ 20,00,000 - ₹ 25,00,000

Job Overview

A Data Pipeline Validator is responsible for ensuring the integrity and quality of data pipelines. This role requires a strong understanding of data warehouse testing methodologies and ETL concepts.

Responsibilities:

  • Develop and execute test plans to validate data quality and integrity
  • Collaborate with cross-functional teams to identify and prioritize testing needs
  • Analyze and troubleshoot issues in data pipelines, working closely with development teams to resolve problems
  • Stay up-to-date with industry trends and emerging technologies, applying this knowledge to improve testing methodologies and processes

Requirements:

  • 5+ years of experience in ETL Testing, Database Testing, and Manual Testing
  • Strong understanding of ETL concepts and data warehouse testing methodologies
  • Proficient in RDBMS: MySQL, Oracle SQL
  • Hands-on experience with SSIS (SQL Server Integration Services)
  • Skilled in UNIX commands (grep, awk, find) for log analysis and job monitoring
  • Advanced SQL skills: joins, group functions, analytical functions, subqueries
  • AWS services: CloudWatch, EventBridge, QuickSight, Batch Jobs, Lambda, S3, Redshift, Glue
  • Ability to write test automation scripts for data pipelines

Why This Role Matters

This position plays a critical role in ensuring the accuracy and reliability of our data pipelines. If you have a passion for data validation and are looking for a challenging opportunity, we encourage you to apply.