Data Pipeline Specialist

6 days ago

india beBeeEngineer Full time

Job OpportunityWe are seeking a skilled Data Engineer to join our team.This is a freelance position that involves designing and building real-time data ingestion and processing pipelines using Apache NiFi and the Google Cloud Platform (GCP) ecosystem.The ideal candidate will develop scalable solutions using NiFi and GCP services such as BigQuery, Pub/Sub, Dataflow, Dataproc, Cloud Storage, and Composer.Design and implement real-time data ingestion pipelines using Apache NiFi for structured and unstructured datasets.Integrate ingestion and processing pipelines with GCP services including BigQuery, Pub/Sub, Dataflow, Dataproc, Cloud Storage, and Composer.Ensure low-latency and high-throughput data movement across ingestion, processing, and storage layers.Develop and optimize SQL queries for BigQuery and relational databases to support analytics and reporting.Build Python scripts for data transformation, automation, and custom NiFi processors development.Implement data quality checks, validation rules, deduplication, late-arriving data handling, and robust error-handling frameworks.Collaborate with data analysts, scientists, and platform engineering teams to deliver analytics-ready datasets.Apply data security standards, maintain compliance, and monitor pipeline performance for stability and reliability.

  • Data Pipeline Specialist

    2 weeks ago

    india beBeeData Full time

    Join Our Data Support TeamAs a skilled professional in data support, you will play a critical role in ensuring the smooth operation of our data pipeline. With 8+ years of experience, you will be responsible for monitoring and troubleshooting data ingestion, consumption, and pipelines.Key Responsibilities:Support escalation point for issues with data...

  • Data Pipeline Quality Assurance Specialist

    1 week ago

    india beBeeDataPipelineQuality Full time

    Job SummaryWe are seeking a skilled professional to fill the role of Data Pipeline Quality Assurance Specialist. As a key member of our team, you will be responsible for ensuring the accuracy and reliability of our data pipelines.The ideal candidate will have hands-on experience in ETL testing, including Informatica tools such as IDMC/IICS, CDI, and MDM...

  • Data Pipeline Specialist

    2 weeks ago

    india beBeeDataEngineer Full time

    Job DescriptionWe are currently seeking a skilled Data Engineer to join our global data platform, analytics, and cloud engineering teams. This role is ideal for individuals who can design and build scalable data pipelines using modern data engineering tools and frameworks.Key ResponsibilitiesDesign and Build Scalable Data Pipelines: Utilize industry-leading...

  • Senior Data Pipeline Developer

    2 weeks ago

    india beBeeDataPipeline Full time

    Job TitleA seasoned Data Pipeline Specialist is sought to spearhead ETL and API testing initiatives.Oversee end-to-end testing of data pipelines across cloud/on-prem environments.Validate complex data transformations, source-to-target mappings, and SCD logic.Test Informatica IDMC/IICS CDI mappings, taskflows, and ingestion patterns.Broad Responsibilities:ETL...

  • Data Pipeline Specialist

    1 week ago

    india beBeeBackendEngineer Full time

    About the Project:Join our dynamic engineering team working on a high-impact tax reporting platform for future fiscal seasons. The core goal is to modernize and significantly accelerate the generation of Excel-based reports, reducing report generation time from minutes to seconds.You'll be contributing to the backend architecture and data pipeline powering...

  • Data Pipeline Quality Assurance Expert

    1 week ago

    india beBeeQuality Full time

    Job OverviewWe are seeking a skilled QA Specialist with expertise in ETL pipeline testing and API validation. The ideal candidate will possess strong SQL skills, a deep understanding of data flows, and familiarity with Informatica tools such as IDMC/IICS, CDI, and MDM SaaS.Perform end-to-end testing of ETL pipelines across cloud/on-prem environments.Validate...

  • Senior Data Engineer

    2 weeks ago

    Bengaluru, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior Data Engineer / Developer (Pipelines & Analytics) to join our team in Bangalore, Karntaka (IN-KA), India (IN)....

  • Senior Data Engineer

    2 weeks ago

    Bengaluru, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior Data Engineer / Developer (Pipelines & Analytics) to join our team in Bangalore, Karntaka (IN-KA), India (IN)....

  • Data Pipeline Tester

    1 week ago

    india beBeeDataPipelineTester Full time

    Job Opportunity:We are seeking a highly skilled professional to fill the role of Data Pipeline Tester.The ideal candidate will possess hands-on experience in testing data pipelines and API systems. A strong background in SQL and understanding of data flows is essential, as well as familiarity with Informatica tools such as IDMC/IICS, CDI, and MDM...

  • Data Transformation Specialist

    2 days ago

    india beBeeDataTransformation Full time

    Job Title: Data Transformation SpecialistWe are seeking a skilled Data Transformation Specialist to join our team. As a Data Transformation Specialist, you will be responsible for developing and maintaining ETL pipelines using Python and Airflow.About the Role:Collaborate with data analysts to understand data requirements and design scalable solutions using...