Senior Data Pipeline Specialist

1 week ago

Kota, Rajasthan, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

We are currently seeking a skilled professional to assume the role of Senior ETL Tester for an engaging project. This is an excellent opportunity for individuals who thrive in dynamic environments and are passionate about ensuring the accuracy and reliability of complex data pipelines.

Key Responsibilities:
  • Perform thorough testing of ETL processes across enterprise-grade data systems to ensure seamless data transfer and minimal errors.
  • Develop and execute advanced SQL queries to validate, reconcile, and transform data, guaranteeing high-quality results.
  • Brew automation frameworks using Python, integrating them seamlessly with CI/CD pipelines (e.g., GitHub Actions, Jenkins).
  • Collaborate closely with DevOps teams to refine automation workflows and contribute to version-controlled repositories on GitHub.
  • Participate actively in performance Testing/Monitoring and data integrity assurance across structured and semi-structured data sets.
Required Skills and Qualifications:
  • Mandatory hands-on experience in ETL testing.
  • Expertise in advanced SQL for large-scale data operations.
  • Proven ability to automate data validation using Python, with exposure to CI/CD tools and GitHub.
Favorable Qualifications:
  • Familiarity with AWS cloud services, especially S3 and Airflow.
  • Experience with PostgreSQL, Oracle, or SQL Server databases.

  • Data Pipeline Architectural Specialist

    2 weeks ago

    Kota, Rajasthan, India beBeeDataDriven Full time ₹ 10,00,000 - ₹ 15,00,000

    **Data Pipeline Architectural Specialist**Create and maintain scalable data pipelines using Glue, Python, EMR/Spark, and Kafka/Kinesis streaming.Design and develop efficient relational databases with a preference for Aurora Postgres.Develop complex SQL queries and stored procedures to drive business insights.Troubleshoot and resolve data quality issues...

  • Data Pipeline Architect

    2 weeks ago

    Kota, Rajasthan, India beBeeAirflow Full time ₹ 15,00,000 - ₹ 19,00,000

    Expert Data Pipeline DeveloperAs a seasoned data engineer, you will be responsible for designing and implementing scalable and reliable data pipelines using Airflow.Develop complex workflows using Airflow, ensuring high-quality data flow and meeting business requirements.Collaborate with cross-functional teams to integrate data pipelines with business...

  • Senior Financial Data Pipeline Specialist

    1 week ago

    Kota, Rajasthan, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Large Scale Data Engineering Opportunity\We are seeking a skilled data engineer to work on a large-scale financial institution project.\The ideal candidate will have experience designing and deploying data pipelines, orchestrating workflows, processing data, managing datasets, and integrating with APIs and CI/CD pipelines.\\Must have 6+ years of experience...

  • Data Architect for Cloud-Based Data Pipelines

    1 week ago

    Kota, Rajasthan, India beBeeETL Full time ₹ 15,00,000 - ₹ 20,00,000

    We are seeking a highly experienced Senior Informatica Engineer to design and develop cloud-based ETL pipelines using Azure services and integrate data into AWS Datalake or other modern data platforms.

  • Data Pipeline Engineer

    1 week ago

    Kota, Rajasthan, India beBeebackend Full time ₹ 15,00,000 - ₹ 20,00,000

    Senior Backend Data & Integration EngineerA seasoned software engineer is required to design and implement data pipelines, integrate external systems and interfaces, and develop crawling/fetch pipelines.Key Responsibilities:Development of efficient crawling/fetch pipelines using API-first approach with playwright/requests where permitted.Parsing and...

  • AWS Cloud Data Pipeline Architect

    2 weeks ago

    Kota, Rajasthan, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    As a Data Engineering Specialist, you will play a key role in designing and implementing data pipelines using AWS services.Key Responsibilities:Design and develop scalable data pipelines using AWS services including Glue, PySpark, SQL, Databricks, and Python.Develop and maintain applications using Python and PySpark for data manipulation, transformation, and...

  • Data Pipeline Architect

    2 weeks ago

    Kota, Rajasthan, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 18,00,000

    Cloud Data Engineer OpportunityWe are seeking a highly skilled AWS Cloud Data Engineer to design, build, and maintain scalable data pipelines on AWS. The ideal candidate will have a solid background in cloud-based data solutions, object-oriented programming, reusable code design, and Python development.This role involves building, optimizing, and maintaining...

  • MACHINE LEARNING PIPELINE SPECIALIST

    2 weeks ago

    Kota, Rajasthan, India beBeeMachineLearning Full time ₹ 20,00,000 - ₹ 25,00,000

    Role SummaryWe are seeking an experienced Machine Learning Pipeline Specialist to lead our team in building and maintaining scalable ML pipelines and backend services.Main Responsibilities:Design, develop, and maintain complex machine learning models and deploy them into production using Python frameworks like Tornado and FastAPI.Work closely with...

  • Data Pipeline Architect

    1 week ago

    Kota, Rajasthan, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Scalable Data EngineerWe are seeking a highly motivated and talented data engineer to join our team. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines using IBM DataStage (on Cloud Pak for Data), AWS Glue, and Snowflake.Key Responsibilities:Design, develop, and maintain ETL pipelines using IBM...

  • GCP Data Engineer

    3 weeks ago

    Kota, Rajasthan, India CustomerLabs 1P Data OPs Full time

    Position Overview:"Yesterday is history, tomorrow is a mystery, but today is a gift. That's why we call itthe present." - Master OogwayJoin CustomerLabs' dynamic data team as a Data Engineer and play a pivotal role intransforming raw marketing data into actionable insights that power our digitalmarketing platform. As a key member of our data infrastructure...