Senior Data Pipeline Specialist

2 days ago


Anand, Gujarat, India beBeeDataValidator Full time ₹ 25,00,000 - ₹ 35,00,000
Job Description

We are seeking a seasoned ETL professional to perform testing across complex data pipelines and enterprise-grade data systems.

Responsibilities include developing and executing advanced SQL queries for data validation, reconciliation, and transformation checks.

Additionally, the ideal candidate will build and maintain data validation automation frameworks using Python, with seamless integration into CI/CD pipelines (e.g., GitHub Actions, Jenkins).

Required Skills
  • Strong hands-on experience in ETL testing is mandatory.
  • Expertise in advanced SQL for large-scale data operations is required.
  • Proven ability to automate data validation using Python, with exposure to CI/CD tools and GitHub is essential.
Good to Have
  • A working knowledge of AWS cloud services, particularly S3 and Airflow, is beneficial.
  • Experience with PostgreSQL, Oracle, or SQL Server databases is a plus.
Why This Role?

This role offers an exciting opportunity to work on high-profile projects and collaborate with DevOps teams.

The ideal candidate will be part of a dynamic team that values innovation and continuous learning.



  • Anand, Gujarat, India beBeedataengineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Software EngineerJob Description:Develop and optimize data pipelines using Azure Data Factory, Databricks, and Synapse Analytics.Design scalable data architectures following best practices.Perform data ingestion, transformation, and orchestration across structured and unstructured datasets.Key Responsibilities:Develop and maintain data lake solutions...


  • Anand, Gujarat, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    Job Opportunity: We are seeking a highly skilled Azure Databricks Engineer for a short-term contract position.The ideal candidate will have hands-on experience with designing and developing data pipelines using Azure Data Factory, Databricks notebooks with SQL & Python, and file formats such as Parquet, Delta, and CSV. A professional with 7+ years of...


  • Anand, Gujarat, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    Job OverviewAs a Senior Data Engineer, you will be responsible for designing, building, and optimizing large-scale data pipelines on the cloud.You will implement data ingestion, transformation, and integration solutions using Spark, Glue, and SQL. Additionally, you will manage and optimize cloud storage and compute environments to ensure high performance and...


  • Anand, Gujarat, India beBeeDataPipeline Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior Data Pipeline EngineerJob Title: Senior Data Pipeline EngineerPrimary Skills:Oracle Data Flow, Apache Spark, Python, PySparkSecondary Skills:ADW, Object Storage, OCI Data IntegrationKey Responsibilities:Design and develop data pipelines using Oracle Data Flow or Apache Spark (PySpark)Orchestrate data workflows ensuring seamless integration and...


  • Anand, Gujarat, India beBeeDataQuality Full time ₹ 18,00,000 - ₹ 23,00,000

    About Data Quality EngineersWe are looking for skilled professionals to join our team of Data Quality Engineers.Data Quality Engineers play a vital role in ensuring the accuracy and reliability of our clients' data pipelines.Key Responsibilities:Develop and execute automated tests to identify and resolve data quality issues.Requirements:Hands-on experience...


  • Anand, Gujarat, India beBeeMachineLearning Full time ₹ 12,00,000 - ₹ 25,00,000

    AI Engineer Role OverviewThe primary objective of this position is to design and optimize data pipelines using Python, Pandas, and Scikit-learn.Key Responsibilities:Develop and refine data pipelines for AI applications.Support Large Language Model (LLM) based initiatives through prompt engineering.Conduct thorough model evaluation and testing to ensure...


  • Anand, Gujarat, India beBeeDataEngineer Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Senior Data EngineerWe are seeking a skilled data professional to lead the design, development and maintenance of our data pipelines. The ideal candidate will have experience with Oracle Symphony, Databricks Lakehouse platform and Oracle EPM.Responsibilities include designing and implementing end-to-end pipelines from API extraction to data integration in...


  • Anand, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 22,50,000

    Job OpportunityWe are seeking a skilled Data Engineer with proficient knowledge in Spark and SQL to fill this critical role.Job Description:The ideal candidate will be responsible for designing, implementing, and optimizing data pipelines on our Data platform. You will work closely with data architects, and other stakeholders to ensure data accessibility,...


  • Anand, Gujarat, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Key Position:Senior Big Data SpecialistWe are seeking a highly skilled Senior Big Data Specialist to join our delivery team, focusing on hands-on project support and mentoring junior engineers.This role is ideal for a developer who excels in a technical environment and is passionate about coaching and developing the next generation of talent.You will work on...


  • Anand, Gujarat, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Data Architect SpecialistWe are seeking a highly skilled Data Architect Specialist to design, build, and optimize scalable data pipelines using Snowflake, AWS (Lambda, Glue), DBT, and SQL.