Senior Data Pipeline Specialist

3 days ago


Udaipur, Rajasthan, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000
Job Overview

We are seeking an experienced Senior Data Engineer to design and develop scalable data pipelines using Databricks and PySpark.

  • Our ideal candidate will have a strong understanding of distributed data processing, CI/CD pipelines, and infrastructure as code using Terraform.
  • The role involves implementing and managing data solutions on AWS, including services like S3, Glue, Lambda, EMR, and Redshift.
  • Additional responsibilities include collaborating with data scientists and analysts to support end-to-end data solutions and monitoring performance of data pipelines and cloud infrastructure.
Key Requirements

The successful candidate will possess:

  • Hands-on experience with Databricks (Essential)
  • Solid knowledge of AWS cloud services (Essential)
  • Proficiency in PySpark and distributed data processing
  • Experience in implementing CI/CD workflows for data solutions
  • Working knowledge of Terraform for infrastructure management
About the Role

This is an exciting opportunity for a skilled Senior Data Engineer to contribute to our dynamic data engineering team.

  • The successful candidate will be responsible for designing and developing high-performance data pipelines using Databricks and PySpark.
  • The role also involves working closely with other teams to deliver end-to-end data solutions and ensuring the scalability and reliability of our data infrastructure.


  • Udaipur, Rajasthan, India beBeeFinancial Full time ₹ 20,00,000 - ₹ 25,00,000

    We are seeking a highly skilled Big Data Engineer to join our growing team. In this role, you will be responsible for designing, building, and maintaining robust data pipelines that handle high-volume financial data, including stocks, cryptocurrencies, and third-party data sources. You will play a critical role in ensuring data integrity, scalability, and...


  • Udaipur, Rajasthan, India beBeeData Full time ₹ 15,00,000 - ₹ 22,50,000

    Unlock Your Potential as a Data EngineerWe are seeking an experienced Data Engineer to drive innovation in our data pipeline team.Your expertise in designing, developing, and running complete end-to-end data pipelines on the Azure platform will be invaluable.As a key member of our team, you will work closely with Agile teams to handle data validation,...


  • Udaipur, Rajasthan, India beBeeDataEngineer Full time US$ 1,50,000 - US$ 1,75,000

    Job Description:The Senior Data Engineer plays a pivotal role in constructing and optimizing the data pipeline architecture. This individual will lead the optimization and scalability of data delivery pipelines, ensuring performance and reliability for cross-functional stakeholders. This key position is responsible for architecting, building, and maintaining...


  • Udaipur, Rajasthan, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job OverviewOur organization is seeking a highly skilled Data Engineer to join our team. This individual will be responsible for designing, implementing, and managing CI/CD pipelines using GitHub Actions or equivalent tools. They will also configure and maintain GitHub branch protection rules and workflows to ensure smooth code integration and deployment.Key...


  • Udaipur, Rajasthan, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Data EngineerWe are seeking an experienced data engineer with expertise in designing, building, and optimizing scalable data pipelines and cloud solutions. The ideal candidate will have strong experience in AWS cloud services, data engineering, and knowledge of upstream, midstream or downstream processes to support advanced analytics, reporting,...


  • Udaipur, Rajasthan, India beBeeDataEngineer Full time ₹ 25,00,000 - ₹ 30,00,000

    Cloud Data Engineer Job DescriptionLooking for an opportunity to work on complex data engineering projects and drive innovation in cloud-based data platforms? We are seeking a highly skilled Cloud Data Engineer to join our team. The ideal candidate will have experience designing, developing, and maintaining scalable data pipelines using PySpark.The role...


  • Udaipur, Rajasthan, India beBeeAutomation Full time ₹ 9,00,000 - ₹ 12,50,000

    About the RoleWe are seeking a highly skilled Senior Data Automation Specialist to join our team. The ideal candidate will have strong experience in data validation and transformation logic, along with hands-on expertise in synthetic test data generation.This role will support the development of a Golden Model simulation in a CI/CD environment, working...


  • Udaipur, Rajasthan, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    We are seeking a seasoned Cloud Data Engineer to join our team and take charge of designing and building scalable data pipelines.About the RoleThe ideal candidate will have a strong background in Azure Data Factory, with expertise in ETL/ELT processes and pipeline design.Design and build data pipelines using Azure Data Factory that ensure smooth, secure, and...


  • Udaipur, Rajasthan, India beBeeCloudIntegration Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Data Engineer – Cloud Integration SpecialistWe are seeking a seasoned Senior Data Engineer to play a pivotal role in designing and implementing scalable data pipelines using Azure technologies.Key Responsibilities:Design, build, and maintain large-scale data pipelines using Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake...


  • Udaipur, Rajasthan, India beBeeEngineer Full time ₹ 1,50,00,000 - ₹ 2,01,00,000

    About this Opportunity:Our organization is seeking a visionary Lead Engineer to spearhead the development of our data pipelines.We require an exceptional individual with hands-on expertise in Python, architecture, and performance optimization.Key Responsibilities:Platform Engineering:Design and implement a shared component library for ingestion, parsing,...