Data Pipeline Specialist

3 days ago

Ajmer, Rajasthan, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000
Job Description

We are seeking a self-motivated Data Engineer with 4-7 years of experience to build and optimize scalable ETL/ELT pipelines using Azure Databricks, PySpark, and Delta Lake.

The role involves working across scrum teams to develop data solutions, ensure data governance with Unity Catalog, and support real-time and batch processing.

Strong problem-solving skills, T-SQL expertise, and hands-on experience with Azure cloud tools are essential.

Required Skills and Qualifications
  • Work with different scrum teams to develop all the quality database programming requirements of the sprint.
  • Experience in Azure cloud platforms like Advanced Python Programming, Databricks, Azure SQL , Data factory (ADF), Data Lake, Data storage, SSIS.
  • Create and deploy scalable ETL/ELT pipelines with Azure Databricks by utilizing PySpark and SQL.
  • Create Delta Lake tables with ACID transactions and schema evolution to support real-time and batch processing.
  • Experience in Unity Catalog for centralized data governance, access control, and data lineage tracking.
  • Independently analyse, solve, and correct issues in real time, providing problem resolution end-to-end.
  • Develop unit tests to be able to test them automatically.
  • Use SOLID development principles to maintain data integrity and cohesiveness.
  • Interact with product owner and business representatives to determine and satisfy needs.
  • Critical thinker and problem-solving skills.
  • Team player.
  • Good time-management skills.
  • Great interpersonal and communication skills.
Benefits

At our company, we focus on modernizing complex back-office systems to create scalable, secure, and high-performing platforms that streamline operations for our clients.

As part of our strategic growth, we are focused on platform modernization — transitioning legacy systems to modern, cloud-native architectures that support the scalability, reliability, and high performance of core back-office functions in the insurance domain.

Others

Healthcare domain knowledge is a plus.

  • Data Pipeline Specialist

    4 days ago

    Ajmer, Rajasthan, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job SummaryWe are seeking a highly skilled Data Engineer to design, build and maintain large-scale data pipelines. This individual will work with streaming data, collaborate with data scientists and stakeholders to deliver high-quality solutions.Key Responsibilities:Design and optimize complex data pipelines using Spark and ETL workflows.Manage and process...

  • Data Pipeline Specialist

    6 days ago

    Ajmer, Rajasthan, India beBeeEtl Full time ₹ 15,00,000 - ₹ 20,00,000

    ETL DeveloperWe are seeking a skilled ETL professional to join our data engineering team. The ideal candidate will have expertise in designing, developing and maintaining scalable data pipelines using IBM DataStage and AWS Glue.The successful applicant will collaborate with architects, business analysts and data modelers to ensure timely delivery of critical...

  • Data Pipeline Specialist

    3 days ago

    Ajmer, Rajasthan, India beBeeData Full time ₹ 18,95,000 - ₹ 25,10,000

    Our organization seeks a Senior Data Engineer to contribute to the design and development of scalable, high-performance data pipelines using Databricks and PySpark.This role is part of a dynamic team that collaborates with data scientists, analysts, and other engineering teams to support end-to-end data solutions. As a Senior Data Engineer, you will be...

  • Data Engineer – Pipeline Specialist

    2 days ago

    Ajmer, Rajasthan, India beBeedataengineer Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    ">Design and Develop Data Pipelines with Python">

  • Senior Render Pipeline Specialist

    3 hours ago

    Ajmer, Rajasthan, India beBeeRender Full time ₹ 10,00,000 - ₹ 15,00,000

    Senior Render Pipeline SpecialistThe role of a Senior Render Pipeline Specialist involves managing, optimizing, and troubleshooting rendering workflows across multiple digital content creation (DCC) applications including Maya, Blender, Houdini, and 3ds Max.

  • Data Pipeline Quality Assurance Specialist

    2 days ago

    Ajmer, Rajasthan, India beBeeTest Full time ₹ 15,00,000 - ₹ 25,00,000

    Job DescriptionYou will play a key role in ensuring the accuracy, integrity, and performance of ETL pipelines deployed into cloud environments. Your task will be to develop and automate comprehensive test cases to validate data flows, transformations, and system behaviours using Python scripting and a popular testing framework.Key Responsibilities:Design and...

  • Chief Data Pipeline Architect

    5 hours ago

    Ajmer, Rajasthan, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Summary:We are seeking a highly motivated and experienced Data Engineer to design, build, and maintain robust data pipelines. The ideal candidate will have deep expertise in cloud-based data processing technologies using GCP, AWS, or Azure.Responsibilities:Design, develop, and maintain scalable data pipelines using cloud services (GCP, AWS, or...

  • Chief Data Pipeline Architect

    2 days ago

    Ajmer, Rajasthan, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Job OverviewWe are seeking a highly skilled Data Engineer to join our data infrastructure team. As a key member of the team, you will design, develop, and maintain robust data pipelines, data warehouses, and analytics platforms that serve as the backbone of our digital product development.

  • Data Insights Specialist

    11 hours ago

    Ajmer, Rajasthan, India beBeeData Full time ₹ 15,00,000 - ₹ 24,00,000

    Data Insights SpecialistWe're building the future of collections and financial inclusion with cutting-edge recovery infrastructure.We seek an experienced Data Insights Specialist to design end-to-end data pipelines, develop advanced predictive models, and create real-time dashboards for operational performance tracking. The ideal candidate will have 3-8...

  • Lead Data Specialist

    2 days ago

    Ajmer, Rajasthan, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Lead Data Specialist Job DescriptionJob Title: Lead Data SpecialistJob Summary:We seek a skilled professional to lead the development of data pipelines and enhance data models for growing data volumes and complexity.Key Responsibilities:Develop scalable data architectures to support increasing data needs.Collaborate with business teams to improve data...