Building Scalable Data Pipelines

5 days ago

Bhavnagar, Gujarat, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

Job Title: Data Engineer

Location: Hyderabad, India

Employment Type: Full-time

Experience : 4 to 7 Years

About Us:

We are transforming the insurance industry by developing innovative benefits management solutions. We modernize complex back-office systems to create scalable, secure, and high-performing platforms that streamline operations for our clients. As part of our strategic growth, we focus on platform modernization — transitioning legacy systems to modern, cloud-native architectures that support the scalability, reliability, and high performance of core back-office functions in the insurance domain.

Position Overview:

We seek a self-driven Data Engineer with 4–7 years of experience to build and optimize scalable ETL/ELT pipelines using Azure Databricks, PySpark, and Delta Lake. The role involves working across scrum teams to develop data solutions, ensure data governance with Unity Catalog, and support real-time and batch processing. Strong problem-solving skills, T-SQL expertise, and hands-on experience with Azure cloud tools are essential. Healthcare domain knowledge is a plus.

Responsibilities:

  • Develop all quality database programming requirements with different scrum teams.
  • Experience in Azure cloud platforms like Advanced Python Programming, Databricks, Azure SQL , Data factory (ADF), Data Lake, Data storage, SSIS.
  • Create and deploy scalable ETL/ELT pipelines with Azure Databricks by utilizing PySpark and SQL.
  • Create Delta Lake tables with ACID transactions and schema evolution to support real-time and batch processing.
  • Experience in Unity Catalog for centralized data governance, access control, and data lineage tracking.
  • Analyse, solve, and correct issues in real time, providing problem resolution end-to-end.
  • Develop unit tests to be able to test them automatically.
  • Use SOLID development principles to maintain data integrity and cohesiveness.
  • Interact with product owner and business representatives to determine and satisfy needs.
  • Sense of ownership and pride in your performance and its impact on company's success.
  • Critical thinker and problem-solving skills.
  • Team player.
  • Good time-management skills.
  • Great interpersonal and communication skills.

Mandatory Qualifications:

  • 4-7 years of experience as a Data Engineer.
  • Self-driven with minimal supervision.
  • Proven experience with T-SQL programming, Azure Databricks, Spark (PySpark/Scala), Delta Lake, Unity Catalog, ADLS Gen2
  • Microsoft TFS, Visual Studio, Devops exposure.
  • Experience with cloud platforms such as Azure or any.
  • Analytical, problem-solving mindset.

Preferred Qualifications:

  • HealthCare domain knowledge.

  • Cloud Data Pipeline Specialist

    8 hours ago

    Bhavnagar, Gujarat, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Cloud Data EngineerAs a Cloud Data Engineer, you will play a key role in developing and maintaining large-scale data pipelines on the cloud.Key Responsibilities:Design and develop complex data pipelines using Python, Data Flow, DataStream, CDC, Cloud Functions, Cloud Run, Pub Sub, BigQuery, and Cloud Storage.Utilize DevOps and CI/CD practices to ensure the...

  • Data Pipeline Architect

    1 week ago

    Bhavnagar, Gujarat, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 18,00,000

    Job Title: Data Engineering SpecialistWe are seeking an accomplished professional to lead the design, development, and maintenance of scalable data pipelines.About the Role:As a key member of our team, you will collaborate with cross-functional stakeholders to deliver high-quality data assets that support business-critical analytics and AI/ML...

  • Scalable Data Solutions Engineer

    8 hours ago

    Bhavnagar, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Cloud Data EngineerWe seek an experienced Cloud Data Engineer to lead the design and implementation of scalable data engineering solutions on Google Cloud Platform.The ideal candidate will possess 5-10 years of experience in GCP services and Big Data Analytics solutions, with a passion for working on advanced cloud-based projects.Design, build, and optimize...

  • Building Robust Data Solutions

    8 hours ago

    Bhavnagar, Gujarat, India beBeeDataEngineer Full time ₹ 1,53,747 - ₹ 2,48,326

    Job Title: Data EngineerAbout UsWe are a global leader in providing premium data services for the ever-evolving AI ecosystem.From machine learning to computer vision and Generative AI, we empower the next generation of AI-powered experiences with high-quality data and human intelligence to test, train, and improve AI models.We deliver solutions designed to...

  • Advanced Data Pipeline Specialist

    7 days ago

    Bhavnagar, Gujarat, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Job DescriptionA Data Engineer is needed to design, build, and maintain high-performance data pipelines that process large volumes of data. The successful candidate will work on optimizing existing systems, identifying performance bottlenecks, and implementing solutions that improve the overall efficiency of our platform.This role is critical in ensuring our...

  • Lead Data Pipeline Developer

    2 days ago

    Bhavnagar, Gujarat, India beBeeDataEngineer Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Job SummaryWe are seeking skilled professionals to work on integration, development, and support within a newly implemented platform.Main Responsibilities:Building and managing data pipelines (Azure Data Factory)Data modeling and delivering high-quality datasets for analytics across business areasAbout Our Team:We are passionate about delivering innovative...

  • Chief Data Pipeline Architect

    5 days ago

    Bhavnagar, Gujarat, India beBeeDataEngineering Full time ₹ 6,00,000 - ₹ 12,00,000

    Data Engineering ExpertWe are seeking a seasoned Data Engineering Expert to join our team. As a key member of our data engineering team, you will design, build, and maintain complex systems that store, process, and retrieve data.Develop real-time and close-to-real-time data integrations using Kafka, MS Event Hubs, etc.Create Business Intelligence Dashboards...

  • Data Architect

    1 week ago

    Bhavnagar, Gujarat, India beBeeDataArchitect Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data EngineerSikich India is seeking an experienced Data Architect to join our team in designing and building end-to-end data solutions using Microsoft's data platforms, including Fabric, Azure Synapse Analytics, Databricks, and Power BI.This role involves implementing contemporary data architecture patterns, creating robust data pipelines, and...

  • Data Professional

    5 days ago

    Bhavnagar, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Data Engineer">Role Overview:We are seeking a skilled and motivated data professional to design, develop, and maintain scalable data pipelines that process and transform large volumes of structured and unstructured data. The ideal candidate will have a strong background in data engineering, cloud technologies, and data architecture, and will...

  • Senior Data Architect

    7 days ago

    Bhavnagar, Gujarat, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Big Data ArchitectWe are seeking a skilled Big Data Architect to design, build, and optimize scalable data architectures using Snowflake, AWS, and DBT. The ideal candidate will enable seamless data integration, transformation, and analytics to support business intelligence and advanced analytics initiatives.Design, build, and maintain ETL/ELT pipelines using...