Building Scalable Data Pipelines

2 days ago


Kozhikode, Kerala, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 15,00,000

Job Title: Azure Data Engineer

We are seeking a self-driven professional to build and optimize scalable ETL/ELT pipelines using Azure Databricks, PySpark, and Delta Lake.

The role involves collaborating with cross-functional teams to develop data solutions, ensuring data governance through Unity Catalog, and supporting real-time and batch processing.

Main Responsibilities:

  • Work closely with multiple teams to deliver high-quality database programming requirements.
  • Create and deploy scalable ETL/ELT pipelines using Azure Databricks by leveraging PySpark and SQL.
  • Develop Delta Lake tables with ACID transactions and schema evolution to support real-time and batch processing.
  • Experience in Unity Catalog for centralized data governance, access control, and data lineage tracking.

Mandatory Qualifications:

  • 4-7 years of experience as a Data Engineer.
  • Self-motivated with minimal supervision.
  • Proven experience with T-SQL programming, Azure Databricks, Spark (PySpark/Scala), Delta Lake, Unity Catalog, ADLS Gen2.

Preferred Qualifications:

  • HealthCare domain knowledge.

Key Skills:

  • T-SQL programming
  • Azure Databricks
  • Spark (PySpark/Scala)
  • Delta Lake
  • Unity Catalog
  • ADLS Gen2

About Us:

We are driving the transformation of the insurance industry by developing innovative benefits management solutions.

We focus on modernizing complex back-office systems to create scalable, secure, and high-performing platforms that streamline operations for our clients.



  • Kozhikode, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Big Data SpecialistOur organization is seeking a skilled professional to design, develop, and maintain robust data pipelines that handle high-volume financial data.Key Responsibilities:Design and manage end-to-end data pipelines for stocks, crypto, and other financial datasets.Integrate third-party APIs and data feeds into internal systems.Develop and...


  • Kozhikode, Kerala, India beBeeBackendEngineer Full time ₹ 1,20,00,000 - ₹ 2,40,00,000

    Backend Engineers at Lorien Finance design and build scalable systems to support global education initiatives.The role involves developing high-impact projects, collaborating with cross-functional teams, and contributing to the development of cutting-edge platforms.Key Responsibilities:Create efficient and maintainable backend systems using Golang, Python,...


  • Kozhikode, Kerala, India beBeeDataEngineering Full time ₹ 90,00,000 - ₹ 1,22,50,000

    Role Overview:">Job DescriptionWe are seeking an experienced Data Engineer to design and implement scalable data pipelines utilizing expertise in Palantir Foundry.Responsibilities will include developing efficient data processing solutions using PySpark and building robust data engineering tools with Typescript.The ideal candidate will have a minimum of 5-8...


  • Kozhikode, Kerala, India beBeeetldeveloper Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: ETL Developer - DataStage, AWS, SnowflakeOverview of the PositionWe are seeking a skilled and motivated ETL developer to join our team. You will work on designing, developing, and maintaining scalable and efficient data pipelines using IBM DataStage (on Cloud Pak for Data), AWS Glue, and Snowflake.Responsibilities


  • Kozhikode, Kerala, India beBeeCloud Full time ₹ 10,00,000 - ₹ 15,00,000

    Senior AWS Glue DeveloperAs a senior developer, you will be responsible for designing and implementing data ingestion and transformation pipelines using serverless and cloud-based services.The ideal candidate will have experience with the Extract-Load-Transform approach, metadata-driven integration design, and Data Build Tool to enable rapid onboarding of...


  • Kozhikode, Kerala, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    About Data Engineering OpportunitiesWe are a global technology services firm with a strong presence across the globe.About the Role:We are seeking skilled professionals to design, build, and optimize scalable data solutions on Google Cloud Platform (GCP).Key Responsibilities:Work with AtScale and GCP services (BigQuery, etc.) to create and manage scalable...


  • Kozhikode, Kerala, India beBeeBackend Full time ₹ 20,00,000 - ₹ 25,00,000

    Key Role in Backend Infrastructure Development">We are seeking an experienced engineer to play a key role in the development and maintenance of our backend infrastructure. The ideal candidate will have a strong background in Java and Kotlin, as well as experience with scalable and efficient system design.">Main Responsibilities:Design and Deploy Scalable...


  • Kozhikode, Kerala, India beBeeData Full time ₹ 25,00,000 - ₹ 30,00,000

    Data Solutions Architect for Oil & Gas IndustryWe are seeking a senior-level Data Solutions Architect with expertise in designing, building, and optimizing scalable data pipelines and cloud solutions for the Oil & Gas industry. The ideal candidate will have a strong background in AWS cloud services, data engineering, and knowledge of Oil & Gas upstream,...


  • Kozhikode, Kerala, India beBeeBackendSoftwareEngineer Full time ₹ 2,16,00,000 - ₹ 2,88,00,000

    Backend Software EngineerWe are seeking a skilled Backend Software Engineer to join our R&D team.The ideal candidate will have a strong understanding of SQL or NoSQL databases, leveraging data modeling solutions for scalability and performance.Key responsibilities include planning, designing, and developing new features and capabilities for our microservices...


  • Kozhikode, Kerala, India beBeeDataEngineer Full time ₹ 40,00,000 - ₹ 50,00,000

    We are seeking a senior professional with deep expertise in building scalable and event-driven data pipelines. This individual will report to the head of AI and engineering and be responsible for designing, building, and operating the backbone of our AI-powered applications. The role requires creating pipelines that process clinical encounter data,...