Senior Data Pipeline Specialist

3 days ago


Cochin, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

Job Role Summary:

We are seeking an accomplished Data Pipeline Developer to join our team and spearhead the creation of efficient data ingestion pipelines for integrating multiple sources into Databricks. This pivotal role requires expertise in designing, developing, and optimizing data ingestion processes that prioritize scalability and efficiency.

Key Responsibilities:

  • Design and develop robust data ingestion pipelines for integrating multiple sources into Databricks.
  • Implement and maintain Continuous Integration/Continuous Deployment (CI/CD) pipelines for data workflows.
  • Deploy and manage containerized applications using Kubernetes.
  • Evaluate data integrity, security, and compliance throughout the ingestion process.
  • Collaborate with Data Engineers to refine data ingestion strategies.
  • Troubleshoot and optimize ingestion pipelines for performance and scalability.

Required Skills & Qualifications:

  • Proven experience in data ingestion and pipeline development.
  • Familiarity with CI/CD tools such as GitHub Actions, Jenkins, Azure DevOps, etc.
  • In-depth knowledge of Kubernetes and container orchestration.
  • Proficiency in Python, Scala, or SQL for data processing.
  • Familiarity with cloud platforms such as AWS, Azure, or GCP.


  • Cochin, Kerala, India beBeeIngestion Full time ₹ 15,00,000 - ₹ 25,00,000

    Job SummaryWe are seeking an experienced Data Ingestion Engineer with a strong background in data pipelines, automation, and infrastructure management to support scalable and efficient ingestion workflows.This role requires designing, developing, and optimizing data ingestion pipelines for integrating multiple sources into Databricks, implementing and...


  • Cochin, Kerala, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 20,00,000

    Job Summary:We are seeking an experienced Python data engineer to join our organization. As a key member of our data initiatives, you will be responsible for designing and maintaining scalable, reliable data pipelines using Python and orchestration tools.Main Responsibilities:Create robust and scalable data pipelines using Python.Utilize orchestration and...


  • Cochin, Kerala, India beBeeTechnical Full time ₹ 15,00,000 - ₹ 20,00,000

    Job OverviewWe are seeking a skilled Technical Specialist to assume the role of designing, implementing, and managing data pipelines using Azure Data Factory. The ideal candidate will have 5-7 years of experience in data warehousing and Azure Synapse Analytics.This is a critical position that involves collaborating closely with clients to understand their...

  • Data Pipeline Lead

    4 days ago


    Cochin, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Lead Data ArchitectOur team is seeking an accomplished data architect to lead the design and implementation of large-scale data pipelines. As a senior member, you will play a pivotal role in shaping our company's data strategy.Key Responsibilities:Design and implement ETL pipelines using FiveTran, DBT Cloud, and custom frameworksDevelop client-specific data...


  • Cochin, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Data Engineer Job Summary">At the heart of our business, we need a skilled Data Engineer to build and manage the intricate networks that drive our analytics. With 3+ years of experience in a Data Engineering role, you'll be responsible for creating scalable data pipelines that deliver real-time insights across our global operations.This isn't just about ETL;...


  • Cochin, Kerala, India beBeeDataEngineering Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Unlock a New Era in Data Engineering with Our TeamWe're seeking a highly skilled Senior Data Engineer to lead the development of our data pipeline architecture, collaborating closely with data scientists and analysts to drive innovative solutions.This pivotal role will be responsible for designing, building, and maintaining scalable data pipelines,...


  • Cochin, Kerala, India DBiz Full time

    Position : Senior Data EngineerWe are seeking an experienced Senior Data Engineer to design and implement high-performance data pipelines, ensuring the smooth flow of large datasets across systems.In this role, you will leverage your expertise in Databricks, Pyspark, and ETL design to build efficient data solutions.You will also contribute to optimizing...


  • Cochin, Kerala, India beBeeDataScientist Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Talend ETL Developer Opportunity">Appit Software Inc, a forward-thinking organization, is seeking an accomplished professional to fill the role of Talend ETL Developer with expertise in cloud data pipelines. The ideal candidate will have 8-10 years of experience and possess excellent communication skills.**Key Responsibilities:**- Design and optimize complex...


  • Cochin, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 22,50,000

    Job Title: Senior Data Integration SpecialistThe ideal candidate will have a strong background in developing, documenting, testing, and maintaining complex data pipelines using Informatica IDMC.We are seeking a highly skilled and experienced Informatica IDMC ETL Developer (Lead-Level) with expertise in leading large projects and mentoring junior...


  • Cochin, Kerala, India beBeeDataProcessing Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job OverviewWe are seeking a seasoned Data Processing Engineer to join our data engineering team. The ideal candidate will have strong expertise in Scala, Spark, and Python for building and optimizing large-scale data pipelines.Key ResponsibilitiesDesign, develop, and optimize distributed data processing systems.Work extensively with Scala, Spark (PySpark),...