Data Ingestion Specialist

3 days ago

Cochin, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000
Job Title

We are seeking a highly skilled Data Pipeline Engineer to join our team.

This role requires expertise in designing, developing, and optimizing data ingestion pipelines for integrating multiple sources into Databricks.

The ideal candidate will have hands-on experience with data pipelines, automation, and infrastructure management to support scalable and efficient ingestion workflows.

Key Responsibilities:

  • Design and develop data ingestion pipelines for integrating multiple sources into Databricks.
  • Implement and maintain CI/CD pipelines for data workflows.
  • Deploy and manage containerized applications using Kubernetes.
  • Ensure data integrity, security, and compliance throughout the ingestion process.
  • Collaborate with Data Engineers and other stakeholders to streamline data ingestion strategies.
  • Troubleshoot and optimize ingestion pipelines for performance and scalability.

Required Skills & Qualifications:

  • Proven experience in data ingestion and pipeline development.
  • Hands-on experience with CI/CD tools (GitHub Actions, Jenkins, Azure DevOps, etc.).
  • Strong knowledge of Kubernetes and container orchestration.
  • Experience with Databricks, Spark, and data lake architectures.
  • Proficiency in Python, Scala, or SQL for data processing.
  • Familiarity with cloud platforms such as AWS, Azure, or GCP.
  • Strong problem-solving and analytical skills.
  • Preferred Qualifications:
  • Experience with Infrastructure as Code (Terraform, Helm, etc.).
  • Background in streaming data ingestion (Kafka, Kinesis, etc.).
  • Knowledge of data governance and security best practices.

  • Senior Data Pipeline Specialist

    1 day ago

    Cochin, Kerala, India beBeeIngestion Full time ₹ 15,00,000 - ₹ 25,00,000

    Job SummaryWe are seeking an experienced Data Ingestion Engineer with a strong background in data pipelines, automation, and infrastructure management to support scalable and efficient ingestion workflows.This role requires designing, developing, and optimizing data ingestion pipelines for integrating multiple sources into Databricks, implementing and...

  • Cloud Infrastructure Specialist

    5 hours ago

    Cochin, Kerala, India beBeeCloud Full time ₹ 1,80,00,000 - ₹ 2,10,00,000

    Job OverviewWe are seeking a skilled Cloud Infrastructure Specialist to lead our transition from an on-premises infrastructure to a scalable, secure, and cost-effective cloud environment.Key Responsibilities:Design end-to-end cloud-native architecture for a multi-tenant SaaS platform.Define tenant isolation strategies (shared vs. dedicated databases,...

  • Chief Data Architect

    3 hours ago

    Cochin, Kerala, India beBeeDataGovernance Full time ₹ 15,00,000 - ₹ 20,00,000

    Role Summary:We are seeking a highly skilled Data Governance professional to join our team. This is an exciting opportunity for individuals with expertise in designing, building and maintaining data systems to ensure the highest standards of data quality and performance.The ideal candidate will have a strong background in data engineering, architecture,...

  • Cloud Data Engineer

    3 hours ago

    Cochin, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Data Engineer - Cloud Infrastructure SpecialistWe are seeking a skilled Data Engineer to design, build, and maintain automated data pipelines in Azure Databricks, supporting governance and analytics initiatives.Key Responsibilities:Design and deploy robust ETL/ELT pipelines using PySpark, SQL, and Delta Lake for ingesting, transforming, and...

  • Chief Data Architect

    5 days ago

    Cochin, Kerala, India beBeeData Full time ₹ 1,75,00,000 - ₹ 2,25,00,000

    Senior Data EngineerWe are seeking a seasoned Senior Data Engineer to play a pivotal role in designing, developing, and optimizing data ingestion, transformation, and governance frameworks. The ideal candidate will have deep expertise in building scalable data pipelines, implementing enterprise-grade data governance, security, and AI-powered engineering...

  • Leading Edge Big Data Professional

    3 days ago

    Cochin, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Experienced Data Engineer">We are seeking a skilled data engineer to design, develop, and maintain scalable data pipelines using Spark (PySpark or Scala).">This role involves building data ingestion and transformation frameworks for structured and unstructured data sources.">Design and develop scalable data pipelines using Spark (PySpark or Scala).Build data...

  • Data Insights Specialist

    20 hours ago

    Cochin, Kerala, India beBeeData Full time ₹ 60,00,000 - ₹ 1,00,00,000

    Job Title:Business Intelligence Analyst - Data Insights Specialist

  • Data Insights Specialist

    1 day ago

    Cochin, Kerala, India beBeeData Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Title: Data Insights Specialist About the Role: We are seeking a highly skilled Data Insights Specialist to join our team. The ideal candidate will have a strong background in data analysis and interpretation, as well as excellent communication skills. This is an exciting opportunity for someone who enjoys working with data, analyzing complex...

  • Data Engineer for Large-Scale Data Platforms

    2 days ago

    Cochin, Kerala, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    About the RoleAs a senior data engineer, you will be responsible for designing and implementing large-scale data platforms on Google Cloud.This is a critical role that involves working closely with cross-functional teams to deliver high-quality solutions.Key Responsibilities:Data Pipeline Design: Design robust data pipelines for ingestion, transformation,...

  • Senior Data Engineer

    2 days ago

    Cochin, Kerala, India Milestone Technologies, Inc. Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Role Overview:Seeking an experienced Senior Data Engineer to lead data ingestion, transformation, and optimization initiatives using the modern Apache and Azure data stack. The role involves working on scalable pipelines, large-scale distributed systems, and data lake management.Core Responsibilities:Build and manage high-volume data pipelines using...