Data Ingestion Expert

2 days ago

Belgaum, Karnataka, India beBeeIngestion Full time ₹ 15,00,000 - ₹ 25,00,000
Job Title: Azure Databricks Engineer

We are seeking an Ingestion Specialist to spearhead our data ingestion initiatives.

This role requires a deep understanding of data ingestion processes, focusing on integrating diverse data sources into Databricks.

The ideal candidate will have hands-on experience with data pipelines, automation, and infrastructure management to support scalable and efficient ingestion workflows.

The successful specialist will design, develop, and optimize data ingestion pipelines for integrating multiple sources into Databricks.

Key Responsibilities:

  • Design, develop, and optimize data ingestion pipelines for integrating multiple sources into Databricks.
  • Implement and maintain continuous integration/continuous deployment (CI/CD) pipelines for data workflows.
  • Deploy and manage containerized applications using Kubernetes.
  • Ensure data integrity, security, and compliance throughout the ingestion process.
  • Collaborate with Data Engineers and other stakeholders to streamline data ingestion strategies.
  • Troubleshoot and optimize ingestion pipelines for performance and scalability.

Required Skills & Qualifications:

  • Proven experience in data ingestion and pipeline development.
  • Hands-on experience with CI/CD tools (GitHub Actions, Jenkins, Azure DevOps, etc.).
  • Strong knowledge of Kubernetes and container orchestration.
  • Experience with Databricks, Spark, and data lake architectures.
  • Proficiency in Python, Scala, or SQL for data processing.
  • Familiarity with cloud platforms such as AWS, Azure, or GCP.
  • Strong problem-solving and analytical skills.

Preferred Qualifications:

  • Experience with Infrastructure as Code (Terraform, Helm, etc.).
  • Background in streaming data ingestion (Kafka, Kinesis, etc.).
  • Knowledge of data governance and security best practices.

  • Chief Data Architect

    1 week ago

    Belgaum, Karnataka, India beBeeDataModeling Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Data ModelerKey Responsibilities:Collaborate with cross-functional teams to design and optimize data models.Translate business requirements into actionable data strategies.Work closely with data ingestion teams to understand data availability and format.Ensure consistency in data coding and naming conventions.Develop physical data models and implement...

  • Cloud Data Engineer and Platform Specialist

    3 days ago

    Belgaum, Karnataka, India beBeeData Full time US$ 1,50,000 - US$ 1,80,000

    Job Role OverviewWe are seeking a seasoned Infrastructure and Data Engineering Expert to lead full lifecycle implementations, including secure platform setup, cloud integration, and high-performance data pipeline development.This role is ideal for those who thrive at the intersection of data engineering, infrastructure, and DevOps, and want to be part of...

  • Data Expert

    2 days ago

    Belgaum, Karnataka, India beBeeMachineLearning Full time ₹ 20,00,000 - ₹ 25,00,000

    About this role:We are seeking a seasoned expert to design, build, and deploy AI-driven solutions using the Azure ecosystem.Key responsibilities include developing end-to-end ML pipelines for data prep, training, validation, and deployment, as well as applying LLMs & GenAI for NLP, predictive modeling, and analytics.Additionally, the ideal candidate will be...

  • Chief Data Pipeline Architect

    1 day ago

    Belgaum, Karnataka, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 25,00,000

    Job OverviewAs a data engineer, you will be responsible for designing and building scalable data pipelines to ingest, process, and store data.The ideal candidate will have expertise in data integration, processing, and storage, as well as knowledge of data optimization architecture, data processes, and data flow.You will work closely with cross-functional...

  • Senior Data Expert

    6 hours ago

    Belgaum, Karnataka, India beBeeData Full time ₹ 10,00,000 - ₹ 15,00,000

    Job Overview:As a seasoned data expert, you will be responsible for analyzing complex datasets to drive informed business decisions. This role requires a high degree of analytical skill and proficiency in data analytics tools and techniques.Key Responsibilities:Analyze large datasets to identify trends and patternsDevelop predictive models to support...

  • Data Engineering Specialist

    2 days ago

    Belgaum, Karnataka, India beBeeDataEngineer Full time ₹ 40,00,000 - ₹ 60,00,000

    Data Engineering ExpertOur organization is seeking a skilled Data Engineer to join our team and support data-driven initiatives. As a key member of the team, you will play a vital role in building scalable pipelines, working with streaming data, and collaborating with data scientists and business stakeholders to deliver high-quality solutions.The role...

  • Data Solutions Expert

    4 hours ago

    Belgaum, Karnataka, India beBeeData Full time ₹ 12,00,000 - ₹ 15,00,000

    Job Title: Data Analyst TrainerWe are seeking a highly skilled and experienced Data Analyst Trainer to join our team.Job Description:The successful candidate will be responsible for delivering high-quality training sessions on data analysis topics, leveraging their expertise in statistical analysis, data visualization, and database management systems.Data...

  • Data Integration Expert

    1 day ago

    Belgaum, Karnataka, India beBeeInformaticaDeveloper Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job InformationThis position requires an expert in data integration and ETL frameworks to design, develop, and implement Informatica solutions.An ideal candidate will have hands-on experience with Informatica PowerCenter, Informatica IDMC (IICS), and Oracle Fusion Cloud data sources.Required SkillsWe are seeking a highly skilled individual who possesses the...

  • Senior Data Expert

    5 hours ago

    Belgaum, Karnataka, India beBeeDataScientist Full time ₹ 10,00,000 - ₹ 15,00,000

    Key Role: Data ScientistWe are seeking a skilled and versatile data expert with expertise in advanced analytics, machine learning, and data-driven solutions to contribute to our organization.Main Responsibilities:Data Analysis and Modeling: Design and develop predictive models using Python and AWS SageMaker to drive business decisions and recommend optimal...

  • Chief Data Architect

    5 hours ago

    Belgaum, Karnataka, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Key Data Engineer RoleWe seek a highly skilled Data Professional to design, develop, and optimize scalable data systems.This role requires collaboration with cross-functional teams to deliver robust, secure, and high-performance data solutions that empower analytics and data science initiatives.Design, develop, and maintain scalable data pipelines using...