Expert in Real-Time Data Ingestion

2 weeks ago


Pune, Maharashtra, India beBeeDataIngestion Full time

Real-Time Data Ingestion Expert

">

We are looking for a highly skilled and adaptable professional to join our team as a Real-Time Data Ingestion Expert. This role involves designing, building, and maintaining scalable systems that stream high-quality, trusted data from Kafka to Snowflake via Snowpipe Streaming.

">

The ideal candidate will have a strong background in software engineering and data infrastructure, with experience working with distributed data systems, containerization, and observability tools.

">

This is a fantastic opportunity to work at the intersection of software engineering and data infrastructure, contributing to the evolution of our real-time data ingestion platform.

">

Key Responsibilities:

">
  • ">
  • Design and build data quality systems and pipelines ">
  • Work with tools such as Snowflake, Docker/Kubernetes, and Kafka to enable scalable, observable data movement ">
  • Collaborate cross-functionally to close skill gaps in DQ and data platform tooling ">
">

Requirements:

">

To be successful in this role, you will need:

">
  • ">
  • Solid programming experience (preferably in Java) ">
  • Experience with distributed data systems (Kafka, Snowflake) ">
  • Familiarity with Data Quality tooling and concepts ">
  • Good working knowledge of SQL (especially for diagnostics and DQ workflows) ">
  • Experience with containerization (Docker, Kubernetes) ">
">

Benefits:

">

We offer a competitive compensation package, including benefits and opportunities for growth and development.

">

What We Offer:

">

We are committed to providing a supportive and inclusive work environment that fosters collaboration, learning, and celebration.

">

Join Our Team:

">

  • Pune, Maharashtra, India beBeeSoftware Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    **Job Overview**We are seeking a highly skilled Staff Software Engineer to contribute to the development of our real-time data ingestion platform.This role involves designing, building, and maintaining scalable systems that stream high-quality, trusted data from Kafka to Snowflake via Snowpipe Streaming. The ideal candidate will have a strong understanding...


  • Pune, Maharashtra, India beBeeDataIngestion Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Overview:Azure Databricks Data Ingestion SpecialistWe are seeking a highly skilled Data Ingestion Specialist with expertise in CI/CD and Kubernetes to join our team. This role requires a strong understanding of data ingestion processes, focusing on integrating various data sources into Databricks.Design, develop, and optimize data ingestion pipelines for...

  • Expert Data Developer

    22 hours ago


    Pune, Maharashtra, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Unlock Your Potential as a Data ExpertJob DescriptionAs a Consultant Specialist ETL Engineer, you will develop and support new feeds ingestion, understand existing frameworks, and implement changes in Data Ingestion/Juniper within stipulated timelines.Develop and support new feeds ingestion/understand existing framework and do the development as per business...


  • Pune, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job SummaryThis is an exciting opportunity to work as a Real-Time Data Systems Architect.The ideal candidate will have extensive experience in designing and implementing scalable, real-time data processing systems using Apache Kafka.Responsibilities include building KAFKA clusters, ensuring high availability, and integrating with other data processing tools...


  • Pune, Maharashtra, India beBeeData Full time US$ 6,00,000 - US$ 12,00,000

    Job TitleWe are seeking a highly skilled Data Engineer to join our team. The ideal candidate will be responsible for designing and implementing scalable, real-time data processing systems.Key Responsibilities:

  • Senior Data Analyst

    5 days ago


    Pune, Maharashtra, India beBeeData Full time ₹ 23,71,000 - ₹ 30,55,000

    We are seeking a Data and Analytics Expert to join our team.Job Role:The successful candidate will be responsible for leveraging data insights to drive business growth and inform strategic decision-making.Develop and maintain scalable data pipelines to extract valuable insights from large datasetsIngest data from various sources, APIs, databases, files, etc....


  • Pune, Maharashtra, India beBeeData Full time ₹ 1,04,000 - ₹ 1,30,878

    Our organization is seeking a seasoned professional to spearhead the development and management of real-time data solutions for the banking sector.Job DescriptionThis role entails designing and implementing Confluent Kafka-based Change Data Capture (CDC) solutions to facilitate seamless data movement across core banking systems. The ideal candidate will...


  • Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,30,00,000

    Senior Data Engineer PositionWe are seeking a highly skilled Senior Data Engineer to join our team. As a critical member of our AI-powered applications, you will design and build scalable data pipelines that process clinical encounter data.You will work closely with software engineers, machine learning specialists, and our clinical partners to bring our...

  • Data Engineer

    4 weeks ago


    Pune, Maharashtra, India Maveric Systems Limited Full time

    Real-Time Data Engineer is responsible for designing and implementing scalable, real time data processing systems in Kafka.This role involves build of KAFKA cluster, ensuring high availability, and integrating with other data processing tools and platformsAs part of the CTO Data Ingestion Service, the incumbent will be required to:- Building scalable,...

  • Data Engineer

    2 weeks ago


    Pune, Maharashtra, India Maveric Systems Limited Full time

    Real-Time Data Engineer is responsible for designing and implementing scalable, real time data processing systems in Kafka. This role involves build of KAFKA cluster, ensuring high availability, and integrating with other data processing tools and platforms As part of the CTO Data Ingestion Service, the incumbent will be required to: Building scalable,...