Real-Time Data Ingestion Platform Developer

1 day ago

Pune, Maharashtra, India beBeeSoftware Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

**Job Overview**

We are seeking a highly skilled Staff Software Engineer to contribute to the development of our real-time data ingestion platform.

This role involves designing, building, and maintaining scalable systems that stream high-quality, trusted data from Kafka to Snowflake via Snowpipe Streaming. The ideal candidate will have a strong understanding of distributed data systems, experience with tools such as Snowflake, Docker, Kubernetes, and Kafka, and excellent problem-solving skills.

**Key Responsibilities:**

  • Design, build, and maintain data quality systems and pipelines
  • Work with cross-functional teams to close skill gaps in DQ and data platform tooling
  • Contribute to building internal tooling that supports schema validation, data experimentation, and automated checks
  • Owning the reliability, scalability, and performance of ingestion systems deployed on AWS
  • Architect and build core components of our real-time ingestion platform using Kafka, Snowpipe Streaming

**Required Skills & Qualifications:**

  • Solid programming experience, preferably in Java
  • Experience with distributed data systems, Kafka, Snowflake
  • Familiarity with Data Quality tooling and concepts
  • Good working knowledge of SQL, especially for diagnostics and DQ workflows
  • Experience with containerization, Docker, Kubernetes
  • Strong debugging, observability, and pipeline reliability practices

**Benefits:**

  • Opportunity to work on a cutting-edge real-time data ingestion platform
  • Collaborative and dynamic work environment
  • Professional growth and development opportunities

  • Expert in Real-Time Data Ingestion

    2 weeks ago

    Pune, Maharashtra, India beBeeDataIngestion Full time

    Real-Time Data Ingestion Expert ">We are looking for a highly skilled and adaptable professional to join our team as a Real-Time Data Ingestion Expert. This role involves designing, building, and maintaining scalable systems that stream high-quality, trusted data from Kafka to Snowflake via Snowpipe Streaming. ">The ideal candidate will have a strong...

  • Data Platform Developer

    6 days ago

    Pune, Maharashtra, India beBeeData Full time ₹ 1,21,90,000 - ₹ 2,13,70,000

    As a seasoned Solutions Architect, you will play a pivotal role in designing, building, and maintaining enterprise-grade data platforms. This position requires expertise in distributed systems, real-time data integration, metadata-driven design, and cloud-native development.You will collaborate with cross-functional teams to implement scalable, secure, and...

  • Azure Databricks Data Ingestion Expert

    4 days ago

    Pune, Maharashtra, India beBeeDataIngestion Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Overview:Azure Databricks Data Ingestion SpecialistWe are seeking a highly skilled Data Ingestion Specialist with expertise in CI/CD and Kubernetes to join our team. This role requires a strong understanding of data ingestion processes, focusing on integrating various data sources into Databricks.Design, develop, and optimize data ingestion pipelines for...

  • Data Platform Strategist

    2 hours ago

    Pune, Maharashtra, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title : Data Platform Strategist">Responsibilities :Data Strategy and Roadmap : Develop a long-term vision, roadmap, and key performance indicators for data platforms including ingestion, storage, archival, and export services.Maintain a clear articulation of how platform capabilities serve internal products and enable scale, performance, or cost...

  • Real-Time Data Systems Architect

    2 days ago

    Pune, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job SummaryThis is an exciting opportunity to work as a Real-Time Data Systems Architect.The ideal candidate will have extensive experience in designing and implementing scalable, real-time data processing systems using Apache Kafka.Responsibilities include building KAFKA clusters, ensuring high availability, and integrating with other data processing tools...

  • Data Engineer

    4 weeks ago

    Pune, Maharashtra, India Maveric Systems Limited Full time

    Real-Time Data Engineer is responsible for designing and implementing scalable, real time data processing systems in Kafka.This role involves build of KAFKA cluster, ensuring high availability, and integrating with other data processing tools and platformsAs part of the CTO Data Ingestion Service, the incumbent will be required to:- Building scalable,...

  • Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Maveric Systems Limited Full time

    Real-Time Data Engineer is responsible for designing and implementing scalable, real time data processing systems in Kafka. This role involves build of KAFKA cluster, ensuring high availability, and integrating with other data processing tools and platforms As part of the CTO Data Ingestion Service, the incumbent will be required to: Building scalable,...

  • Data Engineer

    3 days ago

    Pune, Maharashtra, India Maveric Systems Limited Full time

    Real-Time Data Engineer is responsible for designing and implementing scalable, real time data processing systems in Kafka. This role involves build of KAFKA cluster, ensuring high availability, and integrating with other data processing tools and platformsAs part of the CTO Data Ingestion Service, the incumbent will be required to:Building scalable,...

  • Data Platform Specialist

    2 days ago

    Pune, Maharashtra, India beBeeData Full time US$ 1,04,000 - US$ 1,30,878

    Job TitleTechnical Product Manager - Platform Engineering (Data Platform Focus)Location: Pune, India | Type: Full TimeJob DescriptionAs a Technical Product Manager (TPM) in the Platform Engineering team, you will be responsible for defining, delivering, and scaling the internal data platform capabilities that power our product and analytics...

  • 2747 - Senior Engineer - Data Platform

    4 weeks ago

    Pune, Maharashtra, India EXL Full time

    Position Overview:We are looking for a Senior Engineer with 10-15 years of experience to help design, build, and maintain enterprise-grade data and AI platforms. This role requires strong technical expertise in distributed systems, real-time data integration, metadata-driven design, and cloud-native development. The Senior Engineer will work closely with...