Kafka Administrator

3 days ago

Pune, Maharashtra, India Programming Full time US$ 1,50,000 - US$ 2,00,000 per year

Hiring: Kafka Administrator

Location: Pune – Immediate Joiners Only

10+ years overall, with 5+ years in Kafka-based data streaming development.

Apply at:

Job Title:

SSE - Kafka Developer

Location:

Pune, India (with Travel to Onsite)

Experience Required:

10+ years overall, with 5+ years in Kafka-based data streaming development.

Must have delivered production-grade Kafka pipelines integrated with real-time data sources

and downstream analytics platforms.

Overview:

We are looking for a Kafka Developer to design and implement real-time data ingestion

pipelines using Apache Kafka. The role involves integrating with upstream flow record sources,

transforming and validating data, and streaming it into a centralized data lake for analytics and

operational intelligence.

Key Responsibilities:


• Develop Kafka producers to ingest flow records from upstream systems such as flow record

exporters (e.g., IPFIX-compatible probes).


• Build Kafka consumers to stream data into Spark Structured Streaming jobs and downstream

data lakes.


• Define and manage Kafka topic schemas using Avro and Schema Registry for schema evolution.


• Implement message serialization, transformation, enrichment, and validation logic within the

streaming pipeline.


• Ensure exactly once processing, checkpointing, and fault tolerance in streaming jobs.


• Integrate with downstream systems such as HDFS or Parquet-based data lakes, ensuring

compatibility with ingestion standards.


• Collaborate with Kafka administrators to align topic configurations, retention policies, and security

protocols.


• Participate in code reviews, unit testing, and performance tuning to ensure high-quality

deliverables.


• Document pipeline architecture, data flow logic, and operational procedures for handover and

support.

Required Skills & Qualifications:


• Proven experience in developing Kafka producers and consumers for real-time data

ingestion pipelines.


• Strong hands-on expertise in Apache Kafka, Kafka Connect, Kafka Streams, and

Schema Registry.


• Proficiency in Apache Spark (Structured Streaming) for real-time data transformation

and enrichment.


• Solid understanding of IPFIX, NetFlow, and network flow data formats; experience

integrating with nProbe Cento is a plus.


• Experience with Avro, JSON, or Protobuf for message serialization and schema

evolution.


• Familiarity with Cloudera Data Platform components such as HDFS, Hive, YARN, and

Knox.


• Experience integrating Kafka pipelines with data lakes or warehouses using Parquet or

Delta formats.


• Strong programming skills in Scala, Java, or Python for stream processing and data

engineering tasks.


• Knowledge of Kafka security protocols including TLS/SSL, Kerberos, and access control

via Apache Ranger.


• Experience with monitoring and logging tools such as Prometheus, Grafana, and Splunk.


• Understanding of CI/CD pipelines, Git-based workflows, and containerization

(Docker/Kubernetes)

  • Kafka Cluster Specialist

    2 hours ago

    Pune, Maharashtra, India beBeeKafkaCluster Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Kafka Cluster SpecialistMain Responsibilities:Implement, configure, upgrade, and maintain large-scale Apache Kafka clusters to ensure high availability and reliability.Monitor Kafka cluster health, performance, and capacity planning to optimize data streaming and real-time analytics.Manage topics, partitions, brokers, consumer groups, and access...

  • Deputy Manager with Expertise in Kafka Administration

    3 days ago

    Pune, Maharashtra, India beBeeExcellence Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title:About VOISWe are seeking a skilled Deputy Manager to join our team in Pune. The ideal candidate will have experience in Kafka administration, operational support, and AWS DevOps.Core Competencies:Kafka administrationOperational supportAWS DevOpsJob Description:About VOIS IndiaWe started operating in India in 2009 and have established global...

  • Expert Kafka Cluster Administrator

    6 days ago

    Pune, Maharashtra, India beBeeKafka Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job TitleAs a Kafka Infrastructure Specialist, you will be responsible for deploying and managing production-grade Kafka clusters, ensuring high availability and fault tolerance.Key responsibilities include:Cluster Deployment: Deploy and upgrade production-grade Kafka clusters using tools such as Ansible and Chef.Automated Configuration: Automate the...

  • Lead Consultant Java, Kafka, AWS

    4 days ago

    Pune, Maharashtra, India Genpact Full time

    Job DescriptionReady to build the future with AIAt Genpact, we don&rsquot just keep up with technology&mdashwe set the pace. AI and digital innovation are redefining industries, and we&rsquore leading the charge. Genpact&rsquos AI Gigafactory, our industry-first accelerator, is an example of how we&rsquore scaling advanced technology solutions to help global...

  • Senior Principal Consultant – Java, Kafka, AWS

    4 days ago

    Pune, Maharashtra, India Genpact Full time

    Job DescriptionReady to build the future with AIAt Genpact, we don&rsquot just keep up with technology&mdashwe set the pace. AI and digital innovation are redefining industries, and we&rsquore leading the charge. Genpact&rsquos AI Gigafactory, our industry-first accelerator, is an example of how we&rsquore scaling advanced technology solutions to help global...

  • Deputy Manager Kafka Admin Pune

    4 days ago

    Pune, Maharashtra, India Vodafone Full time

    About VOIS VOIS Vodafone Intelligent Solutions is a strategic arm of Vodafone Group Plc creating value and enhancing quality and efficiency across 28 countries and operating from 7 locations Albania Egypt Hungary India Romania Spain and the UK Over 29 000 highly skilled individuals are dedicated to being Vodafone Group s partner of choice for...

  • Snowflake Administrator

    3 days ago

    Pune, Maharashtra, India SSterling Workforce Enterprises Private Limited Full time ₹ 10,00,000 - ₹ 20,00,000 per year

    Key Responsibilities* Administration & Maintenance: Perform routine administration tasks, including user and role management, account provisioning, and access control (RBAC).* Performance & Optimization: Monitor and tune the performance of Snowflake environments, including query optimization, warehouse sizing, and auto-suspend/resume configurations to ensure...

  • Netcool System Administrator

    1 week ago

    Pune, Maharashtra, India beBeeSystemAdministrator Full time ₹ 15,00,000 - ₹ 20,00,000

    **Netcool System Administrator Role Overview:**The ideal candidate for this position will possess a strong understanding of Netcool system administration and have experience with various web applications.This individual will be responsible for ensuring the reliability, availability, and performance of IBM Tivoli Netcool suite of products and associated web...

  • Distributed Systems Administrator

    1 week ago

    Pune, Maharashtra, India beBeeCloud Full time ₹ 1,50,00,000 - ₹ 2,20,00,000

    We are a strategic arm of Vodafone Group Plc, enhancing quality and efficiency across multiple countries.As a Centre of Excellence for Intelligent Solutions, we work together to deliver the best services across IT, Business Intelligence Services, Customer Operations, Business Operations, HR, Finance, Supply Chain, HR Operations, and more.In India, VOIS has...

  • Cloud & Infrastructure Management Specialist

    1 day ago

    Pune, Maharashtra, India beBeeInfrastructure Full time ₹ 10,00,000 - ₹ 20,00,000

    Job Title: Cloud & Infrastructure Management Specialist">Data Platform Engineer responsible for designing, implementing, and managing cloud-based data platforms.Expertise in Apache NiFi Administration including building clusters, upgrading cluster versions, and troubleshooting on Linux.Strong knowledge of Kafka administration and configuration management...