Leading the Deployment and Operational Management of High-Performance Apache Kafka Clusters

4 days ago

Pune, Maharashtra, India beBeeKafka Full time ₹ 9,00,000 - ₹ 12,00,000
Job Title: Kafka Infrastructure Lead

We are seeking an experienced professional to lead the deployment, configuration, and operational management of Apache Kafka clusters supporting real-time data ingestion pipelines.

  • The role involves ensuring secure, scalable, and highly available Kafka infrastructure for streaming flow records into centralized data platforms.

Key Responsibilities:

  • Architect and deploy Apache Kafka clusters with high availability.
  • Implement Kafka MirrorMaker for cross-site replication and disaster recovery readiness.
  • Integrate Kafka with upstream flow record sources using IPFIX-compatible plugins.
  • Configure Kafka topics, partitions, replication, and retention policies based on data flow requirements.
  • Set up TLS/SSL encryption, Kerberos authentication, and access control using Apache Ranger.
  • Monitor Kafka performance using Prometheus, Grafana, or Cloudera Manager and ensure proactive alerting.
  • Perform capacity planning, cluster upgrades, patching, and performance tuning.
  • Ensure audit logging, compliance with enterprise security standards, and integration with SIEM tools.
  • Collaborate with solution architects and Kafka developers to align infrastructure with data pipeline needs.
  • Maintain operational documentation, SOPs, and support SIT/UAT and production rollout activities.

Required Skills & Qualifications:

  • Proven experience in Apache Kafka, Kafka Connect, Kafka Streams, and Schema Registry.
  • Strong understanding of IPFIX, nProbe Cento, and network flow data ingestion.
  • Hands-on experience with Apache Spark (Structured Streaming) and modern data lake or DWH platforms.
  • Familiarity with Cloudera Data Platform, HDFS, YARN, Ranger, and Knox.
  • Deep knowledge of data security protocols, encryption, and governance frameworks.
  • Excellent communication, documentation, and stakeholder management skills.

Benefits:

  • Opportunity to work with a cutting-edge technology stack.
  • Chance to collaborate with a talented team of professionals.
  • Professional growth and development opportunities.

  • Apache Kafka Clusters Professional

    3 days ago

    Pune, Maharashtra, India Sarvaha Systems Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    We are looking for a skilled professional with experience in leading the deployment and operational management of high-performance Apache Kafka clusters. The ideal candidate will have a strong background in IT Services & Consulting, with expertise in managing large-scale data processing systems.Roles and ResponsibilityDesign, deploy, and manage...

  • Kafka Cluster Specialist

    6 hours ago

    Pune, Maharashtra, India beBeeKafkaCluster Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Kafka Cluster SpecialistMain Responsibilities:Implement, configure, upgrade, and maintain large-scale Apache Kafka clusters to ensure high availability and reliability.Monitor Kafka cluster health, performance, and capacity planning to optimize data streaming and real-time analytics.Manage topics, partitions, brokers, consumer groups, and access...

  • Expert Kafka Cluster Administrator

    6 days ago

    Pune, Maharashtra, India beBeeKafka Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job TitleAs a Kafka Infrastructure Specialist, you will be responsible for deploying and managing production-grade Kafka clusters, ensuring high availability and fault tolerance.Key responsibilities include:Cluster Deployment: Deploy and upgrade production-grade Kafka clusters using tools such as Ansible and Chef.Automated Configuration: Automate the...

  • Deputy Manager Lead Kafka Admin Pune

    3 days ago

    Pune, Maharashtra, India Vodafone Full time

    About VOIS VOIS Vodafone Intelligent Solutions is a strategic arm of Vodafone Group Plc creating value and enhancing quality and efficiency across 28 countries and operating from 7 locations Albania Egypt Hungary India Romania Spain and the UK Over 29 000 highly skilled individuals are dedicated to being Vodafone Group s partner of choice for...

  • Kafka Developer

    3 days ago

    Pune, Maharashtra, India airisDATA Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Position:Kafka DeveloperExperience: 5+ YearsLocations:    Pune, India ( Onsite )Job Description:Seeking a highly skilled Kafka Developer with deep expertise in Kafka transformationsand hands-on experience working with MS SQL / PostgreSQLdatabases especially in environments with non-standard schemas(e.g., tables without primary keys, with/without...

  • Kafka Developer

    3 days ago

    Pune, Maharashtra, India Innovative Information Technologies, Inc. Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Role : Kafka DeveloperExperiences : 5+ YearsLocation : PuneType : ContractMode : Full timeJob Description :Role OverviewSeeking a highly skilled Kafka Developer with deep expertise in Kafka transformations and hands-on experience working with MS SQL / PostgreSQL databases especially in environments with non-standard schemas (e.g., tables without...

  • Kafka Administrator

    3 days ago

    Pune, Maharashtra, India Programming Full time US$ 1,50,000 - US$ 2,00,000 per year

    Hiring: Kafka Administrator Location: Pune – Immediate Joiners Only10+ years overall, with 5+ years in Kafka-based data streaming development. Apply at: Job Title:SSE - Kafka DeveloperLocation:Pune, India (with Travel to Onsite)Experience Required:10+ years overall, with 5+ years in Kafka-based data streaming development.Must have delivered...

  • Kafka & Debezium Engineer

    3 days ago

    Pune, Maharashtra, India Sanglob Business Services Private Limited Full time ₹ 15,00,000 per year

    Job Title: Kafka & Debezium EngineerLocation: Pune (Onsite/Hybrid)Experience Required: 3–5 yearsJoining: Immediate Joiners PreferredKey Responsibilities:Design, build, and manage Kafka-based data streaming pipelines.Implement Debezium connectors for real-time CDC (Change Data Capture).Monitor and optimize Kafka clusters for high availability and...

  • Expert Data Integration Professional

    5 days ago

    Pune, Maharashtra, India beBeeDataIntegration Full time ₹ 1,04,000 - ₹ 1,30,878

    Kafka Integration ExpertWe are seeking an experienced Kafka Integration Expert to join our team. The ideal candidate will have a deep understanding of Apache Kafka and its applications in data integration.About the Role:The successful Kafka Integration Specialist will be responsible for designing, developing, and maintaining robust data pipelines using...

  • Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Maveric Systems Limited Full time

    Real-Time Data Engineer is responsible for designing and implementing scalable, real time data processing systems in Kafka. This role involves build of KAFKA cluster, ensuring high availability, and integrating with other data processing tools and platforms As part of the CTO Data Ingestion Service, the incumbent will be required to: Building scalable,...