Kafka Cluster Specialist

4 hours ago

Pune, Maharashtra, India beBeeKafkaCluster Full time ₹ 15,00,000 - ₹ 20,00,000
Job Title: Kafka Cluster Specialist

Main Responsibilities:
  1. Implement, configure, upgrade, and maintain large-scale Apache Kafka clusters to ensure high availability and reliability.
  2. Monitor Kafka cluster health, performance, and capacity planning to optimize data streaming and real-time analytics.
  3. Manage topics, partitions, brokers, consumer groups, and access control policies across the Kafka ecosystem.
  4. Analyze logs and troubleshoot issues related to Kafka, providing root cause investigation and resolution.
  5. Evaluate and automate deployment processes using scripts or tools to streamline operations.
  6. Collaborate with development, cloud, and DevOps teams to integrate Kafka with applications and services.
  7. Enhance Kafka performance for large-scale data streaming and real-time analytics by optimizing system resources.
  8. Develop backup, recovery, disaster recovery planning, and security hardening strategies for Kafka environments.
  9. Document Kafka processes, standards, and operational runbooks to facilitate knowledge sharing and best practices.

Required Skills & Qualifications:
  1. 4+ years of experience in Kafka Administration and support.
  2. Strong hands-on experience with Apache Kafka ecosystem (Zookeeper, Kafka Connect, Schema Registry, Kafka Streams).
  3. Cloud expertise: Azure or AWS (experience in managing Kafka clusters on cloud platforms like Confluent Cloud, MSK, or HDInsight).
  4. Advanced knowledge of SQL and relational databases.
  5. Experience with Linux/Unix system administration and shell scripting.
  6. Familiarity with monitoring tools (Prometheus, Grafana, CloudWatch, etc.).
  7. Good understanding of networking, security, and performance tuning.
  8. Strong problem-solving skills with the ability to work in a fast-paced environment.
  9. Experience with Confluent Kafka.

This is an opportunity to showcase your technical expertise in designing and maintaining scalable, secure, and efficient Apache Kafka systems. As a Kafka Cluster Specialist, you will play a critical role in ensuring the smooth operation of our data pipeline, collaborating closely with cross-functional teams to drive innovation and excellence.

We offer a competitive salary, comprehensive benefits package, and opportunities for growth and professional development in a dynamic and supportive work environment.

  • Expert Kafka Cluster Administrator

    6 days ago

    Pune, Maharashtra, India beBeeKafka Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job TitleAs a Kafka Infrastructure Specialist, you will be responsible for deploying and managing production-grade Kafka clusters, ensuring high availability and fault tolerance.Key responsibilities include:Cluster Deployment: Deploy and upgrade production-grade Kafka clusters using tools such as Ansible and Chef.Automated Configuration: Automate the...

  • Apache Kafka Clusters Professional

    3 days ago

    Pune, Maharashtra, India Sarvaha Systems Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    We are looking for a skilled professional with experience in leading the deployment and operational management of high-performance Apache Kafka clusters. The ideal candidate will have a strong background in IT Services & Consulting, with expertise in managing large-scale data processing systems.Roles and ResponsibilityDesign, deploy, and manage...

  • Leading the Deployment and Operational Management of High-Performance Apache Kafka Clusters

    4 days ago

    Pune, Maharashtra, India beBeeKafka Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Title: Kafka Infrastructure LeadWe are seeking an experienced professional to lead the deployment, configuration, and operational management of Apache Kafka clusters supporting real-time data ingestion pipelines.The role involves ensuring secure, scalable, and highly available Kafka infrastructure for streaming flow records into centralized data...

  • Kafka Developer

    3 days ago

    Pune, Maharashtra, India airisDATA Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Position:Kafka DeveloperExperience: 5+ YearsLocations:    Pune, India ( Onsite )Job Description:Seeking a highly skilled Kafka Developer with deep expertise in Kafka transformationsand hands-on experience working with MS SQL / PostgreSQLdatabases especially in environments with non-standard schemas(e.g., tables without primary keys, with/without...

  • Kafka Developer

    3 days ago

    Pune, Maharashtra, India Innovative Information Technologies, Inc. Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Role : Kafka DeveloperExperiences : 5+ YearsLocation : PuneType : ContractMode : Full timeJob Description :Role OverviewSeeking a highly skilled Kafka Developer with deep expertise in Kafka transformations and hands-on experience working with MS SQL / PostgreSQL databases especially in environments with non-standard schemas (e.g., tables without...

  • Kafka Specialist

    4 days ago

    Pune, Maharashtra, India beBeeKafka Full time ₹ 1,04,000 - ₹ 1,30,878

    Job DescriptionWe are seeking a highly skilled Kafka specialist to join our team.Key ResponsibilitiesDesign and develop efficient Kafka producers and consumers for real-time data ingestion pipelines.Develop strong hands-on expertise in Apache Kafka, Kafka Connect, Kafka Streams, and Schema Registry.Implement data transformation and enrichment using Apache...

  • Kafka Systems Engineer

    20 hours ago

    Pune, Maharashtra, India beBeeKafkaEngineer Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Title: Kafka Systems EngineerKey Responsibilities:• Ensure the smooth operation and maintenance of Kafka Connectors and clusters.• Manage Connector Configurations (Sink and Source connector configuration) effectively.• Design and implement data conversion protocols from Protobuf to Json Format and vice versa.• Develop business logic for data...

  • Kafka & Debezium Engineer

    3 days ago

    Pune, Maharashtra, India Sanglob Business Services Private Limited Full time ₹ 15,00,000 per year

    Job Title: Kafka & Debezium EngineerLocation: Pune (Onsite/Hybrid)Experience Required: 3–5 yearsJoining: Immediate Joiners PreferredKey Responsibilities:Design, build, and manage Kafka-based data streaming pipelines.Implement Debezium connectors for real-time CDC (Change Data Capture).Monitor and optimize Kafka clusters for high availability and...

  • Kafka and Service Mesh Integration Specialist

    2 days ago

    Pune, Maharashtra, India beBeeServiceMesh Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Kafka and Service Mesh Integration ExpertAbout the Role:We are seeking a seasoned expert to lead our Kafka and Service Mesh integration efforts. The ideal candidate will have a strong background in distributed systems, cloud architecture, and container orchestration.Key Responsibilities:Migrate existing infrastructure from Mirror Maker and Zookeeper to KRaft...

  • Cloud & Infrastructure Management Specialist

    2 days ago

    Pune, Maharashtra, India beBeeInfrastructure Full time ₹ 10,00,000 - ₹ 20,00,000

    Job Title: Cloud & Infrastructure Management Specialist">Data Platform Engineer responsible for designing, implementing, and managing cloud-based data platforms.Expertise in Apache NiFi Administration including building clusters, upgrading cluster versions, and troubleshooting on Linux.Strong knowledge of Kafka administration and configuration management...