Expert Kafka Cluster Architect

3 days ago

Bengaluru, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000
Real-Time Data Specialist

We are seeking a highly skilled expert to manage and maintain our Apache Kafka ecosystem.

About the Role

The successful candidate will be responsible for installing, configuring, upgrading, and maintaining large-scale Apache Kafka clusters.

Key Responsibilities:
  • Cluster Management: Ensure high availability, reliability, and security of the Kafka environment through proactive monitoring, capacity planning, and performance optimization.
  • Topic Management: Manage topics, partitions, brokers, consumer groups, and access control policies to ensure seamless data streaming and real-time analytics.
  • Troubleshooting and Analysis: Perform root cause investigation of Kafka-related issues, analyze logs, and implement corrective actions to prevent recurrence.
  • Automation and Integration: Automate deployment and monitoring processes using scripts or tools, collaborate with development, cloud, and DevOps teams to integrate Kafka with applications.
  • Performance Optimization: Optimize Kafka performance for large-scale data streaming and real-time analytics by streamlining cluster configuration, tuning, and scaling.
  • Backup and Recovery: Develop and implement backup, recovery, disaster recovery planning, and security hardening strategies to ensure business continuity.
  • Documentation: Maintain accurate and up-to-date documentation of Kafka processes, standards, and operational runbooks.
Requirements:
  • 4+ years of experience in Apache Kafka Administration and support.
  • Strong hands-on experience with the Apache Kafka ecosystem (Zookeeper, Kafka Connect, Schema Registry, Kafka Streams).
  • Cloud knowledge: Azure or AWS (experience in managing Kafka clusters on cloud platforms like Confluent Cloud, MSK, or HDInsight).
  • Strong knowledge of SQL and relational databases.
  • Experience with Linux/Unix system administration and shell scripting.
  • Familiarity with monitoring tools (Prometheus, Grafana, CloudWatch, etc.).
  • Good understanding of networking, security, and performance tuning.
  • Strong problem-solving skills with the ability to work in a fast-paced environment.

  • Expert Kafka Architect

    2 weeks ago

    Bengaluru, Karnataka, India beBeeKafka Full time ₹ 9,00,000 - ₹ 12,00,000

    Kafka Cluster Administration ExpertAs a key member of our team, you will be responsible for the design, deployment, and management of Confluent Kafka clusters. This includes configuring and monitoring Kafka components such as Connect, Schema Registry, ksqlDB, and REST Proxy.We are looking for someone with hands-on experience in Apache Kafka and/or Confluent...

  • Senior Kafka Cluster Manager

    2 weeks ago

    Bengaluru, Karnataka, India beBeeKafka Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job OpportunityWe are seeking a highly skilled and experienced Kafka specialist to join our team as a Senior Cluster Manager.Key Responsibilities:Design and deploy scalable Confluent Kafka clusters on-prem and/or cloud.Configure and monitor Kafka components, including Connect, Schema Registry, ksql DB, and REST Proxy, to ensure optimal performance.Develop...

  • Kafka Cluster Engineer

    1 week ago

    Bengaluru, Karnataka, India beBeeDeveloper Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Role OverviewKey ResponsibilitiesCluster Management and AdministrationOptimize Kafka cluster infrastructure to guarantee high availability and resilience.Automate the deployment and configuration of production-grade Kafka clusters using Ansible, Chef, or similar tools.Troubleshoot critical production issues, ensuring minimal downtime and optimal Kafka...

  • High-Performance Kafka Cluster Specialist

    1 week ago

    Bengaluru, Karnataka, India beBeeKafka Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Opportunity: Kafka AdministratorThe position of Kafka Administrator is an excellent opportunity to work on cutting-edge technology and contribute to the growth of our organization.This role involves deploying and managing production-grade Kafka clusters, ensuring high availability and fault tolerance.Cluster Management: Deploy and upgrade Kafka clusters...

  • Kafka Cluster Administrator Position Available

    16 hours ago

    Bengaluru, Karnataka, India beBeeKafka Full time ₹ 20,00,000 - ₹ 25,00,000

    Job OpportunityWe are seeking a skilled professional to assume the role of a Kafka Cluster Administrator.This is an exciting opportunity for someone with extensive knowledge and hands-on experience in designing, implementing, and maintaining large-scale Kafka clusters on-premises and in the cloud.The ideal candidate will possess excellent technical skills,...

  • Kafka Solutions Architect

    1 week ago

    Bengaluru, Karnataka, India beBeeKafka Full time ₹ 20,00,000 - ₹ 25,00,000

    Kafka LeadWe are seeking a highly skilled Kafka Lead to fill this key role at our organization.Responsibilities:Integration: Integrate Kafka with other systems such as databases, APIs, and cloud services, KSQL.Kafka Management: Manage Kafka clusters, including topics, partitions, and brokers, ensuring high availability and scalability.Performance...

  • Kafka Lead

    2 weeks ago

    Bengaluru, Karnataka, India HCLTech Full time

    Kafka Integration - LeadNotice Period - Immediate to 45 days.Location - Bengaluru/Chennai/Hyderabad/Pune/Noida.Experience - 5+ yearsHere's a more detailed breakdown:Responsibilities:Integration:Integrating Kafka with other systems such as databases, APIs, and cloud services, KSQLKafka Management:Managing Kafka clusters, including topics, partitions, and...

  • Kafka Administrator

    1 week ago

    Bengaluru, Karnataka, India Softenger Full time

    Job DescriptionResponsibilities- Deploy and upgrade production-grade Kafka clusters, ensuring high availability and fault tolerance.- Automate the installation and configuration of Kafka clusters using tools such as Ansible and Chef.- Troubleshoot critical production issues, optimizing Kafka performance and minimizing downtime.- Configure MirrorMaker for...

  • Kafka Administrator

    1 week ago

    Bengaluru, Karnataka, India Softenger Full time

    ResponsibilitiesDeploy and upgrade production-grade Kafka clusters, ensuring high availability and fault tolerance.Automate the installation and configuration of Kafka clusters using tools such as Ansible and Chef.Troubleshoot critical production issues, optimizing Kafka performance and minimizing downtime.Configure MirrorMaker for data replication between...

  • Kafka Lead

    3 weeks ago

    Bengaluru, Karnataka, India HCLTech Full time

    Kafka Integration - Lead Notice Period - Immediate to 45 days. Location - Bengaluru/Chennai/Hyderabad/Pune/Noida. Experience - 5+ years Here's a more detailed breakdown: Responsibilities: Integration: Integrating Kafka with other systems such as databases, APIs, and cloud services, KSQL Kafka Management: Managing Kafka clusters, including topics,...