Kafka Developer

4 days ago

Hyderabad, Telangana, India EXL Full time ₹ 20,00,000 - ₹ 25,00,000 per year

Location: Hyderabad [Hybrid]

Job Summary:

We are looking for a skilled Kafka Engineer with 57 years of experience in designing, building, and maintaining real-time streaming pipelines using Apache Kafka. The ideal candidate will have strong expertise in Java-based development, Kafka architecture, and CI/CD integration. You'll play a key role in enabling real-time data processing and ensuring the scalability, fault tolerance, and governance of data streaming across our enterprise systems.

Key Responsibilities:

  • Design and maintain Kafka-based streaming pipelines for high-throughput, low-latency real-time data processing.
  • Ensure scalability, fault tolerance, and schema governance using tools like Schema Registry (Avro/Protobuf).
  • Develop robust Kafka producers and consumers using Java, adhering to performance and reliability standards.
  • Collaborate with DevOps teams to automate CI/CD pipelines, deployment, and infrastructure provisioning for Kafka components.
  • Implement security best practices including encryption, authentication, and access control for Kafka clusters.
  • Monitor and troubleshoot Kafka cluster health, latency, throughput, and message delivery guarantees.
  • Document architecture, deployment strategies, and operational runbooks for Kafka-based systems.
  • Participate in code reviews, knowledge-sharing sessions, and architectural discussions.

Must-Have Skills:

  • 5–7 years of experience in backend or data engineering, with strong focus on Apache Kafka.
  • Proficiency in Java for building Kafka producers/consumers and integration with backend services.
  • Deep understanding of Kafka internals (brokers, partitions, consumer groups, offsets, replication, etc.).
  • Experience with schema management using Confluent Schema Registry, Avro, or Protobuf.
  • Experience with CI/CD pipelines for Kafka component deployment and integration.
  • Strong collaboration skills with DevOps teams to manage Kafka infrastructure, security, and automation.
  • Solid understanding of real-time data processing concepts, fault tolerance, and data consistency.

Good-to-Have Skills:

  • Experience with Kafka Streams, ksqlDB, or Apache Flink for stream processing.
  • Familiarity with Kafka Connect and connectors for data ingestion and export.
  • Exposure to Confluent Kafka Platform and Kafka REST Proxy.
  • Experience with monitoring and observability tools (e.g., Grafana, ELK Stack).
  • Understanding of container orchestration platforms like Kubernetes or OpenShift.
  • Knowledge of cloud-native Kafka deployments (AWS MSK).
  • Familiarity with Spring Boot for integrating Kafka in microservice environments.

  • Kafka Sr Developer

    3 weeks ago

    Hyderabad, Telangana, India TalentOla Full time

    Job Title Kafka Sr Developer Experience Required 9 Relevant Years Notice Period Immediate joiner only Education Engineering or a related field Location - Hyderabad only JD Python MS SQL Java Azure Databricks Spark Kenisis Kafka Sqoop Hive Apache NiFi Unix Shell Scripting The person should be able to work with business team ...

  • Kafka Admin

    1 day ago

    Hyderabad, Telangana, India Talent Worx Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    We are seeking a talented Kafka Administrator to join our dynamic team at Talent Worx. In this role, you will be responsible for managing and supporting our Kafka ecosystem, ensuring optimal performance and reliability of messaging services. Your expertise will be crucial in implementing Kafka-related solutions to enhance data streaming and processing...

  • Kafka Engineer

    2 weeks ago

    Hyderabad, Telangana, India Techno Wise Full time

    Title : Kafka EngineerWe are looking for a skilled Kafka Engineer with 5-7 years of experience in designing, building, and maintaining real-time streaming pipelines using Apache Kafka. The ideal candidate will have strong expertise in Java-based development, Kafka architecture, and CI/CD integration. You'll play a key role in enabling real-time data...

  • Kafka Engineer

    2 weeks ago

    Hyderabad, Telangana, India Techno Wise Full time

    We are looking for a skilled Kafka Engineer with 5- 7 years of experience in designing, building, and maintaining real-time streaming pipelines using Apache Kafka. The ideal candidate will have strong expertise in Java-based development, Kafka architecture, and CI/CD integration. Youll play a key role in enabling real-time data processing and ensuring the...

  • Java Developer with Kafka

    2 weeks ago

    Hyderabad, Telangana, India Innova ESI Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role: Java Developer with KafkaExperience: 6+ YearsLocation: Hyderabad | BangaloreNotice: Immediate Joiners OnlyGood technical knowledge and at least 6 years of experience on following skills:Java 8+Spring Boot, MicroservicesMicroservices Design PrinciplesGood technical knowledge and at least 2 to 3 years of experience on following skills:Event Driven...

  • Kafka Engineer

    4 days ago

    Hyderabad, Telangana, India Radiant Digital Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Design automated migration pipelines for moving enterprise Kafka workloads to open-source or cloud-native clusters.Script and provision migration steps, automate validation, rollback, and monitoring tasks.Develop and integrate custom plugins for Kafka Connect as part of migration workflows[9][8].Build scalable CI/CD processes for Kafka resource provisioning...

  • Kafka Cluster Specialist

    2 weeks ago

    Hyderabad, Telangana, India beBeeKafka Full time ₹ 15,00,000 - ₹ 20,00,000

    Job RoleKafka Professionals oversee the implementation, management, and maintenance of scalable Apache Kafka clusters to facilitate high-performance data streaming and real-time analytics. They are responsible for monitoring cluster health, performance, and capacity planning to ensure reliability and security.Main ResponsibilitiesDeploy, configure, upgrade,...

  • Kafka Cluster Architect

    2 weeks ago

    Hyderabad, Telangana, India beBeeKafkaAdministrator Full time ₹ 20,00,000 - ₹ 25,00,000

    We are seeking a skilled professional to fill the role of Kafka Administrator.Job Description:The successful candidate will be responsible for installing, configuring, and managing large-scale Kafka clusters, ensuring security, availability, scalability, and fault tolerance. They will also monitor performance, collect metrics, and optimize...

  • Kafka Software Validation Engineer

    2 weeks ago

    Hyderabad, Telangana, India beBeeKafka Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Job Title:Kafka Solution TesterDescription:We are seeking a skilled professional to test and validate the functionality of Kafka applications.Responsibilities:Strong understanding of Kafka concepts, including topics, partitions, consumers, producers, and security.Experience with testing Kafka Connect, Kafka Streams, and other Kafka ecosystem components.API...

  • Senior Software Engineer – Kafka

    6 days ago

    Hyderabad, Telangana, India ORBCOMM Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Join Us as a Senior Software Engineer – Real-Time Data ProcessingAre you ready to design and build mission-critical, high-performance systems in a fast-paced global technology environment? At ORBCOMM, we're looking for aSenior Software Engineer – Real-Time Data Processingto architect and implement scalable, event-driven platforms that power innovation...