Kafka Engineer

1 week ago

Hyderabad, India Techno Wise Full time

Title : Kafka Engineer

We are looking for a skilled Kafka Engineer with 5-7 years of experience in designing, building, and maintaining real-time streaming pipelines using Apache Kafka. The ideal candidate will have strong expertise in Java-based development, Kafka architecture, and CI/CD integration.


You'll play a key role in enabling real-time data processing and ensuring the scalability, fault tolerance, and governance of data streaming across our enterprise systems.

Key Responsibilities :

- Design and maintain Kafka-based streaming pipelines for high-throughput, low-latency real-time data processing.

- Ensure scalability, fault tolerance, and schema governance using tools like Schema Registry (Avro/Protobuf).

- Develop robust Kafka producers and consumers using Java, adhering to performance and reliability standards.

- Collaborate with DevOps teams to automate CI/CD pipelines, deployment, and infrastructure provisioning for Kafka components.

- Implement security best practices including encryption, authentication, and access control for Kafka clusters.

- Monitor and troubleshoot Kafka cluster health, latency, throughput, and message delivery guarantees.

- Document architecture, deployment strategies, and operational run books for Kafka-based systems.

- Participate in code reviews, knowledge-sharing sessions, and architectural discussions.

Must-Have Skills :

- 5-7 years of experience in backend or data engineering, with strong focus on Apache Kafka.

- Proficiency in Java for building Kafka producers/consumers and integration with backend services.

- Deep understanding of Kafka internals (brokers, partitions, consumer groups, offsets, replication, etc.).

- Experience with schema management using Confluent Schema Registry, Avro, or Protobuf.

- Experience with CI/CD pipelines for Kafka component deployment and integration.

- Strong collaboration skills with DevOps teams to manage Kafka infrastructure, security, and automation.

- Solid understanding of real-time data processing concepts, fault tolerance, and data consistency.

Good-to-Have Skills :

- Experience with Kafka Streams, ksqlDB, or Apache Flink for stream processing.

- Familiarity with Kafka Connect and connectors for data ingestion and export. Exposure to Confluent Kafka Platform and Kafka REST Proxy.

- Experience with monitoring and observability tools (e.g., Grafana, ELK Stack).

- Understanding of container orchestration platforms like Kubernetes or OpenShift.

- Knowledge of cloud-native Kafka deployments (AWS MSK).

- Familiarity with Spring Boot for integrating Kafka in microservice environments.

(ref:hirist.tech)

  • Kafka Engineer

    3 weeks ago

    Hyderabad, Telangana, India Techno Wise Full time

    Title : Kafka EngineerWe are looking for a skilled Kafka Engineer with 5-7 years of experience in designing, building, and maintaining real-time streaming pipelines using Apache Kafka. The ideal candidate will have strong expertise in Java-based development, Kafka architecture, and CI/CD integration. You'll play a key role in enabling real-time data...

  • Kafka Engineer

    3 weeks ago

    Hyderabad, Telangana, India Techno Wise Full time

    We are looking for a skilled Kafka Engineer with 5- 7 years of experience in designing, building, and maintaining real-time streaming pipelines using Apache Kafka. The ideal candidate will have strong expertise in Java-based development, Kafka architecture, and CI/CD integration. Youll play a key role in enabling real-time data processing and ensuring the...

  • Kafka Engineer

    3 days ago

    Bengaluru, Hyderabad, India Solugenix Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Solugenix is a leader in IT services, delivering cutting-edge technology solutions, exceptional talent, and managed services to global enterprises. With extensive expertise in highly regulated and complex industries, we are a trusted partner for integrating advanced technologies with streamlined processes. Our solutions drive growth, foster innovation, and...

  • Kafka Engineer

    7 days ago

    Hyderabad, Telangana, India Radiant Digital Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Design automated migration pipelines for moving enterprise Kafka workloads to open-source or cloud-native clusters.Script and provision migration steps, automate validation, rollback, and monitoring tasks.Develop and integrate custom plugins for Kafka Connect as part of migration workflows[9][8].Build scalable CI/CD processes for Kafka resource provisioning...

  • Kafka Developer

    7 days ago

    Hyderabad, Telangana, India EXL Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Location: Hyderabad [Hybrid]Job Summary:We are looking for a skilled Kafka Engineer with 57 years of experience in designing, building, and maintaining real-time streaming pipelines using Apache Kafka. The ideal candidate will have strong expertise in Java-based development, Kafka architecture, and CI/CD integration. You'll play a key role in enabling...

  • Kafka Developer

    7 days ago

    Hyderabad, India EXL Full time

    Location: Hyderabad (Hybrid) Job Summary: We are looking for a skilled Kafka Engineer with 57 years of experience in designing, building, and maintaining real-time streaming pipelines using Apache Kafka. The ideal candidate will have strong expertise in Java-based development, Kafka architecture, and CI/CD integration. You'll play a key role in enabling...

  • Kafka Developer

    18 hours ago

    Hyderabad, Telangana, India Mobileprogramming Full time ₹ 7,50,000 - ₹ 9,50,000 per year

    Job DescriptionPosition Title: Kafka DeveloperExperience: 5–8 YearsLocation: All LocationsRole Overview:We are seeking an experienced Kafka Developer to design, develop, and maintain Apache Kafka-based streaming solutions. The candidate will work on building real-time data pipelines, optimizing Kafka clusters, and integrating Kafka with various systems to...

  • Data Engineer

    1 week ago

    Hyderabad, India CORTEX Consultants Full time

    Job Title : Data Engineer Kafka, Python, and Azure DatabricksLocation : Bangalore, Noida, Hyderabad (Hybrid 2 days in office per week)Experience : 5 to 8 YearsNotice Period : Immediate to 15 Days (Immediate Joiners Preferred)About the Role :We're looking for a seasoned Data Engineer to join our dynamic healthcare data engineering team. You'll be...

  • Kafka Developer

    5 days ago

    Bengaluru, Chennai, Hyderabad, India Sdna Global Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job DescriptionKafka DeveloperConfluent Kafka Engineers with in-depth knowledge of Confluent/Kafka ecosystem products/technologiesExperience 10-15 years of experience Deployment and Management of Confluent Kafka.Streams based application problem investigationExperience and hands on expertise in KSql , KStreams and Kafka connectors.In-depth knowledge on...

  • Kafka Developer

    3 days ago

    Bengaluru, Chennai, Hyderabad, India Tanisha Systems Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Role & responsibilitiesPreferred candidate profileNotie Period- Immediate joiner onlyJob DescriptionKafka DeveloperConfluent Kafka Engineers with in-depth knowledge of Confluent/Kafka ecosystem products/technologies Experience 10-15 years of experience Deployment and Management of Confluent Kafka. Streams based application problem investigation Experience...