Kafka Engineer

1 day ago

Hyderabad, Telangana, India Techno Wise Full time

Title : Kafka Engineer

We are looking for a skilled Kafka Engineer with 5-7 years of experience in designing, building, and maintaining real-time streaming pipelines using Apache Kafka. The ideal candidate will have strong expertise in Java-based development, Kafka architecture, and CI/CD integration.

You'll play a key role in enabling real-time data processing and ensuring the scalability, fault tolerance, and governance of data streaming across our enterprise systems.

Key Responsibilities :

- Design and maintain Kafka-based streaming pipelines for high-throughput, low-latency real-time data processing.

- Ensure scalability, fault tolerance, and schema governance using tools like Schema Registry (Avro/Protobuf).

- Develop robust Kafka producers and consumers using Java, adhering to performance and reliability standards.

- Collaborate with DevOps teams to automate CI/CD pipelines, deployment, and infrastructure provisioning for Kafka components.

- Implement security best practices including encryption, authentication, and access control for Kafka clusters.

- Monitor and troubleshoot Kafka cluster health, latency, throughput, and message delivery guarantees.

- Document architecture, deployment strategies, and operational run books for Kafka-based systems.

- Participate in code reviews, knowledge-sharing sessions, and architectural discussions.

Must-Have Skills :

- 5-7 years of experience in backend or data engineering, with strong focus on Apache Kafka.

- Proficiency in Java for building Kafka producers/consumers and integration with backend services.

- Deep understanding of Kafka internals (brokers, partitions, consumer groups, offsets, replication, etc.).

- Experience with schema management using Confluent Schema Registry, Avro, or Protobuf.

- Experience with CI/CD pipelines for Kafka component deployment and integration.

- Strong collaboration skills with DevOps teams to manage Kafka infrastructure, security, and automation.

- Solid understanding of real-time data processing concepts, fault tolerance, and data consistency.

Good-to-Have Skills :

- Experience with Kafka Streams, ksqlDB, or Apache Flink for stream processing.

- Familiarity with Kafka Connect and connectors for data ingestion and export. Exposure to Confluent Kafka Platform and Kafka REST Proxy.

- Experience with monitoring and observability tools (e.g., Grafana, ELK Stack).

- Understanding of container orchestration platforms like Kubernetes or OpenShift.

- Knowledge of cloud-native Kafka deployments (AWS MSK).

- Familiarity with Spring Boot for integrating Kafka in microservice environments.

(ref:hirist.tech)

  • Kafka Engineer

    3 days ago

    Hyderabad, Telangana, India Techno Wise Full time

    We are looking for a skilled Kafka Engineer with 5- 7 years of experience in designing, building, and maintaining real-time streaming pipelines using Apache Kafka. The ideal candidate will have strong expertise in Java-based development, Kafka architecture, and CI/CD integration. Youll play a key role in enabling real-time data processing and ensuring the...

  • Kafka Sr Developer

    5 days ago

    Hyderabad, Telangana, India TalentOla Full time

    Job Title Kafka Sr Developer Experience Required 9 Relevant Years Notice Period Immediate joiner only Education Engineering or a related field Location - Hyderabad only JD Python MS SQL Java Azure Databricks Spark Kenisis Kafka Sqoop Hive Apache NiFi Unix Shell Scripting The person should be able to work with business team ...

  • Sr. Java Kafka Engineer

    1 week ago

    Hyderabad, Telangana, India Antal International Full time

    Job Description We are seeking a skilled and experienced Senior Java Developer to join our growing team. The ideal candidate will have over 5+ years of hands-on experience in Java development and at least 1+ year of experience working with Kafka. Location- Hyderabad Experience- 5+ years Key Responsibilities: Design, develop, test, and deploy scalable...

  • Kafka, IBM APIC Professional

    2 days ago

    Hyderabad, Telangana, India IDESLABS PRIVATE LIMITED Full time US$ 80,000 - US$ 1,20,000 per year

    Kafka, IBM APIC & Data Power Administration:Job Summary:We are seeking a highly skilled Middleware Support Engineer to join our dynamic team. The ideal candidate will have extensive experience in supporting and managing middleware technologies including Kafka, IBM API Connect (APIC), IBM Data Power management. The role involves ensuring the smooth operation,...

  • SQL/ADF Developer with Kafka

    1 day ago

    Hyderabad, Telangana, India Ispace Full time ₹ 1,40,000 - ₹ 28,00,000 per year

    SQL Developer and KafkaExperience Level: YearsEmployment Type: Full-TimeAbout the Role:We are seeking a seasoned SQL Developer to lead the design, optimization, and modernization of our data infrastructure. This role is critical to supporting our large-scale, event-driven platform built on .NET and Azure. The ideal candidate will have deep expertise in SQL...

  • Data Engineer

    3 days ago

    Hyderabad, Telangana, India CORTEX Consultants Full time

    Job Title : Data Engineer Kafka, Python, and Azure DatabricksLocation : Bangalore, Noida, Hyderabad (Hybrid 2 days in office per week)Experience : 5 to 8 YearsNotice Period : Immediate to 15 Days (Immediate Joiners Preferred)About the Role :We're looking for a seasoned Data Engineer to join our dynamic healthcare data engineering team. You'll be...

  • Azure Data Engineer

    13 hours ago

    Hyderabad, Telangana, India Deqode Full time

    Job Description :We are seeking a Senior Software Engineer (SSE) with strong expertise in Kafka, Python, and Azure Databricks to lead and contribute to our healthcare data engineering initiatives. This role is pivotal in building scalable, real-time data pipelines and processing large-scale healthcare datasets in a secure and compliant cloud environment.The...

  • Principal/Senior Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India HyrEzy Talent Solutions Full time

    Job Title : Principal / Senior Data Engineer - Product Development- Location : Hyderabad (Work from Office only)- Experience : 4 - 7 Years- Notice Period : Maximum 15 daysAbout the Company :We are a new-age, AI-first Digital & Cloud Engineering Services company. Our mission is to combine deep engineering expertise with automation-first thinking and AI-native...

  • Senior Data Engineer – Product Development

    2 days ago

    Hyderabad, Telangana, India HYrEzy Tech Solutions Full time ₹ 15,00,000 - ₹ 30,00,000 per year

    Job Title:Principal / Senior Data Engineer – Product DevelopmentLocation: Hyderabad (Work from Office only)Experience: 4 – 7 YearsNotice Period: Maximum 15 daysCompensation: 15 – 30 LPAAbout The CompanyWe are a new-age, AI-first Digital & Cloud Engineering Services company. Our mission is to combine deep engineering expertise with automation-first...

  • Principal / Senior Data Engineer – Product Development

    2 days ago

    Hyderabad, Telangana, India Avant Garde Full time US$ 1,50,000 - US$ 2,00,000 per year

    Are you passionate about building large-scale, data-intensive distributed systemsWere looking for a Principal / Senior Data Engineer to work on cutting-edge data ingestion pipelines and distributed product engineering for one of the worlds leading graph data science companies. Roles & Responsibilities Understand design specifications and follow best...