Kafka Engineer

4 weeks ago

Hyderabad, Telangana, India Techno Wise Full time

Title : Kafka Engineer

We are looking for a skilled Kafka Engineer with 5-7 years of experience in designing, building, and maintaining real-time streaming pipelines using Apache Kafka. The ideal candidate will have strong expertise in Java-based development, Kafka architecture, and CI/CD integration.

You'll play a key role in enabling real-time data processing and ensuring the scalability, fault tolerance, and governance of data streaming across our enterprise systems.

Key Responsibilities :

- Design and maintain Kafka-based streaming pipelines for high-throughput, low-latency real-time data processing.

- Ensure scalability, fault tolerance, and schema governance using tools like Schema Registry (Avro/Protobuf).

- Develop robust Kafka producers and consumers using Java, adhering to performance and reliability standards.

- Collaborate with DevOps teams to automate CI/CD pipelines, deployment, and infrastructure provisioning for Kafka components.

- Implement security best practices including encryption, authentication, and access control for Kafka clusters.

- Monitor and troubleshoot Kafka cluster health, latency, throughput, and message delivery guarantees.

- Document architecture, deployment strategies, and operational run books for Kafka-based systems.

- Participate in code reviews, knowledge-sharing sessions, and architectural discussions.

Must-Have Skills :

- 5-7 years of experience in backend or data engineering, with strong focus on Apache Kafka.

- Proficiency in Java for building Kafka producers/consumers and integration with backend services.

- Deep understanding of Kafka internals (brokers, partitions, consumer groups, offsets, replication, etc.).

- Experience with schema management using Confluent Schema Registry, Avro, or Protobuf.

- Experience with CI/CD pipelines for Kafka component deployment and integration.

- Strong collaboration skills with DevOps teams to manage Kafka infrastructure, security, and automation.

- Solid understanding of real-time data processing concepts, fault tolerance, and data consistency.

Good-to-Have Skills :

- Experience with Kafka Streams, ksqlDB, or Apache Flink for stream processing.

- Familiarity with Kafka Connect and connectors for data ingestion and export. Exposure to Confluent Kafka Platform and Kafka REST Proxy.

- Experience with monitoring and observability tools (e.g., Grafana, ELK Stack).

- Understanding of container orchestration platforms like Kubernetes or OpenShift.

- Knowledge of cloud-native Kafka deployments (AWS MSK).

- Familiarity with Spring Boot for integrating Kafka in microservice environments.

(ref:hirist.tech)

  • Kafka Developer

    1 week ago

    Hyderabad, Telangana, India Mobileprogramming Full time ₹ 7,50,000 - ₹ 9,50,000 per year

    Job DescriptionPosition Title: Kafka DeveloperExperience: 5–8 YearsLocation: All LocationsRole Overview:We are seeking an experienced Kafka Developer to design, develop, and maintain Apache Kafka-based streaming solutions. The candidate will work on building real-time data pipelines, optimizing Kafka clusters, and integrating Kafka with various systems to...

  • Kafka Developer

    4 days ago

    Hyderabad, Telangana, India Risk Resources LLP Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Role :Required Technical Skill Set : - Sound knowledge of Apache Kafka Configuration and Pub/Sub Integration, Java, MicroservicesDesired Competencies (Technical/Behavioral Competency)Must-Have : - Developing scripts/code for Kafka Connector - Developing scripts/code for Kstream - Developing Publisher and Subscriber for Kafka Topics - Configure...

  • Kafka, IBM APIC Professional

    2 weeks ago

    Hyderabad, Telangana, India IDESLABS PRIVATE LIMITED Full time ₹ 8,00,000 - ₹ 25,00,000 per year

    We have Immediate opening for KafkaIBM APICKafka, IBM APIC & Data Power Administration:Job Summary:We are seeking a highly skilled Middleware Support Engineer to join our dynamic team. The ideal candidate will have extensive experience in supporting and managing middleware technologies including Kafka, IBM API Connect (APIC), IBM Data Power management. The...

  • SQL/ADF Developer with Kafka

    6 days ago

    Hyderabad, Telangana, India Ispace Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    SQL Developer and KafkaExperience Level: YearsEmployment Type: Full-TimeAbout the Role:We are seeking a seasoned SQL Developer to lead the design, optimization, and modernization of our data infrastructure. This role is critical to supporting our large-scale, event-driven platform built on .NET and Azure. The ideal candidate will have deep expertise in SQL...

  • Software Engineer II- Spark,AWS,Java,Kafka

    1 week ago

    Hyderabad, Telangana, India JPMorganChase Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    JOB DESCRIPTIONWe have an exciting opportunity for you to advance your software engineering career and grow your skills at JPMorgan Chase.Job summaryAs a Software Engineer II at JPMorgan Chase within Corporate Technology, you will be part of an agile team responsible for designing and delivering reliable technology products in a secure, stable, and scalable...

  • Azure Data Engineer

    4 weeks ago

    Hyderabad, Telangana, India Deqode Full time

    Job Description :We are seeking a Senior Software Engineer (SSE) with strong expertise in Kafka, Python, and Azure Databricks to lead and contribute to our healthcare data engineering initiatives. This role is pivotal in building scalable, real-time data pipelines and processing large-scale healthcare datasets in a secure and compliant cloud environment.The...

  • Principal/Senior Data Engineer

    1 week ago

    Hyderabad, Telangana, India HyrEzy Talent Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title : Principal / Senior Data Engineer - Product Development - Location : Hyderabad (Work from Office only) - Experience : 4 - 7 Years - Notice Period : Maximum 15 daysAbout the Company : We are a new-age, AI-first Digital & Cloud Engineering Services company. Our mission is to combine deep engineering expertise with automation-first...

  • Senior Data Engineer – Product Development

    1 week ago

    Hyderabad, Telangana, India HYrEzy Tech Solutions Full time ₹ 15,00,000 - ₹ 30,00,000 per year

    Job Title:Principal / Senior Data Engineer – Product DevelopmentLocation: Hyderabad (Work from Office only)Experience: 4 – 7 YearsNotice Period: Maximum 15 daysCompensation: 15 – 30 LPAAbout The CompanyWe are a new-age, AI-first Digital & Cloud Engineering Services company. Our mission is to combine deep engineering expertise with automation-first...

  • Senior Data Engineer

    3 weeks ago

    Hyderabad, Telangana, India One Click AI Full time

    Job Opening : Principal/Senior Data Engineer Product DevelopmentCompany : Agivant TechnologiesAbout Agivant Technologies :Agivant is a new-age AI-First Digital and Cloud Engineering services company focused on building cutting-edge products and solutions. Roles & Responsibilities :- Design, develop, and optimize data ingestion pipelines for distributed...

  • Principal / Senior Data Engineer – Product Development

    6 days ago

    Hyderabad, Telangana, India Avant Garde Full time US$ 1,50,000 - US$ 2,00,000 per year

    Are you passionate about building large-scale, data-intensive distributed systemsWere looking for a Principal / Senior Data Engineer to work on cutting-edge data ingestion pipelines and distributed product engineering for one of the worlds leading graph data science companies. Roles & Responsibilities Understand design specifications and follow best...