Apache Kafka Cluster Engineer

3 days ago


Pune, Maharashtra, India Wipro Full time

Job Summary:

">

Kafka Administrator with 4-5 years of hands-on experience managing Apache Kafka clusters in a production environment is required.

The ideal candidate will be responsible for maintaining, monitoring, and scaling Kafka environments, ensuring high availability, security, and performance, while supporting streaming data needs across the organization.

You will work closely with developers, operations teams, and other stakeholders to ensure seamless integration of Kafka with other systems.

">

Key Responsibilities:

">

Install, configure, and maintain Apache Kafka clusters in production environments.

Manage Kafka brokers, topics, partitions, and replication for optimal performance and reliability.

Monitor and optimize Kafka performance, throughput, and latency.

Implement Kafka security (SSL/TLS, Kerberos) to protect data in transit and at rest.

Troubleshoot and resolve Kafka issues, including message lag, consumer group behavior, and cluster stability.

Set up and manage Kafka Connect, Schema Registry, and Kafka Streams.

Ensure disaster recovery readiness by implementing backup and recovery strategies for Kafka clusters.

Develop and manage monitoring tools and alerts (e.g., Prometheus, Grafana, Datadog) to track Kafka cluster health.

Collaborate with development teams to optimize Kafka-based applications and tune message processing.

Automate routine Kafka tasks using scripts and tools.

Manage Kafka in cloud environments like AWS, Google Cloud, or Azure.

Participate in on-call rotations for 24/7 production support of Kafka systems.

">

Requirements:

">

Bachelor's degree in Computer Science, Information Technology, or a related field.

4-5 years of experience managing and administering Kafka in a production environment.

Strong understanding of Kafka architecture, including brokers, zookeepers, producers, and consumers.

Experience with Kafka performance tuning, capacity planning, and scaling.

Hands-on experience with Kafka Connect, Kafka Streams, and Schema Registry.

Proficiency in scripting (e.g., Bash, Python) for automating Kafka administration tasks.

Experience with monitoring and alerting tools like Prometheus, Grafana, and Datadog.

Familiarity with Kafka security (SSL/TLS, Kerberos) and data governance practices.

Experience with managing Kafka in cloud environments (AWS, GCP, Azure).

Strong troubleshooting and analytical skills.

Estimated Salary:

$100,000 - $150,000 per annum.



  • Pune, Maharashtra, India Wipro Full time

    Job Summary:Kafka Cluster Engineer with 4-5 years of hands-on experience managing Apache Kafka clusters in a production environment. The ideal candidate will be responsible for maintaining, monitoring, and scaling Kafka environments, ensuring high availability, security, and performance, while supporting streaming data needs across the organization.Main...


  • Pune, Maharashtra, India Tata Consultancy Services Full time

    Are you passionate about working with cutting-edge data processing technologies? Do you have hands-on experience with Apache Kafka and its ecosystem?We are looking for a highly skilled Senior Apache Kafka Systems Engineer to join our team at Tata Consultancy Services, where you will play a key role in designing, implementing, and maintaining scalable and...


  • Pune, Maharashtra, India Wipro Full time

    About the RoleWe are seeking an experienced Kafka Cluster Architect to join our team at Wipro. This is a unique opportunity to work with a talented group of professionals and contribute to the success of our organization.As a Kafka Cluster Architect, you will be responsible for designing, implementing, and managing Apache Kafka clusters in production...


  • Pune, Maharashtra, India Wipro Full time

    About This RoleWe are seeking an experienced Kafka Architecture Engineer to join our team at Wipro. As a key member of our engineering team, you will be responsible for designing and implementing scalable, secure, and highly available Apache Kafka clusters in a production environment.


  • Pune, Maharashtra, India Tata Consultancy Services Full time

    Dear Candidate,Greetings from TATA CONSULTANCY SERVICES LIMITED.We are seeking an experienced professional to join our team as a skilled Apache Kafka developer.The ideal candidate will have a strong understanding of Kafka integration with security components, including Kerberos, LDAP, and Hadoop Systems.Responsibilities:Design and develop scalable and secure...


  • Pune, Maharashtra, India Wipro Full time

    Wipro is seeking a seasoned Solutions IT Developer with a strong background in Apache Kafka to join our developer advocacy function in our event streaming team.The ideal candidate will be responsible for Kafka code reviews with clients, troubleshooting client connection issues with Kafka and supporting client onboarding to Confluent Cloud.This role requires...


  • Pune, Maharashtra, India Wipro Full time

    Company Overview: Wipro is a leading global information technology, consulting and business process services company.About the Role: We are seeking an experienced Senior Apache Kafka Integration Specialist to join our event streaming team.Salary Range: ₹ 12.50 lakhs - ₹ 20.00 lakhs per annum (approx.), depending on experience.Job Description:Kafka Code...

  • Kafka Architect

    4 weeks ago


    Pune, Maharashtra, India Risk Resources LLP Full time

    About the Role :Overview :This role is a critical part of our data engineering team, where you will work on designing and developing real-time data streaming solutions using Kafka. You will be responsible for building scalable and high-performance data pipelines to meet the organization's evolving data needs. Key Responsibilities :- Designing and developing...


  • Pune, Maharashtra, India Wipro Full time

    Job Title: Kafka Developer and Solutions ArchitectLocation: Toronto/Offshore -PuneWe are seeking a seasoned Solutions IT Developer with a strong background in Apache Kafka to join our developer advocacy function in our event streaming team.The ideal candidate will be responsible for Kafka code reviews with clients, troubleshooting client connection issues...


  • Pune, Maharashtra, India VOIS Full time

    Job DescriptionHiring a skilled Kafka Messaging Architect to join our team at _VOIS (Vodafone Intelligent Solutions)About the RoleWe are seeking an experienced professional with 2-8 years of experience in designing and implementing scalable messaging architectures using Apache Kafka.Key Responsibilities:Design and develop complex message flows and...


  • Pune, Maharashtra, India Kenn IT Business Solutions Full time

    Job SummaryHadoop Cluster Specialist will design, deploy, and manage large-scale Hadoop clusters in a cloud-native environment. The ideal candidate will have experience with Cloudera Distribution, Hadoop patching, and version upgrades.Key ResponsibilitiesDesign and deploy Hadoop clusters in a cloud-native environment.Manage and monitor Hadoop cluster...


  • Pune, Maharashtra, India Wipro Full time

    Company Overview: We are Wipro, a leading global information technology consulting company. Our event streaming team is seeking a seasoned expert to join our developer advocacy function.Job Description: As a Senior Kafka Solutions Architect, you will be responsible for ensuring smooth integration of Apache Kafka for our Line of Business (LOB) users. This...

  • Staff Data Scientist

    2 weeks ago


    Pune, Maharashtra, India Nagarro Software Pvt. Ltd Full time

    About This OpportunityNagarro is seeking a highly skilled Staff Engineer to join our team. As a Staff Engineer, you will be responsible for leading projects and managing teams, leveraging your expertise in big data solutions using Apache Spark and other cutting-edge technologies.Your Key ResponsibilitiesLeverage your expertise in cluster computing...


  • Pune, Maharashtra, India Net2Source Inc. Full time

    Net2Source Inc. is a leading technology company looking for an experienced Expert OpenShift Cluster Engineer to join our team in Kuala Lumpur, Malaysia.As an Expert OpenShift Cluster Engineer at Net2Source Inc., you will be responsible for managing and maintaining records of configuration for all Red Hat OpenShift clusters and its connectivity to peripheral...


  • Pune, Maharashtra, India Persistent Systems Full time

    Job OverviewWe are seeking an experienced Cloud Cluster Engineer to join our team. The ideal candidate will have a strong background in DevOps, automation, and development with at least 8 years of industry experience.This is a full-time employment opportunity with a competitive salary and benefits package.


  • Pune, Maharashtra, India Synechron Technologies Pvt. Ltd. Full time

    About UsSynechron Technologies Pvt. Ltd. is a leading global consulting firm that combines creativity and innovative technology to deliver industry-leading digital solutions.We are seeking an experienced Enterprise Java Kafka Engineer to join our team.Job OverviewWe have an immediate opportunity for a skilled Java Developer with expertise in Kafka. The...


  • Pune, Maharashtra, India Synechron Technologies Pvt. Ltd. Full time

    About the RoleAs a Kafka Integration Specialist at Synechron Technologies Pvt. Ltd., you will play a key role in designing and developing high-performance Java applications that integrate with Kafka.The ideal candidate will have hands-on experience with Kafka, Spring Framework, and Java EE principles, with a strong understanding of software engineering best...


  • Pune, Maharashtra, India Aditi Consulting Full time

    About Aditi ConsultingWe are a leading consulting firm with expertise in data engineering solutions.Job DescriptionWe are seeking an experienced Senior Data Engineer to join our team in Pune/Yerwada. As a key member of our team, you will be responsible for designing and implementing large-scale data engineering systems using Apache Spark, Python, and related...

  • Cloud Data Architect

    2 weeks ago


    Pune, Maharashtra, India Digital Group Infotech Pvt Ltd Full time

    Job Title: Cloud Data ArchitectAt Digital Group Infotech Pvt Ltd, we are seeking a highly skilled Cloud Data Architect to join our team. The ideal candidate will have 5-10 years of experience in designing and developing cloud-based data models, ETL pipelines, and infrastructure for reporting, analytics, and data science.We require the candidate to have...


  • Pune, Maharashtra, India Synechron Technologies Pvt. Ltd. Full time

    About the RoleWe are seeking an experienced Senior Java Software Engineer to join our team in Pune, India. As a key member of our engineering team, you will play a crucial role in designing and developing scalable, fault-tolerant systems using Java and Kafka.Key Responsibilities:Design and implement efficient, scalable, and clean code that can process large...