Senior Kafka Administrator

Location

Bangalore, Karnataka, 560100

Category

Engineering / Information Technology

Job Type

Full time

Job Id

1193139No

Senior Kafka Administrator

This role has been designed as 'Hybrid' with an expectation that you will work on average 2 days per week from an HPE office.

Who We Are:

Hewlett Packard Enterprise is the global edge-to-cloud company advancing the way people live and work. We help companies connect, protect, analyze, and act on their data and applications wherever they live, from edge to cloud, so they can turn insights into outcomes at the speed required to thrive in today's complex world. Our culture thrives on finding new and better ways to accelerate what's next. We know varied backgrounds are valued and succeed here. We have the flexibility to manage our work and personal needs. We make bold moves, together, and are a force for good. If you are looking to stretch and grow your career our culture will embrace you. Open up opportunities with HPE.

Job Description:

Job Family Definition:

Provide technology consulting to external customers and internal project teams. Responsible for providing technical support and/or leadership in the creation and delivery of technology solutions designed to meet customers' business needs and, consequently, for understanding customers' businesses. As trusted advisor create and maintain effective customer relationships so as to insure customer satisfaction. Maintain knowledge of leading edge technologies and industry/market domain knowledge. Actively contribute to the company's solutions portfolio by providing information ranging from technical knowledge to methodologies based on experience gained from customer projects. Shape technical direction and technical strategies within the organization and for external customers. Accountable for consistent and significant chargeability levels (or expense relief for internal project teams) and for assisting in meeting or exceeding revenue and customer satisfaction goals. Contribute to organization's profitability by generating and cultivating new business opportunities and by providing technical support for deal proposal development.

Management Level Definition:

Contributions include applying developed subject matter expertise to solve common and sometimes complex technical problems and recommending alternatives where necessary. Might act as project lead and provide assistance to lower level professionals. Exercises independent judgment and consults with others to determine best method for accomplishing work and achieving objectives.

What you'll do:

Kafka Cluster Management

• Install, configure, and manage Kafka clusters (on-premise & cloud).
• Handle broker upgrades, partitioning, replication, and topic management.
• Maintain ZooKeeper or KRaft-based configurations.

Performance & Reliability

• Optimize Kafka brokers, producers, and consumers for low latency and high throughput.
• Manage storage, retention, and log compaction policies.
• Implement disaster recovery (DR), high availability (HA), and capacity planning strategies.

Monitoring & Troubleshooting

• Monitor cluster health using tools like Prometheus, Grafana, ELK, or Confluent Control Center.
• Diagnose and resolve consumer lag, broker failures, and performance bottlenecks.
• Develop automation scripts and runbooks for recurring tasks.

Security & Governance

• Implement authentication/authorization using SASL, SSL/TLS, Kerberos, or RBAC.
• Enforce data encryption and compliance policies.
• Collaborate with security teams for vulnerability management.

Collaboration & Support

• Work with developers to onboard applications into Kafka.
• Integrate Kafka with CI/CD pipelines and data lake ecosystems.

What you need to bring:

Skills & Experience

• 7+ years of Kafka administration in large-scale environments.
• Strong understanding of Kafka internals: brokers, topics, partitions, offsets.
• Hands-on experience with Confluent Kafka (Schema Registry, Kafka Connect, KSQL).
• Proficiency in Linux system administration, networking, and shell scripting.
• Experience with automation tools (Ansible, Terraform, Python).
• Exposure to cloud-managed Kafka services (AWS MSK, Azure Event Hubs, GCP Pub/Sub).

Preferred Knowledge

• Real-time data streaming tools: Flink, Spark Streaming, or NiFi.
• Integration with data lakes, microservices, and enterprise messaging systems.
• Familiarity with GitOps and container orchestration (Kubernetes, Docker).

Education & Certifications

• Bachelor's or Master's degree in Computer Science, IT, or related field.

• Preferred certifications:

• Confluent Certified Administrator for Apache Kafka (CCAK)

• Cloud platform certifications (AWS, Azure, or GCP)

Additional Skills:

Accountability, Accountability, Active Learning, Active Listening, Bias, Business Growth, Client Expectations Management, Coaching, Creativity, Critical Thinking, Cross-Functional Teamwork, Customer Centric Solutions, Customer Relationship Management (CRM), Design Thinking, Empathy, Follow-Through, Growth Mindset, Information Technology (IT) Infrastructure, Infrastructure as a Service (IaaS), Intellectual Curiosity (Inactive), Long Term Planning, Managing Ambiguity, Process Improvements, Product Services, Relationship Building {+ 5 more}

What We Can Offer You:

Health & Wellbeing

We strive to provide our team members and their loved ones with a comprehensive suite of benefits that supports their physical, financial and emotional wellbeing.

Personal & Professional Development

We also invest in your career because the better you are, the better we all are. We have specific programs catered to helping you reach any career goals you have — whether you want to become a knowledge expert in your field or apply your skills to another division.

Unconditional Inclusion

We are unconditionally inclusive in the way we work and celebrate individual uniqueness. We know varied backgrounds are valued and succeed here. We have the flexibility to manage our work and personal needs. We make bold moves, together, and are a force for good.

Let's Stay Connected:

Follow @HPECareers on Instagram to see the latest on people, culture and tech at HPE.

Job:

Services

Job Level:

TCP_03

HPE is an Equal Employment Opportunity/ Veterans/Disabled/LGBT employer. We do not discriminate on the basis of race, gender, or any other protected category, and all decisions we make are made on the basis of qualifications, merit, and business need. Our goal is to be one global team that is representative of our customers, in an inclusive environment where we can continue to innovate and grow together. Please click here: Equal Employment Opportunity.

Hewlett Packard Enterprise is EEO Protected Veteran/ Individual with Disabilities.

HPE will comply with all applicable laws related to employer use of arrest and conviction records, including laws requiring employers to consider for employment qualified applicants with criminal histories.