Engineer - Kafka

6 days ago

Bengaluru, India ANRGI TECH Pvt. Ltd. Full time
Job Description
Job Title: Engineer - Kafka

Location:  CHENNAI PUNE HYDERABAD KOLKATA BANGALORE PAN India

Job description: must have

• Cluster Management:

Install, configure, and maintain Confluent and AWS MSK Kafka clusters.

Manage large-scale, multi-node Kafka cluster environments (on-prem and cloud).

Troubleshoot and resolve issues related to Kafka brokers, topics, and data flow.

Optimize Kafka configurations for performance, scalability, and fault tolerance.

Plan and execute Kafka version upgrades and apply patches.

Develop and maintain disaster recovery plans.

Create and maintain documentation.


• Security:

Implement and manage security protocols.


• Performance and Monitoring:

Monitor Kafka clusters to ensure optimal performance and availability.

Collect and maintain performance metrics.

Fine-tune Kafka configurations based on performance data.


• Collaboration:

Provide guidance and support to developers using Kafka.

• Automation:

Automate Kafka Cluster installations and topics/acls/connectors deployments using tools like Ansible, terraform, gitops.

Develop and maintain automation for Kafka infrastructure.



Skills and Experience:


• Kafka Administration

Strong understanding of Kafka architecture, concepts, and best practices.

Proven experience in administering Confluent platform Brokers, Zookeepers, Schema registry, Restproxy, Ksql, Connectors and Control Center, Topics, ACLs etc.,

Experience in administering and supporting AWS MSK Clusters.

Experience with Kafka AdminClient for managing topics programmatically.


• Technical Skills:

Experience with monitoring and alerting tools like Prometheus, Grafana, Alertmanager, Dynatrace etc.,

Experience with Linux/Unix operating systems.

Knowledge of software containerization and Kubernetes.

Experience with scripting languages (Python, Shell).

Automate installations and deployments using tools like Ansible, gitops, terraform etc.,

Experience with GitLab pipeline.

Knowledge of Service-Now, JIRA software.


Good to have:

Strong troubleshooting skills.

Excellent communication and collaboration skills.

Ability to work as part of a team and independently.

Experience in providing enhanced support to application teams.





Requirements
BigData and Hadoop Ecosystems~Digital : Apache Spark~Digital : Kafka Experience Range in Required Skills: 6 - 8yrs //Considerable: Overall 5+ yrs Kafka admin - min 2.5yrs

  • Kafka Engineer

    6 days ago

    Bengaluru, India Fractal Full time

    It's fun to work in a company where people truly BELIEVE in what they are doing! Job Summary We are looking for a skilled Kafka Engineer with hands-on experience in Confluent Platform to design, build, and maintain high-performance, real-time data streaming pipelines. The ideal candidate will have expertise in Kafka ecosystem components and be well-versed...

  • Kafka Engineer

    6 days ago

    Bengaluru, India Fractal Full time

    It's fun to work in a company where people truly BELIEVE in what they are doing! Job Summary We are looking for a skilled Kafka Engineer with hands-on experience in Confluent Platform to design, build, and maintain high-performance, real-time data streaming pipelines. The ideal candidate will have expertise in Kafka ecosystem components and be...

  • Kafka Engineer

    7 days ago

    Bengaluru, Karnataka, India Fractal Full time ₹ 1,20,000 - ₹ 2,40,000 per year

    It's fun to work in a company where people truly BELIEVE in what they are doingWe're committed to bringing passion and customer focus to the business.Job SummaryWe are looking for a skilled Kafka Engineer with hands-on experience in Confluent Platform to design, build, and maintain high-performance, real-time data streaming pipelines. The ideal candidate...

  • Kafka Engineer

    2 weeks ago

    Bengaluru, Hyderabad, India Solugenix Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Solugenix is a leader in IT services, delivering cutting-edge technology solutions, exceptional talent, and managed services to global enterprises. With extensive expertise in highly regulated and complex industries, we are a trusted partner for integrating advanced technologies with streamlined processes. Our solutions drive growth, foster innovation, and...

  • Kafka Engineer

    1 week ago

    Bengaluru, Pune, India Tek Ninjas Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role & responsibilitiesDesign and architect scalable Kafka-based data streaming platforms to support real-time data ingestion, processing, and delivery across business-critical systems.Own the full lifecycle of Kafka implementations from initial design and deployment to monitoring, tuning, and support in production environments.Collaborate with...

  • Kafka Integration Engineer

    3 weeks ago

    Bengaluru, India People Prime World Wide Full time

    About Company : Our Client is a largest Top 5 Software giant in India, with over 11.3 USD billion dollars revenue, Global work force 2,40,000 employees, It delivers end-to-end technology, consulting, and business process services to clients across the globe, Presence : 60+ countries and Publicly traded company NSE & BSE (India), NYSE (USA).Job Title : ...

  • Kafka Admin

    3 weeks ago

    Bengaluru, India Surge Technology Solutions Inc Full time

    Job Title: Kafka Admin yrs must) Job location: Bangalore(WFO) JD: 5 + Years of relevant skill Kafka PlatformAdminWe are seeking a highly skilled and motivated Kafka Platform Engineer to join our team. As a Kafka Platform Engineer, you will be responsible for operating and managing our Kafka cluster, ensuring its scalability, reliability, and security. You...

  • Kafka Integration

    3 weeks ago

    Bengaluru, India Wipro Full time

    JD : KAfka: Design and develop Kafka/Kafka connectors data pipelines and integration solutions. Implement and manage Kafka producers, consumers, topics, and partitions. Integrate Kafka with external systems (e.g., databases, APIs, cloud services). Optimize Kafka performance for throughput, latency, and reliability. Collaborate with DevOps, data engineering,...

  • Kafka Integration

    7 days ago

    Bengaluru, Karnataka, India Wipro Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    JD : KAfka:Design and develop Kafka/Kafka connectors data pipelines and integration solutions.Implement and manage Kafka producers, consumers, topics, and partitions.Integrate Kafka with external systems (e.g., databases, APIs, cloud services).Optimize Kafka performance for throughput, latency, and reliability.Collaborate with DevOps, data engineering, and...

  • Kafka Admin

    2 weeks ago

    Bengaluru, India Surge Technology Solutions Inc Full time

    Job Title: Kafka Admin ( 6 - 8yrs must)Job location: Bangalore(WFO)JD:5 + Years of relevant skillKafka Platform Admin We are seeking a highly skilled and motivated Kafka Platform Engineer to join our team. As a Kafka Platform Engineer, you will be responsible for operating and managing our Kafka cluster, ensuring its scalability, reliability, and security....