Engineer - Kafka

1 week ago

Yelahanka, Karnataka, India ANRGI TECH Pvt. Ltd. Full time ₹ 20,00,000 - ₹ 25,00,000 per year
Job Title: Engineer - Kafka

Location: CHENNAI PUNE HYDERABAD KOLKATA BANGALORE PAN India

Job description: must have

• Cluster Management:
Install, configure, and maintain Confluent and AWS MSK Kafka clusters.
Manage large-scale, multi-node Kafka cluster environments (on-prem and cloud).
Troubleshoot and resolve issues related to Kafka brokers, topics, and data flow.
Optimize Kafka configurations for performance, scalability, and fault tolerance.
Plan and execute Kafka version upgrades and apply patches.
Develop and maintain disaster recovery plans.
Create and maintain documentation.

• Security:
Implement and manage security protocols.

• Performance and Monitoring:
Monitor Kafka clusters to ensure optimal performance and availability.
Collect and maintain performance metrics.
Fine-tune Kafka configurations based on performance data.

• Collaboration:
Provide guidance and support to developers using Kafka.

• Automation:
Automate Kafka Cluster installations and topics/acls/connectors deployments using tools like Ansible, terraform, gitops.
Develop and maintain automation for Kafka infrastructure.

Skills and Experience:

• Kafka Administration
Strong understanding of Kafka architecture, concepts, and best practices.
Proven experience in administering Confluent platform Brokers, Zookeepers, Schema registry, Restproxy, Ksql, Connectors and Control Center, Topics, ACLs etc.,
Experience in administering and supporting AWS MSK Clusters.
Experience with Kafka AdminClient for managing topics programmatically.

• Technical Skills:
Experience with monitoring and alerting tools like Prometheus, Grafana, Alertmanager, Dynatrace etc.,
Experience with Linux/Unix operating systems.
Knowledge of software containerization and Kubernetes.
Experience with scripting languages (Python, Shell).
Automate installations and deployments using tools like Ansible, gitops, terraform etc.,
Experience with GitLab pipeline.
Knowledge of Service-Now, JIRA software.

Good to have:
Strong troubleshooting skills.
Excellent communication and collaboration skills.
Ability to work as part of a team and independently.
Experience in providing enhanced support to application teams.

  • Senior Backend Engineer

    1 week ago

    Yelahanka, Karnataka, India AuxoAI Engineering Pvt. Ltd. Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    We're seeking a Senior Backend Developer with 7–10 years of hands-on experience, deep expertise in Python, and strong proficiency in building scalable, real-time backend systems. This role is ideal for someone who has a strong grasp of asynchronous programming, messaging systems, and live data delivery using technologies like WebSockets and Server-Sent...

  • Data Engineer

    13 hours ago

    Yelahanka, India CentricaSoft Full time

    Title: Data Engineer - PySparkAbout CentricaSoft:CentricaSoft is a data-driven technology partner delivering end-to-end data solutions for our clients. We design, build, and scale modern data platforms that empower business decisions. We’re growing our data engineering team and seeking a hands-on PySpark Developer who thrives in a fast-paced, collaborative...

  • Data Engineer

    5 days ago

    Yelahanka, India CentricaSoft Full time

    Title: Data Engineer - PySparkAbout CentricaSoft:CentricaSoft is a data-driven technology partner delivering end-to-end data solutions for our clients. We design, build, and scale modern data platforms that empower business decisions. We’re growing our data engineering team and seeking a hands-on PySpark Developer who thrives in a fast-paced, collaborative...

  • Engineer Ii T500-20338

    3 days ago

    Yelahanka, India lululemon Full time

    About lululemon: lululemon is an innovative performance apparel company for yoga, running, training, and other athletic pursuits. Setting the bar in technical fabrics and functional design, we create transformational products and experiences that support people in moving, growing, connecting, and being well. We owe our success to our innovative products,...

  • Data Engineer

    4 days ago

    Yelahanka, India CentricaSoft Full time

    Title: Data Engineer - PySpark About CentricaSoft: CentricaSoft is a data-driven technology partner delivering end-to-end data solutions for our clients. We design, build, and scale modern data platforms that empower business decisions. We’re growing our data engineering team and seeking a hands-on PySpark Developer who thrives in a fast-paced,...

  • Data Engineer

    4 days ago

    Yelahanka, India CentricaSoft Full time

    Title: Data Engineer - PySparkAbout CentricaSoft:CentricaSoft is a data-driven technology partner delivering end-to-end data solutions for our clients. We design, build, and scale modern data platforms that empower business decisions. We’re growing our data engineering team and seeking a hands-on PySpark Developer who thrives in a fast-paced, collaborative...

  • Ai / Ml Engineer (High Salary)

    18 hours ago

    Yelahanka, India HDFC Bank Full time

    Job Purpose An experienced AI/ML Engineer to design, develop and maintain AI / ML and GenAI based solutions on enterprise platform on Industry best and open-source models at scale along with governance and security frameworks Job Responsibilities (JR): 6 – 8 Areas Actionable (4-6) - Design and implement the necessary infrastructure (e.G., compute clusters,...

  • [15h Left] Senior Engineering Manager

    3 days ago

    Yelahanka, India Walmart Global Tech Full time

    About Team: This is the team which builds reusable technologies that aid in acquiring customers, onboarding and empowering merchants besides ensuring a seamless experience for both these stakeholders. We also optimize tariffs and assortment, adhering to the Walmart philosophy - Everyday Low Cost. In addition to ushering in affordability, we also create...

  • Urgent: Automation Engineer

    3 days ago

    Yelahanka, India Tata Consultancy Services Full time

    TCS has been a great pioneer in feeding the fire of young Techies like you. We are a global leader in the technology arena and there’s nothing that can stop us from growing together. Your role is of key importance, as it lays down the foundation for the entire project. Make sure you have a valid EP number before interview. To create an EP Number, please...