Engineer - Kafka

6 days ago


Yelahanka, Karnataka, India ANRGI TECH Pvt. Ltd. Full time ₹ 20,00,000 - ₹ 25,00,000 per year
Job Title: Engineer - Kafka

Location: CHENNAI PUNE HYDERABAD KOLKATA BANGALORE PAN India

Job description: must have

• Cluster Management:
Install, configure, and maintain Confluent and AWS MSK Kafka clusters.
Manage large-scale, multi-node Kafka cluster environments (on-prem and cloud).
Troubleshoot and resolve issues related to Kafka brokers, topics, and data flow.
Optimize Kafka configurations for performance, scalability, and fault tolerance.
Plan and execute Kafka version upgrades and apply patches.
Develop and maintain disaster recovery plans.
Create and maintain documentation.

• Security:
Implement and manage security protocols.

• Performance and Monitoring:
Monitor Kafka clusters to ensure optimal performance and availability.
Collect and maintain performance metrics.
Fine-tune Kafka configurations based on performance data.

• Collaboration:
Provide guidance and support to developers using Kafka.

• Automation:
Automate Kafka Cluster installations and topics/acls/connectors deployments using tools like Ansible, terraform, gitops.
Develop and maintain automation for Kafka infrastructure.

Skills and Experience:

• Kafka Administration
Strong understanding of Kafka architecture, concepts, and best practices.
Proven experience in administering Confluent platform Brokers, Zookeepers, Schema registry, Restproxy, Ksql, Connectors and Control Center, Topics, ACLs etc.,
Experience in administering and supporting AWS MSK Clusters.
Experience with Kafka AdminClient for managing topics programmatically.

• Technical Skills:
Experience with monitoring and alerting tools like Prometheus, Grafana, Alertmanager, Dynatrace etc.,
Experience with Linux/Unix operating systems.
Knowledge of software containerization and Kubernetes.
Experience with scripting languages (Python, Shell).
Automate installations and deployments using tools like Ansible, gitops, terraform etc.,
Experience with GitLab pipeline.
Knowledge of Service-Now, JIRA software.

Good to have:
Strong troubleshooting skills.
Excellent communication and collaboration skills.
Ability to work as part of a team and independently.
Experience in providing enhanced support to application teams.



  • Yelahanka, Karnataka, India AuxoAI Engineering Pvt. Ltd. Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    We're seeking a Senior Backend Developer with 7–10 years of hands-on experience, deep expertise in Python, and strong proficiency in building scalable, real-time backend systems. This role is ideal for someone who has a strong grasp of asynchronous programming, messaging systems, and live data delivery using technologies like WebSockets and Server-Sent...

  • Senior AI/ML Engineer

    2 weeks ago


    Yelahanka, Karnataka, India Prosperlink Global Pvt Full time ₹ 6,00,000 - ₹ 8,40,000 per year

    Job Title: Senior AI/ML Engineer (LLMs, Voice AI, and Mobile Integration)About the Role.We are seeking a highly skilled and versatile Senior AI/ML Engineer to join our team and drive the development of next-generation AI-powered products. This role requires an individual with proven expertise in designing, deploying, and scaling advanced machine learning...

  • Lead I

    2 weeks ago


    Yelahanka, Karnataka, India ANRGI TECH Pvt. Ltd. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Senior Machine Learning Engineer Experience: 8+ years Location: Bengaluru (Hybrid) Responsibilities: Design, develop, and deploy machine learning models and algorithms for production use with clear SLAs. Build and maintain scalable, reliable data pipelines (batch and streaming) for training and inference. Perform exploratory data...

  • Senior Data Engineer

    3 weeks ago


    Yelahanka, India Josys Full time

    Location: Bengaluru, Karnataka, India About The Role We're looking for an experienced Senior Data Engineer (6-8 years) to join our data team. You'll be key in building and maintaining our data systems on AWS. You'll use your strong skills in big data tools and cloud technology to help our analytics team get valuable insights from our data. You'll be in...

  • Data Engineer

    3 weeks ago


    Yelahanka, India CentricaSoft Full time

    Title: Data Engineer - PySparkAbout CentricaSoft:CentricaSoft is a data-driven technology partner delivering end-to-end data solutions for our clients. We design, build, and scale modern data platforms that empower business decisions. We’re growing our data engineering team and seeking a hands-on PySpark Developer who thrives in a fast-paced, collaborative...

  • Data engineer

    3 weeks ago


    Yelahanka, India CentricaSoft Full time

    Title: Data Engineer - Py SparkAbout Centrica Soft:Centrica Soft is a data-driven technology partner delivering end-to-end data solutions for our clients. We design, build, and scale modern data platforms that empower business decisions. We’re growing our data engineering team and seeking a hands-on Py Spark Developer who thrives in a fast-paced,...


  • Yelahanka, India lululemon Full time

    About lululemon: lululemon is an innovative performance apparel company for yoga, running, training, and other athletic pursuits. Setting the bar in technical fabrics and functional design, we create transformational products and experiences that support people in moving, growing, connecting, and being well. We owe our success to our innovative products,...

  • Data Engineer

    4 weeks ago


    Yelahanka, India CentricaSoft Full time

    Title: Data Engineer - PySpark About CentricaSoft: CentricaSoft is a data-driven technology partner delivering end-to-end data solutions for our clients. We design, build, and scale modern data platforms that empower business decisions. We’re growing our data engineering team and seeking a hands-on PySpark Developer who thrives in a fast-paced,...

  • Data Engineer

    4 weeks ago


    Yelahanka, India CentricaSoft Full time

    Title: Data Engineer - PySparkAbout CentricaSoft:CentricaSoft is a data-driven technology partner delivering end-to-end data solutions for our clients. We design, build, and scale modern data platforms that empower business decisions. We’re growing our data engineering team and seeking a hands-on PySpark Developer who thrives in a fast-paced, collaborative...


  • Yelahanka, India DecisionX AI Full time

    Job description Title : Senior Backend Engineer | Founding Team Location: Bengaluru / Hybrid Experience: 6–10 years Type: Full-time | Founding Team | About DecisionX www.Decisionx.Ai We’re building a Self-Learning, Context-Aware Decision AI — one that uses Ontology, Context, and AI Agents to reimagine how humans and organisations make complex...


  • Yelahanka, India Societe Generale Global Solution Centre Full time

    Responsibilities: The role is a Senior Data Engineer who will help shape the future of data-driven auditing. With 7 - 10 years of experience, you will design and maintain scalable data pipelines, ensure compliance with global data regulations (including GDPR), and empower auditors/inspectors with high-quality data and advanced analytics. You will masterize...


  • Yelahanka, India Hithonix Solutions Private Limited Full time

    About Hithonix Solutions Pvt Ltd: Hithonix Solutions Pvt Ltd is a forward-looking technology company committed to delivering innovative software solutions that drive business success for our clients. Founded on the principles of quality, integrity, and excellence, we operate in a collaborative environment where creativity, learning, and growth are...


  • Yelahanka, India Eltropy Full time

    Role Overview: We’re looking for someone with 5+ years of experience in data engineering, analytics, and ML-based solutions. Job Responsibilities - Design and manage scalable ETL/ELT pipelines using AWS Glue, Redshift, S3, and Kafka/Kinesis. - Architect and implement data lake and warehouse solutions following best practices. - Build and deploy ML models...