 
						Engineer - Kafka
6 days ago
Location: CHENNAI PUNE HYDERABAD KOLKATA BANGALORE PAN India
Job description: must have• Cluster Management:
Install, configure, and maintain Confluent and AWS MSK Kafka clusters.
Manage large-scale, multi-node Kafka cluster environments (on-prem and cloud).
Troubleshoot and resolve issues related to Kafka brokers, topics, and data flow.
Optimize Kafka configurations for performance, scalability, and fault tolerance.
Plan and execute Kafka version upgrades and apply patches.
Develop and maintain disaster recovery plans.
Create and maintain documentation.
• Security:
Implement and manage security protocols.
• Performance and Monitoring:
Monitor Kafka clusters to ensure optimal performance and availability.
Collect and maintain performance metrics.
Fine-tune Kafka configurations based on performance data.
• Collaboration:
Provide guidance and support to developers using Kafka.
• Automation:
Automate Kafka Cluster installations and topics/acls/connectors deployments using tools like Ansible, terraform, gitops.
Develop and maintain automation for Kafka infrastructure.
Skills and Experience:
• Kafka Administration
Strong understanding of Kafka architecture, concepts, and best practices.
Proven experience in administering Confluent platform Brokers, Zookeepers, Schema registry, Restproxy, Ksql, Connectors and Control Center, Topics, ACLs etc.,
Experience in administering and supporting AWS MSK Clusters.
Experience with Kafka AdminClient for managing topics programmatically.
• Technical Skills:
Experience with monitoring and alerting tools like Prometheus, Grafana, Alertmanager, Dynatrace etc.,
Experience with Linux/Unix operating systems.
Knowledge of software containerization and Kubernetes.
Experience with scripting languages (Python, Shell).
Automate installations and deployments using tools like Ansible, gitops, terraform etc.,
Experience with GitLab pipeline.
Knowledge of Service-Now, JIRA software.
Good to have:
Strong troubleshooting skills.
Excellent communication and collaboration skills.
Ability to work as part of a team and independently.
Experience in providing enhanced support to application teams.
- 
					  Senior Backend Engineer1 week ago 
 Yelahanka, Karnataka, India AuxoAI Engineering Pvt. Ltd. Full time ₹ 8,00,000 - ₹ 24,00,000 per yearWe're seeking a Senior Backend Developer with 7–10 years of hands-on experience, deep expertise in Python, and strong proficiency in building scalable, real-time backend systems. This role is ideal for someone who has a strong grasp of asynchronous programming, messaging systems, and live data delivery using technologies like WebSockets and Server-Sent... 
- 
					  Senior AI/ML Engineer2 weeks ago 
 Yelahanka, Karnataka, India Prosperlink Global Pvt Full time ₹ 6,00,000 - ₹ 8,40,000 per yearJob Title: Senior AI/ML Engineer (LLMs, Voice AI, and Mobile Integration)About the Role.We are seeking a highly skilled and versatile Senior AI/ML Engineer to join our team and drive the development of next-generation AI-powered products. This role requires an individual with proven expertise in designing, deploying, and scaling advanced machine learning... 
- 
					  Lead I2 weeks ago 
 Yelahanka, Karnataka, India ANRGI TECH Pvt. Ltd. Full time ₹ 12,00,000 - ₹ 36,00,000 per yearSenior Machine Learning Engineer Experience: 8+ years Location: Bengaluru (Hybrid) Responsibilities: Design, develop, and deploy machine learning models and algorithms for production use with clear SLAs. Build and maintain scalable, reliable data pipelines (batch and streaming) for training and inference. Perform exploratory data... 
- 
					  Senior Data Engineer3 weeks ago 
 Yelahanka, India Josys Full timeLocation: Bengaluru, Karnataka, India About The Role We're looking for an experienced Senior Data Engineer (6-8 years) to join our data team. You'll be key in building and maintaining our data systems on AWS. You'll use your strong skills in big data tools and cloud technology to help our analytics team get valuable insights from our data. You'll be in... 
- 
					  Data Engineer3 weeks ago 
 Yelahanka, India CentricaSoft Full timeTitle: Data Engineer - PySparkAbout CentricaSoft:CentricaSoft is a data-driven technology partner delivering end-to-end data solutions for our clients. We design, build, and scale modern data platforms that empower business decisions. We’re growing our data engineering team and seeking a hands-on PySpark Developer who thrives in a fast-paced, collaborative... 
- 
					  Data engineer3 weeks ago 
 Yelahanka, India CentricaSoft Full timeTitle: Data Engineer - Py SparkAbout Centrica Soft:Centrica Soft is a data-driven technology partner delivering end-to-end data solutions for our clients. We design, build, and scale modern data platforms that empower business decisions. We’re growing our data engineering team and seeking a hands-on Py Spark Developer who thrives in a fast-paced,... 
- 
					  Engineer Ii T500-203383 weeks ago 
 Yelahanka, India lululemon Full timeAbout lululemon: lululemon is an innovative performance apparel company for yoga, running, training, and other athletic pursuits. Setting the bar in technical fabrics and functional design, we create transformational products and experiences that support people in moving, growing, connecting, and being well. We owe our success to our innovative products,... 
- 
					  Data Engineer4 weeks ago 
 Yelahanka, India CentricaSoft Full timeTitle: Data Engineer - PySpark About CentricaSoft: CentricaSoft is a data-driven technology partner delivering end-to-end data solutions for our clients. We design, build, and scale modern data platforms that empower business decisions. We’re growing our data engineering team and seeking a hands-on PySpark Developer who thrives in a fast-paced,... 
- 
					  Data Engineer4 weeks ago 
 Yelahanka, India CentricaSoft Full timeTitle: Data Engineer - PySparkAbout CentricaSoft:CentricaSoft is a data-driven technology partner delivering end-to-end data solutions for our clients. We design, build, and scale modern data platforms that empower business decisions. We’re growing our data engineering team and seeking a hands-on PySpark Developer who thrives in a fast-paced, collaborative... 
- 
					  Senior Backend Engineer | Founding Team3 days ago 
 Yelahanka, India DecisionX AI Full timeJob description Title : Senior Backend Engineer | Founding Team Location: Bengaluru / Hybrid Experience: 6–10 years Type: Full-time | Founding Team | About DecisionX www.Decisionx.Ai We’re building a Self-Learning, Context-Aware Decision AI — one that uses Ontology, Context, and AI Agents to reimagine how humans and organisations make complex... 
- 
					  Senior Data Engineer1 day ago 
 Yelahanka, India Societe Generale Global Solution Centre Full timeResponsibilities: The role is a Senior Data Engineer who will help shape the future of data-driven auditing. With 7 - 10 years of experience, you will design and maintain scalable data pipelines, ensure compliance with global data regulations (including GDPR), and empower auditors/inspectors with high-quality data and advanced analytics. You will masterize... 
- 
					  Apply in 3 Minutes: Data Engineer1 day ago 
 Yelahanka, India Hithonix Solutions Private Limited Full timeAbout Hithonix Solutions Pvt Ltd: Hithonix Solutions Pvt Ltd is a forward-looking technology company committed to delivering innovative software solutions that drive business success for our clients. Founded on the principles of quality, integrity, and excellence, we operate in a collaborative environment where creativity, learning, and growth are... 
- 
					  15h Left! Lead Data Engineer5 days ago 
 Yelahanka, India Eltropy Full timeRole Overview: We’re looking for someone with 5+ years of experience in data engineering, analytics, and ML-based solutions. Job Responsibilities - Design and manage scalable ETL/ELT pipelines using AWS Glue, Redshift, S3, and Kafka/Kinesis. - Architect and implement data lake and warehouse solutions following best practices. - Build and deploy ML models...