Kafka Administrator
1 day ago
Create, configure, and manage Kafka topics based on the requirements from various teams.Configure consumer groups and manage Kafka queues to ensure efficient data processing.Tune consumer group settings, such as max.poll.records, fetch.min.bytes, and
session.timeout.ms , to optimize throughput and latency.Monitor and resolve issues related to consumer lag, ensuring that data is processed in a timely manner.Adjust broker-level configurations (e.g., log.retention.hours, log.segment.bytes,
zookeeper.connection.timeout.ms ) to maintain optimal performance and stability.Apply updates and patches to Kafka brokers and ensure configurations are in line with best practices.Strong experience with Kafka Components like Producers, Consumers, Topics, Partitions, Brokers, and ZookeeperManage Kafka security settings, including SSL/TLS encryption, Kerberos, and SASL authentication.Configure ACLs (Access Control Lists) to control access to topics and consumer groups, ensuring secure and compliant operations.Work with the Confluent Schema Registry to enforce schema validation and compatibility.Manage versioning of schemas and ensure backward and forward compatibility across different services.Monitor Kafka clusters using tools like Prometheus, Grafana, and Confluent Control Center to track key metrics (e.g., broker CPU usage, disk I/O, topic throughput).Set up and manage alerts for critical issues like broker failures, high consumer lag, and message backlog.Respond to incidents involving Kafka infrastructure, such as broker crashes, network partitions, or performance degradations.Troubleshoot and resolve issues related to topic misconfigurations, consumer group errors, and producer failures.Continuously optimize Kafka performance by adjusting configurations based on observed behavior and workload patterns.
Tools and Technologies Used:Kafka Management: Apache Kafka, Confluent Control CenterMonitoring and Alerts: Prometheus, Grafana, Elasticsearch, Kibana, Confluent Health+Automation: Shell Scripting, Ansible, Jenkins, GitLab CISecurity: SSL/TLS, Kerberos, SASL, ACLsCollaboration: Jira, Confluence, Slack
Qualifications:Strong knowledge and hands-on experience with Apache Kafka and the Confluent Platform.Proficiency in configuring and managing Kafka topics, queues, and consumer groups.Experience with Kafka monitoring, troubleshooting, and performance tuning.Understanding of Kafka security configurations and best practices.
-
Kafka Administrator
3 days ago
Ahmedabad, India SID Global Solutions Full timeExperience:3+ years in Kafka Admin RoleJob Location: AhmedabadPosition: 5 days a week from office(on-site)Create, configure, and manage Kafka topics based on the requirements from various teams.Configure consumer groups and manage Kafka queues to ensure efficient data processing.Tune consumer group settings, such as max.poll.records, fetch.min.bytes, and...
-
Kafka Administrator
3 days ago
ahmedabad, India SID Global Solutions Full timeHi,Join our team to manage and optimize ourApache Kafka clusters!We're looking for an experiencedKafka Adminwho can relocate toGift City, Ahmadabad- Gujratand handle cluster deployment, performance tuning, troubleshooting, and security. Strong skills in Kafka architecture, Linux/Unix, and scripting are essential. If you thrive in a fast-paced environment and...
-
Kafka Administrator
3 weeks ago
Ahmedabad, India SID Global Solutions Full timeHi,Join our team to manage and optimize ourApache Kafka clusters!We're looking for an experiencedKafka Adminwho can relocate toGift City, Ahmadabad- Gujratand handle cluster deployment, performance tuning, troubleshooting, and security. Strong skills in Kafka architecture, Linux/Unix, and scripting are essential. If you thrive in a fast-paced environment and...
-
Kafka Administrator
2 weeks ago
Ahmedabad, India SID Global Solutions Full timeHi, Join our team to manage and optimize our Apache Kafka clusters! We're looking for an experienced Kafka Admin who can relocate to Gift City, Ahmadabad- Gujrat and handle cluster deployment, performance tuning, troubleshooting, and security. Strong skills in Kafka architecture, Linux/Unix, and scripting are essential. If you thrive in a...
-
Kafka Administrator
3 weeks ago
Ahmedabad, India SID Global Solutions Full timeHi,Join our team to manage and optimize our Apache Kafka clusters! We're looking for an experienced Kafka Admin who can relocate to Gift City, Ahmadabad- Gujrat and handle cluster deployment, performance tuning, troubleshooting, and security. Strong skills in Kafka architecture, Linux/Unix, and scripting are essential. If you thrive in a fast-paced...
-
Kafka Administrator
4 days ago
ahmedabad, India SID Global Solutions Full timeHi,Join our team to manage and optimize our Apache Kafka clusters! We're looking for an experienced Kafka Admin who can relocate to Gift City, Ahmadabad- Gujrat and handle cluster deployment, performance tuning, troubleshooting, and security. Strong skills in Kafka architecture, Linux/Unix, and scripting are essential. If you thrive in a fast-paced...
-
Kafka Administrator
3 weeks ago
Ahmedabad, India SID Global Solutions Full timeHi,Join our team to manage and optimize our Apache Kafka clusters! We're looking for an experienced Kafka Admin who can relocate to Gift City, Ahmadabad- Gujrat and handle cluster deployment, performance tuning, troubleshooting, and security. Strong skills in Kafka architecture, Linux/Unix, and scripting are essential. If you thrive in a fast-paced...
-
Kafka Administrator
3 weeks ago
Ahmedabad, India SID Global Solutions Full timeHi, Join our team to manage and optimize our Apache Kafka clusters! We're looking for an experienced Kafka Admin who can relocate to Gift City, Ahmadabad- Gujrat and handle cluster deployment, performance tuning, troubleshooting, and security. Strong skills in Kafka architecture, Linux/Unix, and scripting are essential. If you thrive in a fast-paced...
