Kafka Administrator
3 weeks ago
Experience:3+ years in Kafka Admin Role Job Location: Ahmedabad Position: 5 days a week from office(on-site) Create, configure, and manage Kafka topics based on the requirements from various teams. Configure consumer groups and manage Kafka queues to ensure efficient data processing. Tune consumer group settings, such as max.poll.records, fetch.min.bytes, and session.timeout.ms , to optimize throughput and latency. Monitor and resolve issues related to consumer lag, ensuring that data is processed in a timely manner. Adjust broker-level configurations (e.g., log.retention.hours, log.segment.bytes, zookeeper.connection.timeout.ms ) to maintain optimal performance and stability. Apply updates and patches to Kafka brokers and ensure configurations are in line with best practices. Strong experience with Kafka Components like Producers, Consumers, Topics, Partitions, Brokers, and Zookeeper Manage Kafka security settings, including SSL/TLS encryption, Kerberos, and SASL authentication. Configure ACLs (Access Control Lists) to control access to topics and consumer groups, ensuring secure and compliant operations. Work with the Confluent Schema Registry to enforce schema validation and compatibility. Manage versioning of schemas and ensure backward and forward compatibility across different services. Monitor Kafka clusters using tools like Prometheus, Grafana, and Confluent Control Center to track key metrics (e.g., broker CPU usage, disk I/O, topic throughput). Set up and manage alerts for critical issues like broker failures, high consumer lag, and message backlog. Respond to incidents involving Kafka infrastructure, such as broker crashes, network partitions, or performance degradations. Troubleshoot and resolve issues related to topic misconfigurations, consumer group errors, and producer failures. Continuously optimize Kafka performance by adjusting configurations based on observed behavior and workload patterns. Tools and Technologies Used: Kafka Management: Apache Kafka, Confluent Control Center Monitoring and Alerts: Prometheus, Grafana, Elasticsearch, Kibana, Confluent Health+ Automation: Shell Scripting, Ansible, Jenkins, GitLab CI Security: SSL/TLS, Kerberos, SASL, ACLs Collaboration: Jira, Confluence, Slack Qualifications: Strong knowledge and hands-on experience with Apache Kafka and the Confluent Platform. Proficiency in configuring and managing Kafka topics, queues, and consumer groups. Experience with Kafka monitoring, troubleshooting, and performance tuning. Understanding of Kafka security configurations and best practices.
-
Kafka Administrator
3 weeks ago
ahmedabad, India SID Global Solutions Full timeExperience:3+ years in Kafka Admin RoleJob Location: AhmedabadPosition: 5 days a week from office(on-site)Create, configure, and manage Kafka topics based on the requirements from various teams.Configure consumer groups and manage Kafka queues to ensure efficient data processing.Tune consumer group settings, such as max.poll.records, fetch.min.bytes, and...
-
Kafka administrator
3 weeks ago
Ahmedabad, India SID Global Solutions Full timeExperience:3+ years in Kafka Admin Role Job Location: Ahmedabad Position: 5 days a week from office(on-site) Create, configure, and manage Kafka topics based on the requirements from various teams. Configure consumer groups and manage Kafka queues to ensure efficient data processing. Tune consumer group settings, such as max.poll.records,...
-
Kafka Administrator
2 months ago
Ahmedabad, India SID Global Solutions Full timeExperience:3+ years in Kafka Admin RoleJob Location: AhmedabadPosition: 5 days a week from office(on-site)Create, configure, and manage Kafka topics based on the requirements from various teams.Configure consumer groups and manage Kafka queues to ensure efficient data processing.Tune consumer group settings, such as max.poll.records, fetch.min.bytes, and...
-
Kafka Cluster Architect
3 weeks ago
Ahmedabad, Gujarat, India SID Global Solutions Full timeKafka Administrator Job DescriptionAt SID Global Solutions, we are seeking a highly skilled Kafka Administrator to join our team. As a Kafka Administrator, you will be responsible for designing, implementing, and managing Kafka clusters to ensure efficient data processing and real-time data streaming.Key Responsibilities:Design and implement Kafka clusters...
-
Kafka Cluster Manager
3 weeks ago
Ahmedabad, Gujarat, India SID Global Solutions Full timeKafka Administrator Job DescriptionWe are seeking a highly skilled Kafka Administrator to join our team at SID Global Solutions. As a key member of our infrastructure team, you will be responsible for designing, implementing, and managing our Apache Kafka clusters to ensure high-performance, scalability, and reliability.Key Responsibilities:Design and...
-
Ahmedabad, Gujarat, India Infraveo Full timeAbout the RoleThis is a remote position that requires a highly skilled DevOps Engineer to provide database infrastructure and Linux server infrastructure and software support for all production systems.The ideal candidate will have experience in designing and implementing configuration management and automation tools for infrastructure provisioning and...
-
Linux Systems Engineer
2 weeks ago
Ahmedabad, Gujarat, India Infraveo Full timeJob DescriptionWe are seeking a highly skilled Linux Systems Engineer to join our team at Infraveo. As a key member of our infrastructure team, you will be responsible for designing, building, and maintaining our Linux systems and database infrastructure.Key Responsibilities:Design and implement configuration management and automation tools for...
-
Ahmedabad, Gujarat, India Infraveo Full timeAbout the RoleThis is a remote position that requires a highly skilled DevOps Engineer to provide database infrastructure Linux server infrastructure and software support for all production systems.Key ResponsibilitiesDesign and implement configuration management and automation tools for infrastructure provisioning and application release.Provide database...
-
Linux Systems Engineer
2 weeks ago
Ahmedabad, Gujarat, India Infraveo Full timeJob DescriptionThis is a remote position that requires an experienced individual to provide database infrastructure and Linux server support for all production systems.The successful candidate will be responsible for designing and implementing configuration management and automation tools for infrastructure provisioning and application release.Key...
