Kafka Administrator

Education Criteria: 

• Qualified Professionals from Premium Institutes in B.E / B. Tech in Computer Science 

Experience Level: 

• 3-7 yrs or more years of demonstrated skill and experience in the design, installation, monitoring, and troubleshooting of messaging infrastructure such as RabbitMQ and Kafka in self-hosted and cloud environments is required. 

Technical Skills (Essential): 

• Minimum 3+ years of experience in IT Industry 

• Experience integrating Kafka with other technology products. 

• Understanding cloud data streaming technologies (Kafka/ksqlDB, StreamSets, AWS Kinesis, Google Cloud 
Platform PubSub, etc.), stream processing, event-driven architectures 

• Knowing techniques for data injection and extraction into/from Kafka-based or similar pipelines 

• Working knowledge on Kafka Rest proxy. 

• Experience in Installation, Configuration and Administration of Rabbit MQ on UNIX/Cloud environments.

• Strong knowledge on Message oriented middleware concepts including different Messaging styles 

• (Asynchronous, pub-sub), Messaging APIs (JMS, STOMP, AMQP, REST). 

• Setting up of exchanges, queues, and virtual hosts. 

• Implementation experience in Clustering, Security and High Availability of Rabbit MQ nodes. 

• Monitoring Alarms of Rabbit MQ. 

• Troubleshooting and migration of Rabbit MQ. 

• Experience and knowledge with Cloud (AWS MQ) 

• Expertise in deploying and maintaining in Cloud environments. 

• Willing to work in shifts 

Technical Skills (Desirable): 

• Experience and knowledge of common issues associated with RHEL Servers and strong verbal and written communication skills 

• Good scripting skills (Python, etc.); experience with Java
• Strong skills in In-memory applications and Data Integration. 

• Working knowledge of Ansible & Automation 

• Knowledge of Kubernetes is plus 

• Excellent communication skills 

• Prioritize and manage several open issues at one time and ensure all issues are properly logged
•Comfortable working in a team, also with members of other teams (Development & QA) when needed. 

• Ability to quickly learn new technologies, tools and environments. 

Roles & Responsibilities: 

• Standing up and administer On-Prem & cloud-native Kafka clusters. 

• Ability to architect and create a reference architecture for Kafka Implementation standards 

• Provide expertise in Kafka brokers, zookeepers, Kafka connect, schema registry, KSQL, Rest proxy and Kafka Control center. 

• Ensure optimum performance, high availability and stability of solutions 

• Provide expertise and hands on experience working on Kafka connect using schema registry in a very high volume 

• Provide administration and operations of the Kafka platform like provisioning, access lists Kerberos and SSL configurations. 

• Provide expertise and hands on experience working on Kafka connectors such as MQ connectors, Elastic Search 
connectors, JDBC connectors, File stream connector, JMS source connectors, Tasks, Workers, converters, Transforms. 

• Provide expertise and hands on experience on custom connectors using the Kafka core concepts and API. 

• Involve in design and capacity review meetings to provide suggestions in Kafka usage. 

• Participate in work planning and estimation 

• Ensure optimum performance, high availability and stability of solutions. 

• Create topics, setup redundancy cluster, deploy monitoring tools, alerts and has good knowledge of best practices. 

• Create stubs for producers, consumers and consumer groups for helping onboard applications from different languages/platforms. 

• Use automation tools like provisioning using Docker, Jenkins, and GitLab. 

• Setting up security on Kafka, Monitor, prevent, and troubleshoot security-related issues. 

• Ability to perform data related benchmarking, performance analysis and tuning. 

• Competent working in one or more environments highly integrated with an operating system. 

• Ability to manage tasks independently and take ownership of responsibilities 

• Ability to communicate highly complex technical information clearly and articulately for all levels and audiences

Location: 

• Chennai