kafka Admin

3 weeks ago


Sany, India SPG Consulting Full time
OverviewThe KafkaAdmin plays a crucial role in managing and maintaining Apache Kafkaclusters and ensuring their optimal performance. This position isvital in ensuring the smooth and efficient functioning of the Kafkainfrastructure which is essential for realtime data processing andanalytics within the organization. The Kafka Admin collaborateswith various teams to understand their data processing needs andimplements robust Kafka clusters to support theserequirements.Keyresponsibilities
  • Install configureand maintain Kafka clusters across development testing andproduction environments.
  • Establish and enforceKafka security protocols ensuring data confidentiality andintegrity.
  • Monitor Kafka performancetroubleshoot issues and optimize clusterefficiency.
  • Implement highavailability anddisaster recovery solutions for Kafkaclusters.
  • Collaborate with development teams todesign and implement Kafka topics partitions and partitionsreplicas.
  • Manage and maintain Kafka connectorsfor seamless data integration.
  • Implement andmanage Kafka schema registry for data quality andconsistency.
  • Conduct regular Kafka clusterhealth checks and capacity planning.
  • Developand maintain documentation related to Kafka architecture processesand procedures.
  • Participate in oncall supportfor Kafkarelated incidents andissues.
Requiredqualifications
  • Bachelors degree inComputer Science Information Technology or a relatedfield.
  • Proven experience in administratingApache Kafka clusters in a productionenvironment.
  • Strong understanding of Kafkaarchitecture configuration and performancetuning.
  • Proficient in Kafka securityimplementation and best practices.
  • Experiencein integrating Kafka with monitoring and logging tools for realtimecluster oversight.
  • Proficiency in scriptinglanguages such as Python Bash or PowerShell for automation andmonitoring tasks.
  • Solid understanding ofnetworking principles and TCP/IP protocolsuite.
  • Experience with Kafka ecosystemcomponents like Kafka Connect KSQL and KafkaStreams.
  • Ability to work in a fastpacedenvironment and prioritize taskseffectively.
  • Excellent problemsolving andcommunication skills.

apachekafka,troubleshooting,disaster recovery,documentation,kafkaconnect,python,powershell,kafka,monitoring,bash,securityprotocols,schema registry,cluster management,ksql,dataintegration,kafka streams,tcp/ip protocol suite,networkingprinciples,capacity planning,cluster


  • kafka Admin

    1 week ago


    sany, India SPG Consulting Full time

    Overview The KafkaAdmin plays a crucial role in managing and maintaining Apache Kafkaclusters and ensuring their optimal performance. This position isvital in ensuring the smooth and efficient functioning of the Kafkainfrastructure which is essential for realtime data processing andanalytics within the organization. The Kafka Admin collaborateswith various...