Kafka Architect

Kafka Architect (Kafka Event Hub Stream) Job Description:The Kafka Architect will be a senior architect/engineer responsible for designing, implementing, and advising on large-scale Confluent Kafka platforms. This role involves guiding the overall direction of the Kafka platform, ensuring alignment with business objectives and collaborating with various technology stakeholders. Roles and Responsibilities: * Lead the design and architecture of large-scale Confluent Kafka platforms. * Develop and maintain architectural artifacts for Kafka solutions. * Ensure Kafka platform meets requirements for performance, scalability, reliability, and security. * Provide expert guidance on Kafka best practices, including topic design, partitioning, replication, and security. * Collaborate with development teams, other architects, and operations. * Partner with technology decision-makers to guide the overall direction of the platform. * Identify and implement optimizations for Kafka clusters. Years of Experience: 7-10+ yearsPrimary Skillset:** Confluent Kafka, Apache Kafka, Kafka Streams, KSQL, ZooKeeper, Event-driven architecture.Secondary Skillset: ** Java/Scala development, Kubernetes/Cloud deployment for Kafka, Monitoring tools (e.g., Prometheus, Grafana).Must-have Skills: * Proven experience in designing and implementing large-scale Confluent Kafka platforms. * Deep understanding of Kafka architecture, core concepts, and ecosystem components (Connect, Streams, Schema Registry). * Experience with Kafka security (authentication, authorization, encryption). * Hands-on experience with Kafka cluster administration, monitoring, and troubleshooting.Good-to-have Skills: * Confluent Certified Developer/Administrator for Apache Kafka. * Experience with deploying Kafka on Kubernetes. * Knowledge of other streaming technologies.