Kafka Architecture Specialist

2 weeks ago


Hyderabad, Telangana, India Alignity Solutions Full time
Job Summary

We are seeking a highly skilled Kafka Subject Matter Expert (SME) to lead the architecture, management, and scaling of Kafka environments in 24x7 production settings. The ideal candidate will have a deep understanding of Apache Kafka, a proven track record of resolving complex production and non-production issues, and strong leadership capabilities.

Key Responsibilities:
  • Kafka Management:
    • Design, build, manage, and upgrade Kafka clusters in production and non-production environments.
    • Ensure the Kafka infrastructure supports 24x7 availability for mission-critical, customer-facing applications.
    • Monitor Kafka performance and proactively address issues related to scalability, availability, and performance.
  • Incident Management:
    • Troubleshoot and resolve complex Kafka-related production incidents in a timely and efficient manner.
    • Implement strategies to reduce incident resolution time and improve the reliability of Kafka services.
    • Provide root cause analysis and implement long-term fixes for recurring issues.
  • Leadership & Mentoring:
    • Act as a technical leader for Kafka-related projects and initiatives, guiding and mentoring fellow engineers.
    • Lead the efforts in managing, upgrading, and scaling Kafka infrastructure across multiple environments.
    • Provide technical direction and input for key business and infrastructure initiatives, ensuring best practices are followed.
  • Infrastructure as Code (IaC):
    • Develop and maintain Infrastructure as Code (IaC) using Terraform, Helm, and optionally Ansible, to automate Kafka cluster provisioning, scaling, and management.
    • Ensure that Kafka infrastructure is fully automated and scalable, adhering to DevOps and Agile methodologies.
  • Operational Excellence:
    • Establish and follow standard operating procedures for managing Kafka clusters, including patching, upgrading, and scaling.
    • Implement Kafka monitoring and alerting tools to ensure continuous health checks and performance monitoring.
    • Collaborate with DevOps and development teams to integrate Kafka into CI/CD pipelines and ensure seamless delivery of updates and features.
  • Documentation & Continuous Improvement:
    • Maintain comprehensive documentation for Kafka infrastructure, including architectural diagrams, operational processes, and troubleshooting guides.
    • Continuously improve Kafka operations by adopting the latest tools, technologies, and best practices to drive performance and cost efficiency.
Requirements
  • Kafka Expertise: Extensive hands-on experience with Apache Kafka, including Kafka architecture, configuration, and performance tuning.
  • Production Environment Experience: Proven ability to manage Kafka clusters in high-demand, 24x7 customer-facing production environments.
  • Incident Management: Strong experience in diagnosing, troubleshooting, and resolving complex production and non-production incidents in the shortest time possible.
  • Leadership Skills: Ability to lead a team of engineers, provide technical guidance, and mentor junior team members.
  • IaC Expertise: Proficiency in Infrastructure as Code (IaC) using tools like Terraform, Helm, and optionally Ansible.
  • Automation & Monitoring: Experience with automating Kafka operations and using monitoring tools to track the health and performance of Kafka clusters.
  • Problem Solving: Strong analytical and problem-solving skills with the ability to think critically and provide innovative solutions.
  • Self-Motivation: Highly self-organized, motivated, and able to work independently with minimal supervision.
  • Collaboration: Strong communication and collaboration skills, with the ability to work in a fast-paced, cross-functional environment.
Preferred Qualifications:
  • Experience with Ansible: Experience using Ansible for Kafka automation and configuration management is a plus.
  • Cloud Platforms: Familiarity with deploying and managing Kafka in cloud environments such as AWS, Azure, or Google Cloud.
  • DevOps & CI/CD: Hands-on experience integrating Kafka with CI/CD pipelines and DevOps practices.
  • Scripting & Automation: Proficiency in scripting languages such as Python, Bash, or Java for Kafka-related automation tasks.
Benefits

Alignity Solutions is an Equal Opportunity Employer, M/F/V/D.

CEO Message: Click Here

Clients Testimonial: Click Here



  • Hyderabad, Telangana, India Alignity Solutions Full time

    Job Title: Kafka Architecture SpecialistWe are seeking a highly skilled Kafka Architecture Specialist to lead the architecture management and scaling of Kafka environments in 24x7 production settings.Key Responsibilities:Design, build, manage, and upgrade Kafka clusters in production and non-production environments.Ensure the Kafka infrastructure supports...


  • Hyderabad, Telangana, India Alignity Solutions Full time

    Job OverviewWe are seeking a highly skilled Kafka Subject Matter Expert (SME) to lead the architecture, management, and scaling of Kafka environments in 24x7 production settings. As a key member of our team, you will work closely with cross-functional teams, provide technical guidance to junior engineers, and ensure the high availability, scalability, and...


  • Hyderabad, Telangana, India Alignity Solutions Full time

    Job SummaryWe are seeking a highly skilled Kafka Subject Matter Expert (SME) to lead the architecture management and scaling of Kafka environments in 24x7 production settings. The ideal candidate will have a deep understanding of Apache Kafka, a proven track record of resolving complex production and non-production issues, and strong leadership...


  • Hyderabad, Telangana, India Alignity Solutions Full time

    Job DescriptionWe are seeking a highly skilled Kafka Subject Matter Expert (SME) to lead the architecture, management, and scaling of Kafka environments in 24x7 production settings. The ideal candidate will have a deep understanding of Apache Kafka, a proven track record of resolving complex production and non-production issues, and strong leadership...


  • Hyderabad, Telangana, India Alignity Solutions Full time

    Unlock Your Potential as a Kafka ExpertWe are seeking a highly skilled Kafka Subject Matter Expert (SME) to lead the architecture management and scaling of Kafka environments in 24x7 production settings. The ideal candidate will have a deep understanding of Apache Kafka, a proven track record of resolving complex production and non-production issues, and...


  • Hyderabad, Telangana, India Alignity Solutions Full time

    Unlock Your Potential as a Kafka ExpertAre you a skilled professional looking to take your career to the next level? Do you have a passion for Kafka and a desire to work with a leading IT solutions integrator? We are excited to announce an exciting opportunity for a Kafka SME to join our team at Alignity Solutions.Job SummaryWe are seeking a highly skilled...


  • Hyderabad, Telangana, India ValueLabs Full time

    Job Title: Centralized Kafka SpecialistAbout the Role:We are seeking a skilled Centralized Kafka Specialist to join our team at ValueLabs. The ideal candidate will have strong experience with Kafka and its ecosystem, as well as proficiency in Java or another programming language used for Kafka development.Key Responsibilities:Design and implement Kafka...


  • Hyderabad, Telangana, India Alignity Solutions Full time

    Job Title: Kafka SMEWe are seeking a highly skilled Kafka Subject Matter Expert (SME) to lead the architecture, management, and scaling of Kafka environments in 24x7 production settings. The ideal candidate will have a deep understanding of Apache Kafka, a proven track record of resolving complex production and non-production issues, and strong leadership...


  • Hyderabad, Telangana, India Alignity Solutions Full time

    Kafka Infrastructure Specialist RoleWe are seeking a highly skilled Kafka Subject Matter Expert (SME) to lead the architecture management and scaling of Kafka environments in 24x7 production settings. The ideal candidate will have a deep understanding of Apache Kafka, a proven track record of resolving complex production and non-production issues, and strong...


  • Hyderabad, Telangana, India ConsultBae India Private limited Full time

    Job Title: Senior Java Architecture SpecialistAbout the Role:We are seeking a highly skilled Senior Java Architecture Specialist to join our team at ConsultBae India Private Limited. The ideal candidate will have a strong background in designing and implementing scalable, secure, and efficient microservices architecture using J2EE technology.Key...


  • Hyderabad, Telangana, India DSV Full time

    Kafka Specialist & Site Reliability Engineer OpportunityWe are seeking a skilled Kafka Specialist & Site Reliability Engineer to join our Hybrid Computing Platform department in Global IT. As a member of our Event Streaming team, you will be responsible for designing, developing, and maintaining event streaming solutions using Confluent Cloud, Confluent...

  • Kafka Developer

    4 weeks ago


    Hyderabad, Telangana, India ScaleneWorks Full time

    Kafka Developer Job DescriptionJob Summary: We are seeking an experienced Kafka Developer to join our team at ScaleneWorks. The ideal candidate will have a strong background in developing and maintaining high-performance data pipelines and streaming applications using Confluent Kafka.Key Responsibilities:Design, develop, and deploy Confluent Kafka Streams...

  • Kafka Architect

    3 weeks ago


    Hyderabad, Telangana, India ScaleneWorks Full time

    ScaleneWorks - Confluent Kafka DeveloperJob Summary: We are seeking a highly skilled Confluent Kafka Developer to join our team at ScaleneWorks. The ideal candidate will have a strong background in developing high-performance data pipelines and streaming applications using Confluent Kafka.Key Responsibilities:Design, develop, and deploy Confluent Kafka...

  • Kafka Architect

    4 weeks ago


    Hyderabad, Telangana, India Alignity Solutions Full time

    Job Title: Kafka SMEWe are seeking a highly skilled Kafka Subject Matter Expert (SME) to lead the architecture management and scaling of Kafka environments in 24x7 production settings. The ideal candidate will have a deep understanding of Apache Kafka, a proven track record of resolving complex production and non-production issues, and strong leadership...

  • Kafka Architect

    4 weeks ago


    Hyderabad, Telangana, India Alignity Solutions Full time

    Job Title: Kafka SMEWe are seeking a highly skilled Kafka Subject Matter Expert (SME) to lead the architecture, management, and scaling of Kafka environments in 24x7 production settings. The ideal candidate will have a deep understanding of Apache Kafka, a proven track record of resolving complex production and non-production issues, and strong leadership...

  • Kafka Architect

    4 weeks ago


    Hyderabad, Telangana, India Alignity Solutions Full time

    Job Title: Kafka SMEWe are seeking a highly skilled Kafka Subject Matter Expert (SME) to lead the architecture, management, and scaling of Kafka environments in 24x7 production settings.Key Responsibilities:Kafka Management:Design, build, manage, and upgrade Kafka clusters in production and non-production environments.Ensure the Kafka infrastructure supports...

  • Kafka Architect

    3 weeks ago


    Hyderabad, Telangana, India Alignity Solutions Full time

    Job Title: Kafka SMEWe are seeking a highly skilled Kafka Subject Matter Expert (SME) to lead the architecture management and scaling of Kafka environments in 24x7 production settings.Key Responsibilities:Kafka Management:Design, build, manage, and upgrade Kafka clusters in production and non-production environments.Ensure the Kafka infrastructure supports...


  • Hyderabad, Telangana, India DSV Full time

    About the Role:Kafka Systems ArchitectThe Kafka Systems Architect will be responsible for designing and implementing event-driven architectures using Apache Kafka. This includes developing and maintaining Kafka clusters, ensuring high availability, and troubleshooting issues.Key Responsibilities:Design and implement event-driven architectures using Apache...

  • Kafka Architect

    5 days ago


    Hyderabad, Telangana, India Alignity Solutions Full time

    About the RoleWe are looking for a highly skilled Kafka Architect to lead the design, development, and deployment of our Kafka-based data pipeline. As a Kafka Architect, you will be responsible for designing and implementing scalable, fault-tolerant, and high-performance Kafka clusters.Key Responsibilities:Kafka Cluster Design: Design and implement scalable...

  • Kafka Developer

    4 weeks ago


    Hyderabad, Telangana, India ProArch Full time

    Job Title: Sr. Kafka DeveloperProArch is seeking a highly skilled Sr. Kafka Developer to join our team. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining scalable and efficient Kafka-based messaging solutions and microservices applications.Key Responsibilities:Design and Develop Kafka Clusters: Set up...