Kafka Architect

3 weeks ago

Hyderabad, Telangana, India Alignity Solutions Full time
Job Title: Kafka SME

We are seeking a highly skilled Kafka Subject Matter Expert (SME) to lead the architecture management and scaling of Kafka environments in 24x7 production settings. The ideal candidate will have a deep understanding of Apache Kafka, a proven track record of resolving complex production and non-production issues, and strong leadership capabilities.

Key Responsibilities:
  • Kafka Management:
    • Design, build, manage, and upgrade Kafka clusters in production and non-production environments.
    • Ensure the Kafka infrastructure supports 24x7 availability for mission-critical customer-facing applications.
    • Monitor Kafka performance and proactively address issues related to scalability, availability, and performance.
  • Incident Management:
    • Troubleshoot and resolve complex Kafka-related production incidents in a timely and efficient manner.
    • Implement strategies to reduce incident resolution time and improve the reliability of Kafka services.
    • Provide root cause analysis and implement long-term fixes for recurring issues.
  • Leadership & Mentoring:
    • Act as a technical leader for Kafka-related projects and initiatives, guiding and mentoring fellow engineers.
    • Lead the efforts in managing, upgrading, and scaling Kafka infrastructure across multiple environments.
    • Provide technical direction and input for key business and infrastructure initiatives, ensuring best practices are followed.
  • Infrastructure as Code (IaC):
    • Develop and maintain Infrastructure as Code (IaC) using Terraform, Helm, and optionally Ansible to automate Kafka cluster provisioning, scaling, and management.
    • Ensure that Kafka infrastructure is fully automated and scalable, adhering to DevOps and Agile methodologies.
  • Operational Excellence:
    • Establish and follow standard operating procedures for managing Kafka clusters, including patching, upgrading, and scaling.
    • Implement Kafka monitoring and alerting tools to ensure continuous health checks and performance monitoring.
    • Collaborate with DevOps and development teams to integrate Kafka into CI/CD pipelines and ensure seamless delivery of updates and features.
  • Documentation & Continuous Improvement:
    • Maintain comprehensive documentation for Kafka infrastructure, including architectural diagrams, operational processes, and troubleshooting guides.
    • Continuously improve Kafka operations by adopting the latest tools, technologies, and best practices to drive performance and cost efficiency.
Required Skills & Qualifications:
  • Kafka Expertise: Extensive hands-on experience with Apache Kafka, including Kafka architecture, configuration, and performance tuning.
  • Production Environment Experience: Proven ability to manage Kafka clusters in high-demand, 24x7 customer-facing production environments.
  • Incident Management: Strong experience in diagnosing, troubleshooting, and resolving complex production and non-production incidents in the shortest time possible.
  • Leadership Skills: Ability to lead a team of engineers, provide technical guidance, and mentor junior team members.
  • IaC Expertise: Proficiency in Infrastructure as Code (IaC) using tools like Terraform, Helm, and optionally Ansible.
  • Automation & Monitoring: Experience with automating Kafka operations and using monitoring tools to track the health and performance of Kafka clusters.
  • Problem Solving: Strong analytical and problem-solving skills with the ability to think critically and provide innovative solutions.
  • Self-Motivation: Highly self-organized, motivated, and able to work independently with minimal supervision.
  • Collaboration: Strong communication and collaboration skills with the ability to work in a fast-paced, cross-functional environment.
Preferred Qualifications:
  • Experience with Ansible: Experience using Ansible for Kafka automation and configuration management is a plus.
  • Cloud Platforms: Familiarity with deploying and managing Kafka in cloud environments such as AWS, Azure, or Google Cloud.
  • DevOps & CI/CD: Hands-on experience integrating Kafka with CI/CD pipelines and DevOps practices.
  • Scripting & Automation: Proficiency in scripting languages such as Python, Bash, or Java for Kafka-related automation tasks.
Benefits:

Alignity Solutions is an Equal Opportunity Employer M/F/V/D.

CEOMessage: Click Here

Clients Testimonial: Click Here

  • Kafka Architect

    3 days ago

    Hyderabad, Telangana, India Alignity Solutions Full time

    About the RoleWe are looking for a highly skilled Kafka Architect to lead the design, development, and deployment of our Kafka-based data pipeline. As a Kafka Architect, you will be responsible for designing and implementing scalable, fault-tolerant, and high-performance Kafka clusters.Key Responsibilities:Kafka Cluster Design: Design and implement scalable...

  • Kafka Systems Architect

    6 days ago

    Hyderabad, Telangana, India DSV Full time

    About the Role:Kafka Systems ArchitectThe Kafka Systems Architect will be responsible for designing and implementing event-driven architectures using Apache Kafka. This includes developing and maintaining Kafka clusters, ensuring high availability, and troubleshooting issues.Key Responsibilities:Design and implement event-driven architectures using Apache...

  • Kafka Systems Architect

    4 days ago

    Hyderabad, Telangana, India Tata Consultancy Services Full time

    Tata Consultancy Services is seeking a skilled Kafka Systems Architect to join our team.Key Responsibilities:Design and implement event-driven architecture using KafkaDevelop and maintain high-performance Kafka clustersCollaborate with cross-functional teams to integrate Kafka with other systemsRequirements:5-8 years of experience in designing and...

  • Kafka Architect Lead

    4 days ago

    Hyderabad, Telangana, India Qode Full time

    Kafka Architect Lead PositionAt Qode, we are looking for a seasoned expert in designing and implementing scalable Kafka architectures. The ideal candidate will have extensive experience with Kafka Streams, KSQL, and the associated clustering model. Additionally, they should possess solid programming skills in Java and a deep understanding of best practices...

  • Kafka Architect

    3 weeks ago

    Hyderabad, Telangana, India Alignity Solutions Full time

    Job Title: Kafka SMEWe are seeking a highly skilled Kafka Subject Matter Expert (SME) to lead the architecture, management, and scaling of Kafka environments in 24x7 production settings. The ideal candidate will have a deep understanding of Apache Kafka, a proven track record of resolving complex production and non-production issues, and strong leadership...

  • Kafka Architect

    3 weeks ago

    Hyderabad, Telangana, India Alignity Solutions Full time

    Job Title: Kafka SMEWe are seeking a highly skilled Kafka Subject Matter Expert (SME) to lead the architecture, management, and scaling of Kafka environments in 24x7 production settings.Key Responsibilities:Kafka Management:Design, build, manage, and upgrade Kafka clusters in production and non-production environments.Ensure the Kafka infrastructure supports...

  • Kafka Architect

    3 weeks ago

    Hyderabad, Telangana, India Alignity Solutions Full time

    Job Title: Kafka SMEWe are seeking a highly skilled Kafka Subject Matter Expert (SME) to lead the architecture management and scaling of Kafka environments in 24x7 production settings.Key Responsibilities:Kafka Management:Design, build, manage, and upgrade Kafka clusters in production and non-production environments.Ensure the Kafka infrastructure supports...

  • Kafka Architect

    3 weeks ago

    Hyderabad, Telangana, India ScaleneWorks Full time

    ScaleneWorks - Confluent Kafka DeveloperJob Summary: We are seeking a highly skilled Confluent Kafka Developer to join our team at ScaleneWorks. The ideal candidate will have a strong background in developing high-performance data pipelines and streaming applications using Confluent Kafka.Key Responsibilities:Design, develop, and deploy Confluent Kafka...

  • Kafka Architect

    3 weeks ago

    Hyderabad, Telangana, India Health Catalyst Full time

    About UsHealth Catalyst is a leading healthcare technology company that is revolutionizing the industry with innovative solutions. We are a fast-growing organization that values smart, hardworking, and humble individuals who are passionate about making a difference in the lives of millions of people.Job SummaryWe are seeking a highly skilled Senior Software...

  • Senior Java Architect for Microservices and Kafka

    2 weeks ago

    Hyderabad, Telangana, India Virtusa Full time

    Job Description:As a Senior Java Architect at Virtusa, you will be responsible for designing and implementing scalable and efficient microservices architecture using Java. You will work closely with the development team to ensure seamless integration with Kafka and other systems.Key Responsibilities:Design and implement microservices architecture using...

  • Kafka Solutions Architect

    3 weeks ago

    Hyderabad, Telangana, India Experian Full time

    About This RoleWe are seeking a highly skilled Staff Software Engineer to join our team at Experian. As a key member of our engineering team, you will be responsible for designing, developing, and implementing our Kafka ecosystem.Key ResponsibilitiesDesign and develop a framework for leveraging technologies such as Kafka Connect, KStreams/KSQL, Attunity,...

  • Senior Kafka Developer

    3 weeks ago

    Hyderabad, Telangana, India ProArch Full time

    Senior Kafka DeveloperProArch is seeking a highly skilled Senior Kafka Developer with expertise in AWS to join our innovative team. In this role, you will be responsible for designing, developing, and managing Kafka-based solutions that enhance our data streaming capabilities and support our cloud infrastructure on AWS.Key Responsibilities:Design and...

  • Enterprise Kafka Solutions Architect

    7 days ago

    Hyderabad, Telangana, India ProArch Full time

    Job DescriptionWe are seeking a highly skilled Sr. Kafka Developer to join our team at ProArch. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining scalable and efficient Kafka-based messaging solutions and microservices applications.Key Responsibilities:Configure and manage Kafka clusters, ensuring...

  • Java-Kafka Solutions Architect

    3 weeks ago

    Hyderabad, Telangana, India Qode Full time

    Key ResponsibilitiesWe are seeking a highly skilled Java-Kafka Lead to join our team at Qode. The ideal candidate will have a strong background in Kafka Streams, KSQL, and Java, with a proven track record of designing and implementing scalable and efficient Kafka ecosystems.Technical RequirementsMinimum 8 years of experience in software development, with a...

  • Senior Kafka Developer

    3 weeks ago

    Hyderabad, Telangana, India ProArch Full time

    ProArch is seeking a skilled Senior Kafka Developer with AWS experience to join our innovative team. In this role, you will be responsible for designing, developing, and managing Kafka-based solutions that improve our data streaming capabilities and support our cloud infrastructure on AWS.Key Responsibilities:Design, develop, and implement Kafka streams and...

  • Senior Kafka Developer

    3 days ago

    Hyderabad, Telangana, India ProArch Full time

    OverviewProArch is seeking a skilled Senior Kafka Developer with AWS experience to join our innovative team.Key Responsibilities:Design, develop, and implement Kafka streams and data pipelines to facilitate real-time data processing and analytics.Integrate Kafka with various data sources and sinks, ensuring data flow across different applications.Work...

  • Senior Kafka Developer

    3 days ago

    Hyderabad, Telangana, India ProArch Full time

    Data Streaming Solutions Engineer - KafkaProArch is seeking a skilled Senior Kafka Developer with AWS experience to join our innovative team in the field of cloud data streaming solutions.Key Responsibilities:Design, develop, and implement Kafka streams and data pipelines to facilitate real-time data processing and analytics for our cloud infrastructure on...

  • Senior Java Architect

    3 weeks ago

    Hyderabad, Telangana, India Virtusa Full time

    Job DescriptionJob Title: Architect - Java Ms/KafkaLocation: Hyderabad, Andhra Pradesh, IndiaJob Type: ExperiencedPrimary Skills: Hibernate, Spring Boot/Spring CloudYears of Experience: 10Travel: NoAbout the Role:We are seeking a highly skilled Java Architect with expertise in Microservices, Kafka, and Cloud-Native technologies to join our team at Virtusa....

  • Senior Software Architect

    2 weeks ago

    Hyderabad, Telangana, India Riverforest Connections Private Limited Full time

    Job Title: Senior Software ArchitectWe are seeking a skilled Senior Software Architect to lead the migration of existing Kafka infrastructure to Amazon MSK. The ideal candidate will have strong expertise in Kafka core Java and migration projects with additional experience in Apache Storm being advantageous.Key Responsibilities:Lead the migration of existing...

  • Senior Java Architect

    3 weeks ago

    Hyderabad, Telangana, India Virtusa Full time

    Job Title: Architect - Java Ms/KafkaJob Summary: We are seeking a highly skilled Java Architect with expertise in Kafka and Microservices to join our team at Virtusa. As a key member of our architecture team, you will be responsible for designing and implementing scalable, secure, and efficient software systems using Java and Kafka.Key...