Kafka Engineer

3 weeks ago

Hyderabad, India Health Catalyst Full time
About Us

The healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends. Health Catalyst is a fast-growing company that values smart, hardworking, and humble individuals. Each product team is a small, mission-critical team focused on developing innovative tools to support Catalyst’s mission to improve healthcare performance, cost, and quality.

Job Summary/Responsibilities

We're looking for a Software Development Engineer, Sr. with 6+ years of experience to join our team in designing, implementing, and maintaining complex Kafka pipelines in an AWS environment. The ideal candidate will have extensive experience in distributed systems, data engineering, and team leadership.

Key Responsibilities:

• Lead the design and architecture of Kafka pipelines using AWS MSK and Kafka Connect

• Develop advanced Kafka Sink Connectors for various data stores, including RDS, DocumentDB, S3, OpenSearch, and potentially AWS KeySpaces and ScyllaDB

• Create complex Single Message Transformations (SMTs) for sophisticated ETL operations

• Design and implement robust error handling and fault tolerance mechanisms, including DLQ systems

• Optimize Kafka cluster performance and develop advanced monitoring solutions using Prometheus and Grafana

• Implement best practices for logging and observability using AWS CloudWatch

• Develop comprehensive automation solutions using shell scripting and potentially other technologies

• Provide technical leadership and mentorship to team members

• Collaborate with other teams to design and implement Kafka Producers in Java

Requirements:

• Bachelor's or Master's degree in Computer Science, Engineering, or related field

• 5+ years of extensive experience working with Apache Kafka and its ecosystem

• Strong Java programming skills with experience in developing Kafka Producers

• Deep understanding of AWS services, particularly MSK, EC2, CloudWatch, and other relevant data services

• Expert-level knowledge of Kafka Connect and developing custom connectors

• Proven experience in designing and implementing complex distributed systems

• Advanced skills in performance tuning and optimization of Kafka clusters

• Expertise in monitoring and observability tools such as Prometheus and Grafana

• Strong scripting skills (shell, Python, etc.) for developing sophisticated automation solutions

• Excellent problem-solving, communication, and leadership skills

Preferred Qualifications:

• Experience with additional AWS services like AWS KeySpaces and Aurora

• Knowledge of emerging technologies in the data streaming space

• Contributions to open-source Kafka projects or connectors

• Experience with Kubernetes and containerization of Kafka ecosystems

- • Familiarity with real-time data processing frameworks (e.g., Apache Flink, Spark Streaming)

  • Kafka Engineer

    2 weeks ago

    hyderabad, India Health Catalyst Full time

    About Us The healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends....

  • Kafka Engineer

    3 weeks ago

    hyderabad, India Health Catalyst Full time

    About UsThe healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends. Health...

  • Kafka engineer

    4 weeks ago

    Hyderabad, India Health Catalyst Full time

    About UsThe healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends. Health...

  • Kafka Engineer

    1 month ago

    hyderabad, India Health Catalyst Full time

    About UsThe healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends. Health...

  • Kafka engineer

    1 month ago

    Hyderabad, India Health Catalyst Full time

    About Us The healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends....

  • Kafka Engineer

    1 month ago

    Hyderabad, India Health Catalyst Full time

    About Us The healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends....

  • Kafka Engineer

    1 month ago

    hyderabad, India Health Catalyst Full time

    About Us The healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends....

  • Kafka Architect

    3 weeks ago

    Hyderabad, Telangana, India Alignity Solutions Full time

    About the RoleWe are looking for a highly skilled Kafka Architect to lead the design, development, and deployment of our Kafka-based data pipeline. As a Kafka Architect, you will be responsible for designing and implementing scalable, fault-tolerant, and high-performance Kafka clusters.Key Responsibilities:Kafka Cluster Design: Design and implement scalable...

  • Kafka Architect

    1 month ago

    Hyderabad, Telangana, India ScaleneWorks Full time

    ScaleneWorks - Confluent Kafka DeveloperJob Summary: We are seeking a highly skilled Confluent Kafka Developer to join our team at ScaleneWorks. The ideal candidate will have a strong background in developing high-performance data pipelines and streaming applications using Confluent Kafka.Key Responsibilities:Design, develop, and deploy Confluent Kafka...

  • Kafka Developer

    3 months ago

    Hyderabad, India Health Catalyst Full time

    About UsThe healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends. Health...

  • Kafka Developer

    3 months ago

    Hyderabad, India Health Catalyst Full time

    About UsThe healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends. Health...

  • Kafka Developer

    3 months ago

    Hyderabad, India Health Catalyst Full time

    About UsThe healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends. Health...

  • Kafka Developer

    3 months ago

    Hyderabad, India Health Catalyst Full time

    About Us The healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends....

  • Kafka SME

    2 months ago

    Hyderabad, India Alignity Solutions Full time

    Do you love a career where you Experience, Grow & Contribute at the same time, while earning at least 10% above the market? If so, we are excited to have bumped onto you.Learn how we are redefining the meaning of work, and be a part of the team raved by Clients, Job-seekers and Employees.Jobseeker Video Testimonials Employee Glassdoor ReviewsIf you are...

  • Kafka Infrastructure Specialist

    3 weeks ago

    Hyderabad, Telangana, India Alignity Solutions Full time

    Kafka Infrastructure Specialist RoleWe are seeking a highly skilled Kafka Subject Matter Expert (SME) to lead the architecture management and scaling of Kafka environments in 24x7 production settings. The ideal candidate will have a deep understanding of Apache Kafka, a proven track record of resolving complex production and non-production issues, and strong...

  • Kafka Engineers

    2 days ago

    Hyderabad, India CriticalRiver Inc. Full time

    Job Title:Kafka LeadExperience10+ yrs.Location:HyderabadScopeThe scope of work involves the finalization and optimization of the Kafka Streams solution for the IEE job, focusing on achieving production-level performance, scalability, observability, and cost efficiency. The key objectives are outlined as follows:Cost OptimizationEstimate and benchmark the...

  • Kafka Architecture Specialist

    1 month ago

    Hyderabad, Telangana, India Alignity Solutions Full time

    Job OverviewWe are seeking a highly skilled Kafka Subject Matter Expert (SME) to lead the architecture, management, and scaling of Kafka environments in 24x7 production settings. As a key member of our team, you will work closely with cross-functional teams, provide technical guidance to junior engineers, and ensure the high availability, scalability, and...

  • Centralized Kafka Specialist

    3 weeks ago

    hyderabad, India ValueLabs Full time

    Dear Aspirants, Greetings from ValueLabs !! We are seeking a skilled Centralized Kafka Specialist who can join our team immediately. Primary Skills : Centralized Kafka Specialist Experience: 9- 12 years Location: Hyderabad Notice period: Immediate -7 days Joiners Key Responsibilities: Design and implement Kafka clusters and topologies to meet the...

  • Centralized Kafka Specialist

    4 weeks ago

    Hyderabad, India ValueLabs Full time

    Dear Aspirants,Greetings from ValueLabs !!We are seeking a skilled Centralized Kafka Specialist who can join our team immediately.Primary Skills : Centralized Kafka SpecialistExperience: 9- 12 yearsLocation: HyderabadNotice period: Immediate -7 days JoinersKey Responsibilities:Design and implement Kafka clusters and topologies to meet the organization's...

  • Centralized kafka specialist

    1 month ago

    Hyderabad, India ValueLabs Full time

    Dear Aspirants, Greetings from Value Labs !! We are seeking a skilled Centralized Kafka Specialist who can join our team immediately. Primary Skills : Centralized Kafka Specialist Experience: 9- 12 years Location: Hyderabad Notice period: Immediate -7 days Joiners Key Responsibilities: Design and implement Kafka clusters and topologies to meet the...