Health Catalyst | Kafka Engineer | hyderabad

2 weeks ago


Hyderabad, India Health Catalyst Full time
About UsThe healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends. Health Catalyst is a fast-growing company that values smart, hardworking, and humble individuals. Each product team is a small, mission-critical team focused on developing innovative tools to support Catalyst’s mission to improve healthcare performance, cost, and quality.

Job Summary/ResponsibilitiesWe're looking for a Software Development Engineer, Sr. with 6+ years of experience to join our team in designing, implementing, and maintaining complex Kafka pipelines in an AWS environment. The ideal candidate will have extensive experience in distributed systems, data engineering, and team leadership.

Key Responsibilities:• Lead the design and architecture of Kafka pipelines using AWS MSK and Kafka Connect• Develop advanced Kafka Sink Connectors for various data stores, including RDS, DocumentDB, S3, OpenSearch, and potentially AWS KeySpaces and ScyllaDB• Create complex Single Message Transformations (SMTs) for sophisticated ETL operations• Design and implement robust error handling and fault tolerance mechanisms, including DLQ systems• Optimize Kafka cluster performance and develop advanced monitoring solutions using Prometheus and Grafana• Implement best practices for logging and observability using AWS CloudWatch• Develop comprehensive automation solutions using shell scripting and potentially other technologies• Provide technical leadership and mentorship to team members• Collaborate with other teams to design and implement Kafka Producers in Java

Requirements:• Bachelor's or Master's degree in Computer Science, Engineering, or related field• 5+ years of extensive experience working with Apache Kafka and its ecosystem• Strong Java programming skills with experience in developing Kafka Producers• Deep understanding of AWS services, particularly MSK, EC2, CloudWatch, and other relevant data services• Expert-level knowledge of Kafka Connect and developing custom connectors• Proven experience in designing and implementing complex distributed systems• Advanced skills in performance tuning and optimization of Kafka clusters• Expertise in monitoring and observability tools such as Prometheus and Grafana• Strong scripting skills (shell, Python, etc.) for developing sophisticated automation solutions• Excellent problem-solving, communication, and leadership skills

Preferred Qualifications:• Experience with additional AWS services like AWS KeySpaces and Aurora• Knowledge of emerging technologies in the data streaming space• Contributions to open-source Kafka projects or connectors• Experience with Kubernetes and containerization of Kafka ecosystemsFamiliarity with real-time data processing frameworks (e.g., Apache Flink, Spark Streaming)



  • hyderabad, India Health Catalyst Full time

    About UsThe healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends. Health...

  • Kafka Engineer

    4 weeks ago


    hyderabad, India Health Catalyst Full time

    About Us The healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends....

  • Kafka Engineer

    2 months ago


    hyderabad, India Health Catalyst Full time

    About UsThe healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends. Health...

  • Kafka engineer

    2 months ago


    Hyderabad, India Health Catalyst Full time

    About Us The healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends....

  • Kafka Engineer

    2 months ago


    Hyderabad, India Health Catalyst Full time

    About Us The healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends....

  • Kafka engineer

    1 month ago


    Hyderabad, India Health Catalyst Full time

    About UsThe healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends. Health...

  • Kafka Engineer

    1 month ago


    Hyderabad, India Health Catalyst Full time

    About UsThe healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends. Health...

  • Kafka engineer

    1 week ago


    Hyderabad, India Health Catalyst Full time

    About UsThe healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends. Health...

  • Kafka Engineer

    2 months ago


    hyderabad, India Health Catalyst Full time

    About Us The healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends....


  • hyderabad, India Health Catalyst Full time

    About Company:Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends. Health Catalyst is a fast-growing company that values smart, hardworking, and humble...


  • hyderabad, India Health Catalyst Full time

    About Company:Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends. Health Catalyst is a fast-growing company that values smart, hardworking, and humble individuals....


  • hyderabad, India Health Catalyst Full time

    About Company: Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends. Health Catalyst is a fast-growing company that values smart, hardworking, and humble...

  • Kafka Developer

    4 months ago


    Hyderabad, India Health Catalyst Full time

    About UsThe healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends. Health...


  • hyderabad, India Health Catalyst Full time

    About Company: The healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends....


  • hyderabad, India Health Catalyst Full time

    About Company: The healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and...


  • hyderabad, India Health Catalyst Full time

    About Company: The healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and...


  • Hyderabad, India Health Catalyst Full time

    About Us:The healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends. Health...

  • Kafka Developer

    4 months ago


    Hyderabad, India Health Catalyst Full time

    About Us The healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends....

  • Kafka Developer

    4 months ago


    Hyderabad, India Health Catalyst Full time

    About UsThe healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends. Health...

  • Kafka Developer

    4 months ago


    Hyderabad, India Health Catalyst Full time

    About UsThe healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends. Health...