Kafka Developer

4 months ago

Hyderabad, India Health Catalyst Full time

About Us

The healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends. Health Catalyst is a fast-growing company that values smart, hardworking, and humble individuals. Each product team is a small, mission-critical team focused on developing innovative tools to support Catalyst’s mission to improve healthcare performance, cost, and quality.


Job Summary/Responsibilities

We're looking for a Software Development Engineer, Sr. with 6+ years of experience to join our team in designing, implementing, and maintaining complex Kafka pipelines in an AWS environment. The ideal candidate will have extensive experience in distributed systems, data engineering, and team leadership.


Key Responsibilities:

• Lead the design and architecture of Kafka pipelines using AWS MSK and Kafka Connect

• Develop advanced Kafka Sink Connectors for various data stores, including RDS, DocumentDB, S3, OpenSearch, and potentially AWS KeySpaces and ScyllaDB

• Create complex Single Message Transformations (SMTs) for sophisticated ETL operations

• Design and implement robust error handling and fault tolerance mechanisms, including DLQ systems

• Optimize Kafka cluster performance and develop advanced monitoring solutions using Prometheus and Grafana

• Implement best practices for logging and observability using AWS CloudWatch

• Develop comprehensive automation solutions using shell scripting and potentially other technologies

• Provide technical leadership and mentorship to team members

• Collaborate with other teams to design and implement Kafka Producers in Java


Requirements:

• Bachelor's or Master's degree in Computer Science, Engineering, or related field

• 5+ years of extensive experience working with Apache Kafka and its ecosystem

• Strong Java programming skills with experience in developing Kafka Producers

• Deep understanding of AWS services, particularly MSK, EC2, CloudWatch, and other relevant data services

• Expert-level knowledge of Kafka Connect and developing custom connectors

• Proven experience in designing and implementing complex distributed systems

• Advanced skills in performance tuning and optimization of Kafka clusters

• Expertise in monitoring and observability tools such as Prometheus and Grafana

• Strong scripting skills (shell, Python, etc.) for developing sophisticated automation solutions

• Excellent problem-solving, communication, and leadership skills


Preferred Qualifications:

• Experience with additional AWS services like AWS KeySpaces and Aurora

• Knowledge of emerging technologies in the data streaming space

• Contributions to open-source Kafka projects or connectors

• Experience with Kubernetes and containerization of Kafka ecosystems

  • • Familiarity with real-time data processing frameworks (e.g., Apache Flink, Spark Streaming)

  • Kafka Developer

    1 month ago

    hyderabad, India Tata Consultancy Services Full time

    Dear AspirantsTCS is hiring for Kafka DeveloperLocation: HYDERABADExperience: 6 to 8 years onlyMust Have:# Design and Develop event based architecture based on Kafka & Kafka streams# Lead Architecture discussion & design of Kafka based application# Design a holistic approach for Event based architecture# Configure Kafka connectors and Kafka topic# Develops...

  • Kafka Developer

    2 months ago

    Hyderabad, India Tata Consultancy Services Full time

    Dear AspirantsTCS is hiring for Kafka DeveloperLocation: HYDERABADExperience: 6 to 8 years onlyMust Have:# Design and Develop event based architecture based on Kafka & Kafka streams# Lead Architecture discussion & design of Kafka based application# Design a holistic approach for Event based architecture# Configure Kafka connectors and Kafka topic# Develops...

  • Kafka Developer

    2 months ago

    Hyderabad, India Tata Consultancy Services Full time

    Dear Aspirants TCS is hiring for Kafka Developer Location: HYDERABAD Experience: 6 to 8 years only Must Have: # Design and Develop event based architecture based on Kafka & Kafka streams # Lead Architecture discussion & design of Kafka based application # Design a holistic approach for Event based architecture # Configure Kafka...

  • Kafka Developer

    2 months ago

    Hyderabad, India Tata Consultancy Services Full time

    Dear AspirantsTCS is hiring for Kafka DeveloperLocation: HYDERABADExperience: 6 to 8 years onlyMust Have:# Design and Develop event based architecture based on Kafka & Kafka streams# Lead Architecture discussion & design of Kafka based application# Design a holistic approach for Event based architecture# Configure Kafka connectors and Kafka topic# Develops...

  • Kafka Developer

    2 months ago

    Hyderabad, India Tata Consultancy Services Full time

    Dear AspirantsTCS is hiring for Kafka DeveloperLocation: HYDERABADExperience: 6 to 8 years onlyMust Have:# Design and Develop event based architecture based on Kafka & Kafka streams# Lead Architecture discussion & design of Kafka based application# Design a holistic approach for Event based architecture# Configure Kafka connectors and Kafka topic# Develops...

  • Kafka Developer

    2 months ago

    Hyderabad, India Tata Consultancy Services Full time

    Dear Aspirants TCS is hiring for Kafka Developer Location: HYDERABAD Experience: 6 to 8 years only Must Have: # Design and Develop event based architecture based on Kafka & Kafka streams # Lead Architecture discussion & design of Kafka based application # Design a holistic approach for Event based architecture # Configure Kafka connectors and Kafka...

  • Kafka Developer

    4 months ago

    Hyderabad, India Health Catalyst Full time

    About UsThe healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends. Health...

  • Kafka Developer

    4 months ago

    Hyderabad, India Health Catalyst Full time

    About Us The healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends....

  • Kafka engineer

    2 months ago

    Hyderabad, India Health Catalyst Full time

    About UsThe healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends. Health...

  • Kafka Engineer

    2 months ago

    Hyderabad, India Health Catalyst Full time

    About UsThe healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends. Health...

  • Kafka Engineer

    2 weeks ago

    Hyderabad, India Health Catalyst Full time

    About UsThe healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends. Health...

  • Kafka Engineer

    2 weeks ago

    Hyderabad, India Health Catalyst Full time

    About UsThe healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends. Health...

  • Kafka Engineer

    2 months ago

    Hyderabad, India Health Catalyst Full time

    About Us The healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends....

  • Kafka engineer

    2 months ago

    Hyderabad, India Health Catalyst Full time

    About Us The healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends....

  • Kafka engineer

    4 weeks ago

    Hyderabad, India Health Catalyst Full time

    About UsThe healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends. Health...

  • Kafka Engineer

    2 months ago

    hyderabad, India Health Catalyst Full time

    About Us The healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends....

  • Kafka Architect

    18 hours ago

    Hyderabad, India ProArch Full time

    **Responsibilities**: - Design new solutions and validate new ideas by either building on top of existing solutions or by prototyping new platform capabilities - Take ownership for the quality of design and implementation of software components. - Interact with various non-engineering teams such as Product Management, SRE, Risk Analysts and senior...

  • Health Catalyst | Kafka Engineer

    2 weeks ago

    hyderabad, India Health Catalyst Full time

    About UsThe healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends. Health...

  • Kafka Solutions Architect

    2 weeks ago

    Hyderabad, Telangana, India Criticalriver Technologies Full time

    About CriticalRiver Technologies:CriticalRiver Technologies is a technology consulting and IT services firm empowering its workforce to have a direct stake in the company's growth and success. We are committed to fostering a culture of innovation, growth, and collaboration where your ideas and leadership will thrive.Job Overview:The estimated salary for this...

  • Kafka Systems Architect

    4 weeks ago

    Hyderabad, Telangana, India Tata Consultancy Services Full time

    At Tata Consultancy Services, we are seeking a highly skilled Kafka Systems Architect to join our team.The ideal candidate will have a minimum of 6 to 8 years of experience in designing and developing event-based architecture based on Kafka & Kafka streams.This is an exceptional opportunity for a talented professional to lead architecture discussions and...