Kafka Developer

3 months ago

Hyderabad, India Health Catalyst Full time

About Us

The healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends. Health Catalyst is a fast-growing company that values smart, hardworking, and humble individuals. Each product team is a small, mission-critical team focused on developing innovative tools to support Catalyst’s mission to improve healthcare performance, cost, and quality.


Job Summary/Responsibilities

We're looking for a Software Development Engineer, Sr. with 6+ years of experience to join our team in designing, implementing, and maintaining complex Kafka pipelines in an AWS environment. The ideal candidate will have extensive experience in distributed systems, data engineering, and team leadership.


Key Responsibilities:

• Lead the design and architecture of Kafka pipelines using AWS MSK and Kafka Connect

• Develop advanced Kafka Sink Connectors for various data stores, including RDS, DocumentDB, S3, OpenSearch, and potentially AWS KeySpaces and ScyllaDB

• Create complex Single Message Transformations (SMTs) for sophisticated ETL operations

• Design and implement robust error handling and fault tolerance mechanisms, including DLQ systems

• Optimize Kafka cluster performance and develop advanced monitoring solutions using Prometheus and Grafana

• Implement best practices for logging and observability using AWS CloudWatch

• Develop comprehensive automation solutions using shell scripting and potentially other technologies

• Provide technical leadership and mentorship to team members

• Collaborate with other teams to design and implement Kafka Producers in Java


Requirements:

• Bachelor's or Master's degree in Computer Science, Engineering, or related field

• 5+ years of extensive experience working with Apache Kafka and its ecosystem

• Strong Java programming skills with experience in developing Kafka Producers

• Deep understanding of AWS services, particularly MSK, EC2, CloudWatch, and other relevant data services

• Expert-level knowledge of Kafka Connect and developing custom connectors

• Proven experience in designing and implementing complex distributed systems

• Advanced skills in performance tuning and optimization of Kafka clusters

• Expertise in monitoring and observability tools such as Prometheus and Grafana

• Strong scripting skills (shell, Python, etc.) for developing sophisticated automation solutions

• Excellent problem-solving, communication, and leadership skills


Preferred Qualifications:

• Experience with additional AWS services like AWS KeySpaces and Aurora

• Knowledge of emerging technologies in the data streaming space

• Contributions to open-source Kafka projects or connectors

• Experience with Kubernetes and containerization of Kafka ecosystems

  • • Familiarity with real-time data processing frameworks (e.g., Apache Flink, Spark Streaming)

  • Kafka Developer

    2 weeks ago

    hyderabad, India Tata Consultancy Services Full time

    Dear Aspirants TCS is hiring for Kafka Developer Location: HYDERABAD Experience: 6 to 8 years only Must Have: # Design and Develop event based architecture based on Kafka & Kafka streams # Lead Architecture discussion & design of Kafka based application # Design a holistic approach for Event based architecture # Configure Kafka connectors and Kafka topic #...

  • Kafka Developer

    2 weeks ago

    hyderabad, India Tata Consultancy Services Full time

    Dear AspirantsTCS is hiring for Kafka DeveloperLocation: HYDERABADExperience: 6 to 8 years onlyMust Have:# Design and Develop event based architecture based on Kafka & Kafka streams# Lead Architecture discussion & design of Kafka based application# Design a holistic approach for Event based architecture# Configure Kafka connectors and Kafka topic# Develops...

  • Kafka Developer

    2 weeks ago

    hyderabad, India Tata Consultancy Services Full time

    Dear AspirantsTCS is hiring for Kafka DeveloperLocation: HYDERABADExperience: 6 to 8 years onlyMust Have:# Design and Develop event based architecture based on Kafka & Kafka streams# Lead Architecture discussion & design of Kafka based application# Design a holistic approach for Event based architecture# Configure Kafka connectors and Kafka topic# Develops...

  • Kafka Developer

    2 weeks ago

    Hyderabad, India Tata Consultancy Services Full time

    Dear AspirantsTCS is hiring for Kafka DeveloperLocation: HYDERABADExperience: 6 to 8 years onlyMust Have:# Design and Develop event based architecture based on Kafka & Kafka streams# Lead Architecture discussion & design of Kafka based application# Design a holistic approach for Event based architecture# Configure Kafka connectors and Kafka topic# Develops...

  • Kafka Developer

    2 weeks ago

    Hyderabad, India Tata Consultancy Services Full time

    Dear AspirantsTCS is hiring for Kafka DeveloperLocation: HYDERABADExperience: 6 to 8 years onlyMust Have:# Design and Develop event based architecture based on Kafka & Kafka streams# Lead Architecture discussion & design of Kafka based application# Design a holistic approach for Event based architecture# Configure Kafka connectors and Kafka topic# Develops...

  • Kafka Developer

    2 weeks ago

    Hyderabad, India Tata Consultancy Services Full time

    Dear AspirantsTCS is hiring for Kafka DeveloperLocation: HYDERABADExperience: 6 to 8 years onlyMust Have:# Design and Develop event based architecture based on Kafka & Kafka streams# Lead Architecture discussion & design of Kafka based application# Design a holistic approach for Event based architecture# Configure Kafka connectors and Kafka topic# Develops...

  • Kafka Developer

    2 weeks ago

    Hyderabad, India Tata Consultancy Services Full time

    Dear Aspirants TCS is hiring for Kafka Developer Location: HYDERABAD Experience: 6 to 8 years only Must Have: # Design and Develop event based architecture based on Kafka & Kafka streams # Lead Architecture discussion & design of Kafka based application # Design a holistic approach for Event based architecture # Configure Kafka...

  • Kafka Developer

    2 weeks ago

    Hyderabad, India Tata Consultancy Services Full time

    Dear Aspirants TCS is hiring for Kafka Developer Location: HYDERABAD Experience: 6 to 8 years only Must Have: # Design and Develop event based architecture based on Kafka & Kafka streams # Lead Architecture discussion & design of Kafka based application # Design a holistic approach for Event based architecture # Configure Kafka connectors and Kafka...

  • Kafka Developer

    3 months ago

    Hyderabad, India Health Catalyst Full time

    About UsThe healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends. Health...

  • Kafka developer

    3 weeks ago

    Hyderabad, India Tata Consultancy Services Full time

    Greetings from TCS!! TCS hiring for Kafka Developer Job Title: Kafka Developer Location: Hyderabad/Pan India Experience Range: 5- 8 Years Minimum Qualification: 15 years of full-time education Must Have: Experience in Flink is a must Knowledge about Kafka is desired Experience in design of event driven architecture Experience in...

  • Kafka Developer

    3 months ago

    Hyderabad, India Health Catalyst Full time

    About UsThe healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends. Health...

  • Kafka Developer

    3 months ago

    Hyderabad, India Health Catalyst Full time

    About UsThe healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends. Health...

  • Kafka Developer

    3 weeks ago

    hyderabad, India Tata Consultancy Services Full time

    Greetings from TCS!!TCS hiring for Kafka DeveloperJob Title: Kafka DeveloperLocation: Hyderabad/Pan IndiaExperience Range: 5- 8 YearsMinimum Qualification: 15 years of full-time educationMust Have:- Experience in Flink is a must- Knowledge about Kafka is desired- Experience in design of event driven architectureExperience in advanced level Java (Streaming...

  • Kafka developer

    4 weeks ago

    Hyderabad, India Tata Consultancy Services Full time

    Greetings from TCS!!TCS hiring for Kafka DeveloperJob Title: Kafka DeveloperLocation: Hyderabad/Pan IndiaExperience Range: 5- 8 YearsMinimum Qualification: 15 years of full-time educationMust Have:Experience in Flink is a mustKnowledge about Kafka is desiredExperience in design of event driven architecture Experience in advanced level Java (Streaming...

  • Kafka Developer

    4 weeks ago

    Hyderabad, India Tata Consultancy Services Full time

    Greetings from TCS!!TCS hiring for Kafka DeveloperJob Title: Kafka DeveloperLocation: Hyderabad/Pan IndiaExperience Range: 5- 8 YearsMinimum Qualification: 15 years of full-time educationMust Have:Experience in Flink is a mustKnowledge about Kafka is desiredExperience in design of event driven architectureExperience in advanced level Java (Streaming classes,...

  • Kafka Developer

    4 weeks ago

    hyderabad, India Tata Consultancy Services Full time

    Greetings from TCS!! TCS hiring for Kafka Developer Job Title: Kafka Developer Location: Hyderabad/Pan India Experience Range: 5- 8 Years Minimum Qualification: 15 years of full-time education Must Have: Experience in Flink is a must Knowledge about Kafka is desired Experience in design of event driven architectureExperience in advanced level Java...

  • Kafka Developer

    4 weeks ago

    Hyderabad, India Tata Consultancy Services Full time

    Greetings from TCS!!TCS hiring for Kafka DeveloperJob Title: Kafka DeveloperLocation: Hyderabad/Pan IndiaExperience Range: 5- 8 YearsMinimum Qualification: 15 years of full-time educationMust Have:Experience in Flink is a mustKnowledge about Kafka is desiredExperience in design of event driven architectureExperience in advanced level Java (Streaming classes,...

  • Kafka Developer

    4 weeks ago

    Hyderabad, India Tata Consultancy Services Full time

    Greetings from TCS!! TCS hiring for Kafka Developer Job Title: Kafka Developer Location: Hyderabad/Pan India Experience Range: 5- 8 Years Minimum Qualification: 15 years of full-time education Must Have: Experience in Flink is a must Knowledge about Kafka is desired Experience in design of event driven architectureExperience in advanced level Java...

  • Kafka Developer

    4 weeks ago

    hyderabad, India Tata Consultancy Services Full time

    Greetings from TCS!!TCS hiring for Kafka DeveloperJob Title: Kafka DeveloperLocation: Hyderabad/Pan IndiaExperience Range: 5- 8 YearsMinimum Qualification: 15 years of full-time educationMust Have:Experience in Flink is a mustKnowledge about Kafka is desiredExperience in design of event driven architectureExperience in advanced level Java (Streaming classes,...

  • Kafka Developer

    4 weeks ago

    Hyderabad, India Tata Consultancy Services Full time

    Greetings from TCS!!TCS hiring for Kafka DeveloperJob Title: Kafka DeveloperLocation: Hyderabad/Pan IndiaExperience Range: 5- 8 YearsMinimum Qualification: 15 years of full-time educationMust Have:Experience in Flink is a mustKnowledge about Kafka is desiredExperience in design of event driven architectureExperience in advanced level Java (Streaming classes,...