Kafka Developer

3 months ago


Hyderabad, India Health Catalyst Full time

About Us

The healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends. Health Catalyst is a fast-growing company that values smart, hardworking, and humble individuals. Each product team is a small, mission-critical team focused on developing innovative tools to support Catalyst’s mission to improve healthcare performance, cost, and quality.


Job Summary/Responsibilities

We're looking for a Software Development Engineer, Sr. with 6+ years of experience to join our team in designing, implementing, and maintaining complex Kafka pipelines in an AWS environment. The ideal candidate will have extensive experience in distributed systems, data engineering, and team leadership.


Key Responsibilities:

• Lead the design and architecture of Kafka pipelines using AWS MSK and Kafka Connect

• Develop advanced Kafka Sink Connectors for various data stores, including RDS, DocumentDB, S3, OpenSearch, and potentially AWS KeySpaces and ScyllaDB

• Create complex Single Message Transformations (SMTs) for sophisticated ETL operations

• Design and implement robust error handling and fault tolerance mechanisms, including DLQ systems

• Optimize Kafka cluster performance and develop advanced monitoring solutions using Prometheus and Grafana

• Implement best practices for logging and observability using AWS CloudWatch

• Develop comprehensive automation solutions using shell scripting and potentially other technologies

• Provide technical leadership and mentorship to team members

• Collaborate with other teams to design and implement Kafka Producers in Java


Requirements:

• Bachelor's or Master's degree in Computer Science, Engineering, or related field

• 5+ years of extensive experience working with Apache Kafka and its ecosystem

• Strong Java programming skills with experience in developing Kafka Producers

• Deep understanding of AWS services, particularly MSK, EC2, CloudWatch, and other relevant data services

• Expert-level knowledge of Kafka Connect and developing custom connectors

• Proven experience in designing and implementing complex distributed systems

• Advanced skills in performance tuning and optimization of Kafka clusters

• Expertise in monitoring and observability tools such as Prometheus and Grafana

• Strong scripting skills (shell, Python, etc.) for developing sophisticated automation solutions

• Excellent problem-solving, communication, and leadership skills


Preferred Qualifications:

• Experience with additional AWS services like AWS KeySpaces and Aurora

• Knowledge of emerging technologies in the data streaming space

• Contributions to open-source Kafka projects or connectors

• Experience with Kubernetes and containerization of Kafka ecosystems

  • • Familiarity with real-time data processing frameworks (e.g., Apache Flink, Spark Streaming)


  • Kafka Developer

    3 weeks ago


    Hyderabad, Telangana, India ScaleneWorks Full time

    Kafka Developer Job DescriptionJob Summary: We are seeking an experienced Kafka Developer to join our team at ScaleneWorks. The ideal candidate will have a strong background in developing and maintaining high-performance data pipelines and streaming applications using Confluent Kafka.Key Responsibilities:Design, develop, and deploy Confluent Kafka Streams...

  • Kafka Developer

    3 months ago


    Hyderabad, India Health Catalyst Full time

    About UsThe healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends. Health...

  • Kafka Developer

    3 weeks ago


    Hyderabad, Telangana, India ProArch Full time

    Job Title: Sr. Kafka DeveloperProArch is seeking a highly skilled Sr. Kafka Developer to join our team. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining scalable and efficient Kafka-based messaging solutions and microservices applications.Key Responsibilities:Design and Develop Kafka Clusters: Set up...

  • Kafka Developer

    3 months ago


    Hyderabad, India Health Catalyst Full time

    About UsThe healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends. Health...

  • Kafka Developer

    3 months ago


    Hyderabad, India Health Catalyst Full time

    About Us The healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends....

  • Kafka developer

    2 days ago


    Hyderabad, India Tata Consultancy Services Full time

    Greetings from TCS!! TCS hiring for Kafka Developer Job Title: Kafka Developer Location: Hyderabad/Pan India Experience Range: 5- 8 Years Minimum Qualification: 15 years of full-time education Must Have: Experience in Flink is a must Knowledge about Kafka is desired Experience in design of event driven architecture Experience in...

  • Kafka Developer

    5 months ago


    Hyderabad, India SID Global Solutions Full time

    Role: Java / KafkaLocation: Hyderabad / BangaloreType: Permanent Full-timeAbout SIDGS:SIDGS is a premium global systems integrator and global implementation partner of Google corporation, providing Digital Solutions & Services to Fortune 500 companies. Our Digital solutions go across following domains: User Experience, CMS, API Management, Microservices,...

  • Kafka Developer

    2 months ago


    hyderabad, India SID Global Solutions Full time

    Role: Java / KafkaLocation: Hyderabad / BangaloreType: Permanent Full-timeAbout SIDGS:SIDGS is a premium global systems integrator and global implementation partner of Google corporation, providing Digital Solutions & Services to Fortune 500 companies. Our Digital solutions go across following domains: User Experience, CMS, API Management, Microservices,...

  • Kafka Developer

    5 months ago


    Hyderabad, India SID Global Solutions Full time

    Role: Java / Kafka Location: Hyderabad / Bangalore Type: Permanent Full-time About SIDGS: SIDGS is a premium global systems integrator and global implementation partner of Google corporation, providing Digital Solutions & Services to Fortune 500 companies. Our Digital solutions go across following domains: User Experience, CMS, API Management,...

  • Kafka Developer

    3 months ago


    Hyderabad, India SID Global Solutions Full time

    Role: Java / KafkaLocation: Hyderabad / BangaloreType: Permanent Full-timeAbout SIDGS:SIDGS is a premium global systems integrator and global implementation partner of Google corporation, providing Digital Solutions & Services to Fortune 500 companies. Our Digital solutions go across following domains: User Experience, CMS, API Management, Microservices,...

  • Kafka Developer

    3 days ago


    hyderabad, India Tata Consultancy Services Full time

    Greetings from TCS!!TCS hiring for Kafka DeveloperJob Title: Kafka DeveloperLocation: Hyderabad/Pan IndiaExperience Range: 5- 8 YearsMinimum Qualification: 15 years of full-time educationMust Have:- Experience in Flink is a must- Knowledge about Kafka is desired- Experience in design of event driven architectureExperience in advanced level Java (Streaming...

  • Kafka developer

    4 days ago


    Hyderabad, India Tata Consultancy Services Full time

    Greetings from TCS!!TCS hiring for Kafka DeveloperJob Title: Kafka DeveloperLocation: Hyderabad/Pan IndiaExperience Range: 5- 8 YearsMinimum Qualification: 15 years of full-time educationMust Have:Experience in Flink is a mustKnowledge about Kafka is desiredExperience in design of event driven architecture Experience in advanced level Java (Streaming...

  • Kafka Developer

    3 weeks ago


    Hyderabad, Telangana, India Tata Consultancy Services Full time

    Unlock Your Potential as a Kafka DeveloperTata Consultancy Services is seeking a skilled Kafka Developer to join our team.About the Role:We are looking for a talented individual with experience in Python development, familiarity with Fast API, and a strong understanding of Kafka queues and NoSQL databases.Key Responsibilities:Collaborate with internal teams...

  • Kafka Developer

    1 month ago


    hyderabad, India Tata Consultancy Services Full time

    Greetings From TCS!!!!! TCS presents an excellent opportunity for "Kafka Developer" Job Title: Kafka Developer Location: Hyderabad ( Deccan Park Plot No 1, Software Units Layout, Madhapur, Hyderabad, Telangana 500081 , India ) In Person Drive Date: 5th October 2024(Saturday) In Person Drive Time: 09:00 AM - 2:00 PM Experience Range: 4 to 12 Years Job...

  • Kafka Developer

    3 weeks ago


    Hyderabad, India Tata Consultancy Services Full time

    Greetings From TCS!!!!! TCS presents an excellent opportunity for "Kafka Developer" Job Title: Kafka Developer Location: Hyderabad ( Deccan Park Plot No 1, Software Units Layout, Madhapur, Hyderabad, Telangana 500081 , India ) In Person Drive Date: 5th October 2024(Saturday) In Person Drive Time: 09:00 AM - 2:00 PM Experience Range: 4 to 12 Years Job...

  • Kafka developer

    3 weeks ago


    Hyderabad, India Tata Consultancy Services Full time

    Greetings From TCS!!!!! TCS presents an excellent opportunity for "Kafka Developer" Job Title: Kafka Developer Location: Hyderabad ( Deccan Park Plot No 1, Software Units Layout, Madhapur, Hyderabad, Telangana 500081 , India ) In Person Drive Date: 5th October 2024(Saturday) In Person Drive Time: 09:00 AM - 2:00 PM Experience Range: 4 to 12 Years Job...

  • Kafka Developer

    6 days ago


    hyderabad, India Tata Consultancy Services Full time

    Greetings from TCS!!TCS hiring for Kafka DeveloperJob Title: Kafka DeveloperLocation: Hyderabad/Pan IndiaExperience Range: 5- 8 YearsMinimum Qualification: 15 years of full-time educationMust Have:Experience in Flink is a mustKnowledge about Kafka is desiredExperience in design of event driven architectureExperience in advanced level Java (Streaming classes,...

  • Kafka Developer

    6 days ago


    Hyderabad, India Tata Consultancy Services Full time

    Greetings from TCS!!TCS hiring for Kafka DeveloperJob Title: Kafka DeveloperLocation: Hyderabad/Pan IndiaExperience Range: 5- 8 YearsMinimum Qualification: 15 years of full-time educationMust Have:Experience in Flink is a mustKnowledge about Kafka is desiredExperience in design of event driven architectureExperience in advanced level Java (Streaming classes,...

  • Kafka Developer

    4 days ago


    hyderabad, India Tata Consultancy Services Full time

    Greetings from TCS!! TCS hiring for Kafka Developer Job Title: Kafka Developer Location: Hyderabad/Pan India Experience Range: 5- 8 Years Minimum Qualification: 15 years of full-time education Must Have: Experience in Flink is a must Knowledge about Kafka is desired Experience in design of event driven architectureExperience in advanced level Java...

  • Kafka Developer

    6 days ago


    Hyderabad, India Tata Consultancy Services Full time

    Greetings from TCS!!TCS hiring for Kafka DeveloperJob Title: Kafka DeveloperLocation: Hyderabad/Pan IndiaExperience Range: 5- 8 YearsMinimum Qualification: 15 years of full-time educationMust Have:Experience in Flink is a mustKnowledge about Kafka is desiredExperience in design of event driven architectureExperience in advanced level Java (Streaming classes,...