Kafka Engineer
2 months ago
The healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends. Health Catalyst is a fast-growing company that values smart, hardworking, and humble individuals. Each product team is a small, mission-critical team focused on developing innovative tools to support Catalyst’s mission to improve healthcare performance, cost, and quality.
Job Summary/Responsibilities
We're looking for a Software Development Engineer, Sr. with 6+ years of experience to join our team in designing, implementing, and maintaining complex Kafka pipelines in an AWS environment. The ideal candidate will have extensive experience in distributed systems, data engineering, and team leadership.
Key Responsibilities:
• Lead the design and architecture of Kafka pipelines using AWS MSK and Kafka Connect
• Develop advanced Kafka Sink Connectors for various data stores, including RDS, DocumentDB, S3, OpenSearch, and potentially AWS KeySpaces and ScyllaDB
• Create complex Single Message Transformations (SMTs) for sophisticated ETL operations
• Design and implement robust error handling and fault tolerance mechanisms, including DLQ systems
• Optimize Kafka cluster performance and develop advanced monitoring solutions using Prometheus and Grafana
• Implement best practices for logging and observability using AWS CloudWatch
• Develop comprehensive automation solutions using shell scripting and potentially other technologies
• Provide technical leadership and mentorship to team members
• Collaborate with other teams to design and implement Kafka Producers in Java
Requirements:
• Bachelor's or Master's degree in Computer Science, Engineering, or related field
• 5+ years of extensive experience working with Apache Kafka and its ecosystem
• Strong Java programming skills with experience in developing Kafka Producers
• Deep understanding of AWS services, particularly MSK, EC2, CloudWatch, and other relevant data services
• Expert-level knowledge of Kafka Connect and developing custom connectors
• Proven experience in designing and implementing complex distributed systems
• Advanced skills in performance tuning and optimization of Kafka clusters
• Expertise in monitoring and observability tools such as Prometheus and Grafana
• Strong scripting skills (shell, Python, etc.) for developing sophisticated automation solutions
• Excellent problem-solving, communication, and leadership skills
Preferred Qualifications:
• Experience with additional AWS services like AWS KeySpaces and Aurora
• Knowledge of emerging technologies in the data streaming space
• Contributions to open-source Kafka projects or connectors
• Experience with Kubernetes and containerization of Kafka ecosystems
- • Familiarity with real-time data processing frameworks (e.g., Apache Flink, Spark Streaming)
-
Kafka engineer
5 days ago
Hyderabad, India Health Catalyst Full timeAbout UsThe healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends. Health...
-
Kafka engineer
3 months ago
Hyderabad, India Health Catalyst Full timeAbout Us The healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends....
-
Kafka Engineer
3 months ago
Hyderabad, India Health Catalyst Full timeAbout Us The healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends....
-
Kafka Engineer
4 weeks ago
Hyderabad, India Health Catalyst Full timeAbout UsThe healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends. Health...
-
Kafka Engineer
4 weeks ago
Hyderabad, India Health Catalyst Full timeAbout UsThe healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends. Health...
-
Kafka engineer
1 month ago
Hyderabad, India Health Catalyst Full timeAbout UsThe healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends. Health...
-
Kafka Engineer
3 months ago
hyderabad, India Health Catalyst Full timeAbout Us The healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends....
-
Health Catalyst | Kafka Engineer
1 week ago
hyderabad, India Health Catalyst Full timeAbout Us The healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends....
-
Health Catalyst | Kafka Engineer
4 weeks ago
hyderabad, India Health Catalyst Full timeAbout UsThe healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends. Health...
-
Kafka Architecture Engineer
2 weeks ago
Hyderabad, Telangana, India Health Catalyst Full timeAbout Health CatalystWe are a fast-growing company that values smart, hardworking, and humble individuals. Each product team is a small, mission-critical team focused on developing innovative tools to support our mission to improve healthcare performance, cost, and quality.Job Summary/ResponsibilitiesWe're looking for a Senior Software Development Engineer...
-
Kafka Architect
2 weeks ago
Hyderabad, India ProArch Full time**Responsibilities**: - Design new solutions and validate new ideas by either building on top of existing solutions or by prototyping new platform capabilities - Take ownership for the quality of design and implementation of software components. - Interact with various non-engineering teams such as Product Management, SRE, Risk Analysts and senior...
-
Senior Confluent Kafka Engineer
1 day ago
Hyderabad, Telangana, India Tata Consultancy Services Full timeWe are seeking a highly skilled Senior Confluent Kafka Engineer to join our team at Tata Consultancy Services. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining scalable data streaming architectures using Confluent Kafka.Key ResponsibilitiesDesign and develop efficient data pipelines using...
-
Kafka Developer
5 months ago
Hyderabad, India Health Catalyst Full timeAbout Us The healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends....
-
Apache Kafka Engineer Lead
1 month ago
Hyderabad, Telangana, India Criticalriver Technologies Full timeAbout Distributed Streaming Systems Expert Role at CriticalRiver Technologies: We are seeking an experienced Distributed Streaming Systems Expert to lead our efforts in designing, implementing, and maintaining distributed streaming platforms using Apache Kafka. The ideal candidate will have expertise in building real-time data streaming pipelines and...
-
Health Catalyst | Kafka Engineer | hyderabad
2 months ago
hyderabad, India Health Catalyst Full timeAbout UsThe healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends. Health...
-
Health Catalyst | Kafka Engineer | hyderabad
1 month ago
Hyderabad, India Health Catalyst Full timeAbout UsThe healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends. Health...
-
Kafka Solutions Architect
1 month ago
Hyderabad, Telangana, India Criticalriver Technologies Full timeAbout CriticalRiver Technologies:CriticalRiver Technologies is a technology consulting and IT services firm empowering its workforce to have a direct stake in the company's growth and success. We are committed to fostering a culture of innovation, growth, and collaboration where your ideas and leadership will thrive.Job Overview:The estimated salary for this...
-
Kafka Engineers
2 months ago
Hyderabad, India CriticalRiver Inc. Full timeJob Title:Kafka LeadExperience10+ yrs.Location:HyderabadScopeThe scope of work involves the finalization and optimization of the Kafka Streams solution for the IEE job, focusing on achieving production-level performance, scalability, observability, and cost efficiency. The key objectives are outlined as follows:Cost OptimizationEstimate and benchmark the...
-
Kafka Cluster Architect
4 days ago
Hyderabad, Telangana, India Health Catalyst Full timeAbout UsAt Health Catalyst, we're revolutionizing the healthcare industry by harnessing the power of technology to drive innovation and excellence. As a leader in data engineering, we're pushing the boundaries of what's possible in software development.Job Summary/ResponsibilitiesWe're seeking an exceptional Senior Software Development Engineer with 6+ years...
-
Kafka engineers
4 weeks ago
Hyderabad, India CriticalRiver Inc. Full timeJob Title: Kafka Lead Experience 10+ yrs. Location: Hyderabad Scope The scope of work involves the finalization and optimization of the Kafka Streams solution for the IEE job, focusing on achieving production-level performance, scalability, observability, and cost efficiency. The key objectives are outlined as follows: Cost Optimization ...
