Kafka Architecture Engineer

2 days ago


Hyderabad, Telangana, India Health Catalyst Full time

About Health Catalyst

We are a fast-growing company that values smart, hardworking, and humble individuals. Each product team is a small, mission-critical team focused on developing innovative tools to support our mission to improve healthcare performance, cost, and quality.

Job Summary/Responsibilities

We're looking for a Senior Software Development Engineer with 6+ years of experience to join our team in designing, implementing, and maintaining complex distributed systems in an AWS environment. The ideal candidate will have extensive experience in data engineering, team leadership, and Apache Kafka.

Key Responsibilities:

  • Design and implement robust and scalable Kafka pipelines using AWS MSK and Kafka Connect.
  • Create advanced Kafka connectors for various data stores, including RDS, DocumentDB, S3, OpenSearch, and potentially AWS KeySpaces and ScyllaDB.
  • Develop Single Message Transformations (SMTs) for sophisticated ETL operations.
  • Implement best practices for logging and observability using AWS CloudWatch.
  • Develop comprehensive automation solutions using shell scripting and other technologies.

Requirements:

  • Bachelor's or Master's degree in Computer Science, Engineering, or related field.
  • 5+ years of extensive experience working with Apache Kafka and its ecosystem.
  • Strong Java programming skills with experience in developing Kafka producers.
  • Deep understanding of AWS services, particularly MSK, EC2, CloudWatch, and other relevant data services.
  • Expert-level knowledge of Kafka Connect and developing custom connectors.

Preferred Qualifications:

  • Experience with additional AWS services like AWS KeySpaces and Aurora.
  • Knowledge of emerging technologies in the data streaming space.
  • Contributions to open-source Kafka projects or connectors.

"Our team works closely together to design, develop, and deploy scalable and efficient data processing systems. If you're passionate about building complex software systems and leading your team towards success, this could be the perfect opportunity for you."

"We offer a competitive salary range: $160,000 - $200,000 per year, depending on experience",

Estimated Salary: $180,000

Location: Flexible work arrangement

We provide excellent benefits, including health insurance, retirement savings plan, paid time off, and opportunities for growth and professional development.

Industry Leading Benefits



  • Hyderabad, Telangana, India Criticalriver Technologies Full time

    About Distributed Streaming Systems Expert Role at CriticalRiver Technologies: We are seeking an experienced Distributed Streaming Systems Expert to lead our efforts in designing, implementing, and maintaining distributed streaming platforms using Apache Kafka. The ideal candidate will have expertise in building real-time data streaming pipelines and...


  • Hyderabad, Telangana, India Tata Consultancy Services Full time

    At Tata Consultancy Services, we are seeking a highly skilled Kafka Systems Architect to join our team.The ideal candidate will have a minimum of 6 to 8 years of experience in designing and developing event-based architecture based on Kafka & Kafka streams.This is an exceptional opportunity for a talented professional to lead architecture discussions and...


  • Hyderabad, Telangana, India Criticalriver Technologies Full time

    About CriticalRiver Technologies:CriticalRiver Technologies is a technology consulting and IT services firm empowering its workforce to have a direct stake in the company's growth and success. We are committed to fostering a culture of innovation, growth, and collaboration where your ideas and leadership will thrive.Job Overview:The estimated salary for this...

  • Software Engineer

    4 weeks ago


    Hyderabad, Telangana, India INTVERSE IT SOLUTIONS PRIVATE LIMITED Full time

    Job OverviewWe are seeking a highly skilled Software Engineer to join our team as a Microservices Architecture Specialist. This is a full-time, permanent position based in Hyderabad with the option to work remotely or from an office location as per preference.About the RoleThe successful candidate will be responsible for designing, developing, and deploying...

  • Software Engineer

    4 weeks ago


    Hyderabad, Telangana, India Ingrain Systems Inc Full time

    At Ingrain Systems Inc, we are seeking a skilled Software Engineer to join our team as a Cloud Architect. This role will involve designing, developing, and maintaining complex software applications using Java, J2EE, and Spring Boot.We require the selected candidate to have hands-on experience with cloud platforms (AWS, Azure) for deploying and managing...


  • Hyderabad, Telangana, India LTIMindtree Full time

    Job Title: Senior Software Architecture ManagerWe are seeking a seasoned Senior Software Architecture Manager to lead our engineering teams in delivering high-quality software solutions.About the Role:Lead engineering teams to ensure successful delivery of software solutionsOversee modernization of legacy systems, integrating new technologies...

  • DevOps Professional

    2 weeks ago


    Hyderabad, Telangana, India Devops Engineer Full time

    Company Overview">We are a leading technology company seeking an experienced DevOps Engineer to join our team. The successful candidate will have a proven track record of implementing and maintaining scalable systems, with a strong understanding of microservices architecture.Job Description">The DevOps Engineer will be responsible for designing, deploying,...


  • Hyderabad, Telangana, India ANRI Solutions HR Services Full time

    **Job Title: Data Architectural Specialist**We are seeking a highly skilled Data Architectural Specialist to join our team at ANRI Solutions HR Services. The ideal candidate will have a strong background in designing and developing scalable data pipelines and architectures.Key Responsibilities:Design and implement data pipelines using Python and...


  • Hyderabad, Telangana, India Tanla Platforms Limited Full time

    Tanla Platforms Limited is seeking a highly skilled Senior Software Engineer - Microservices Architecture.About the RoleWe are looking for a talented engineer to play a pivotal role in safeguarding Tanla's assets, data, and reputation in the industry. The successful candidate will be responsible for designing and developing resilient & scalable distributed...


  • Hyderabad, Telangana, India HARP Technologies and Services Full time

    HARP Technologies and Services invites applications from highly skilled Data Streaming Engineers.Estimated Salary: $150,000 - $220,000 per annumAbout the Job:The successful candidate will have around 10-12 years of experience in various integration technologies, data streaming technologies, and Kafka architecture.Job Description:We are seeking an experienced...


  • Hyderabad, Telangana, India ANSR Full time

    At ANSR, we are seeking a highly skilled Senior Software Engineer I to join our team. This role offers a competitive salary of $150,000 per year.About the RoleThe successful candidate will be responsible for delivering large-scale cloud solutions in an agile development environment. They will have a strong background in Java/J2EE, AWS, Spring Boot,...


  • Hyderabad, Telangana, India Taggd Full time

    Job Title: Cloud Platform EngineerTaggd is seeking an experienced Cloud Platform Engineer to join our team. As a key member of our engineering department, you will be responsible for designing, building, and operating secure cloud platform services and software that meet business requirements.We are looking for someone with 7+ years of experience in...


  • Hyderabad, Telangana, India Health Catalyst Full time

    Health Catalyst is a pioneering company in the healthcare industry, poised to revolutionize the way we approach software development.We are seeking an experienced Distributed Systems Engineer to join our team and contribute to designing, implementing, and maintaining complex Kafka pipelines in an AWS environment.About UsWe're working on solving...


  • Hyderabad, Telangana, India NCR Voyix Full time

    About NCR Voyix CorporationNCR Voyix is a leading global technology company, revolutionizing how the world connects, interacts, and transacts with businesses. Headquartered in Atlanta, Georgia, USA, we serve over 100 countries across retail and restaurant organizations.Required Technical SkillsProficiency in one or more programming languages – Java,...


  • Hyderabad, Telangana, India Egen Full time

    Egen, a fast-growing and entrepreneurial company with a data-first mindset, is looking for an experienced professional to lead its platform team. The ideal candidate must have a minimum of 7+ years in the industry.Company OverviewWe bring together the best engineering talent working with advanced technology platforms to help clients drive action and impact...


  • Hyderabad, Telangana, India Selsoft Full time

    Estimated Salary: ₹27-41 LPAAbout the Job:We are seeking a seasoned Data Engineer to join our team at Selsoft. The ideal candidate will have 5+ years of experience in designing, building, and maintaining large-scale data processing systems.Main Responsibilities:Design and implement efficient data pipelines using Apache Spark, Kafka, and AWS Glue.Work with...


  • Hyderabad, Telangana, India ANSR Full time

    Job SummaryWe are seeking a seasoned Technical Director to lead our cloud architecture team at ANSR in Hyderabad, India. The successful candidate will have 10-12 years of software development experience and a deep understanding of Integration patterns and architectures.Key ResponsibilitiesManage application development projects in partnership with IT teams,...


  • Hyderabad, Telangana, India Tata Consultancy Services Full time

    Tata Consultancy Services is a leading IT services company looking to hire a skilled Senior Java Developer.Our team focuses on delivering high-quality solutions using microservices architecture, and we need an experienced professional to lead the way.The ideal candidate will have a strong background in Java, React JS, and Spring Boot, with experience in...


  • Hyderabad, Telangana, India Selsoft Full time

    Job Title: Senior Data ArchitectAbout the Role:The company is looking for a talented Data Engineer to join their team. The successful candidate will have at least 5 years of experience in designing, building and maintaining large-scale data processing systems using technologies such as Spark, Kafka and AWS Glue.Responsibilities:Design and implement scalable...


  • Hyderabad, Telangana, India Gramener Full time

    About UsGramener is a design-led data science company that builds custom Data & AI solutions to help solve complex business problems with actionable insights and compelling data stories.We partner with enterprise data and digital transformation teams to improve the data-driven decision-making culture across the organization.Our open standard low-code...