Real-Time Data Systems Architect

4 days ago

Chennai, Tamil Nadu, India beBeeDataEngineer Full time US$ 12,00,000 - US$ 18,00,000

As a Lead Data Engineer at Thryve Digital Health LLP, you will be responsible for designing and building scalable real-time data pipelines using Apache Kafka, Apache Flink, and Confluent Kafka ecosystem components.

Role Summary:

We are looking for an experienced professional with strong expertise in stream processing technologies, particularly Apache Flink. This role will involve implementing and managing data pipelines, building robust applications for complex event processing, enrichment, and real-time analytics, as well as staying up-to-date with industry best practices.

This is a high-performance, real-time data systems role in a fast-paced collaborative environment. As a Lead Data Engineer, you will design and develop scalable data architectures using Kafka, Flink, Kafka Connect, and ksqlDB, and contribute to DevOps automation for deployment, monitoring, and maintenance of data pipelines.

Key Responsibilities:
  1. Design and develop scalable real-time and batch data pipelines using Kafka, Flink, Kafka Connect, and ksqlDB.
  2. Implement and manage Kafka Connectors to integrate with diverse data sources (APIs, databases, message queues).
  3. Build robust Flink applications for complex event processing, enrichment, and real-time analytics.
  4. Write and optimize ksqlDB queries for transformations, filters, and aggregations.
Required Qualifications:
  • Bachelors or Masters degree in Computer Science, Engineering, or related discipline.
  • 8+ years of experience in Data Engineering, with a strong background in Kafka and Big Data systems.
  • Deep expertise in Apache Flink for stream processing.
  • Strong experience with Confluent Kafka, including Kafka Brokers, Producers/Consumers, and Schema Registry.
  • Solid knowledge of Kafka Connect and ksqlDB.
  • Proficient in building and deploying large-scale ETL/ELT and ingestion frameworks.
  • Hands-on experience with big data stack on any cloud platform (GCP, AWS, or Azure).
  • Self-motivated with the ability to work both independently and within a team.
Preferred Qualifications:
  • Experience working on Google Cloud Platform (GCP).
  • Prior exposure to the Healthcare domain and data compliance practices.

  • Real-Time Data Solutions Architect

    2 weeks ago

    Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 22,00,000 - ₹ 28,00,000

    Real-Time Data EngineerThis role will be instrumental in building and maintaining robust, scalable, and reliable data pipelines using Confluent Kafka, ksqlDB, Kafka Connect, and Apache Flink.The ideal candidate will have a strong understanding of data streaming concepts, experience with real-time data processing, and a passion for building high-performance...

  • Real-Time Analytics Systems Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India beBeeData Full time ₹ 18,00,000 - ₹ 25,00,000

    Job TitleAs a Data Architect, you will lead the design and implementation of real-time analytics systems using Apache Druid. This role is ideal for professionals with a passion for data engineering who can drive business insights through scalable data architectures.Key Responsibilities:Design and implement robust data models leveraging expertise in SQL,...

  • Data Architect

    7 days ago

    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Job Title: Data Architect – AWS & GCP Experience: 11 Years Location: Remote / Hybrid Job Type: Full-timeAbout the Role:We are seeking an experienced Data Architect with deep expertise in AWS and Google Cloud Platform (GCP). The ideal candidate will have a proven track record in designing and implementing scalable, secure, and high-performance data...

  • Leading Data Engineer

    3 days ago

    Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 8,00,000 - ₹ 12,00,000

    Key Roles and Responsibilities:We are seeking a seasoned professional to spearhead the development of large-scale data processing systems. The ideal candidate will have extensive experience in designing and implementing real-time stream and batch data processing systems, as well as excellent programming skills in Python or similar languages.The successful...

  • Senior Real-Time Data Engineer Wanted

    2 weeks ago

    Chennai, Tamil Nadu, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,00,00,000

    About UsWe are a global healthcare partner delivering strategic innovation and IT expertise to organizations in the healthcare sector.As a leading provider of next-generation solutions, we bring unique insights into healthcare operations, helping our partners deliver superior consumer experiences.We are committed to integrity, diversity, and inclusion,...

  • Data Architect

    2 weeks ago

    Chennai, Tamil Nadu, India Capgemini Engineering Full time

    Data Architect / Data EngineerLocation: ChennaiExperience: 4–6 yearsYour RoleAs a Data Architect / Data Engineer, you will be responsible for creating and maintaining digital twin models and integrating real-time data streams to support simulation and analytics in maritime systems. You will work with advanced tools and platforms to build scalable,...

  • Data Architect

    2 weeks ago

    Chennai, Tamil Nadu, India Capgemini Engineering Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Data Architect / Data EngineerLocation:ChennaiExperience:4–6 yearsYour RoleAs a Data Architect / Data Engineer, you will be responsible for creating and maintaining digital twin models and integrating real-time data streams to support simulation and analytics in maritime systems. You will work with advanced tools and platforms to build scalable,...

  • Data Architect

    2 weeks ago

    Chennai, Tamil Nadu, India Capgemini Engineering Full time

    Data Architect / Data Engineer Location: Chennai Experience: 4–6 years Your Role As a Data Architect / Data Engineer, you will be responsible for creating and maintaining digital twin models and integrating real-time data streams to support simulation and analytics in maritime systems. You will work with advanced tools and platforms to build scalable,...

  • Data Architect

    1 week ago

    Chennai, Tamil Nadu, India Capgemini Engineering Full time

    Data Architect / Data EngineerLocation: ChennaiExperience: 4–6 yearsYour RoleAs a Data Architect / Data Engineer, you will be responsible for creating and maintaining digital twin models and integrating real-time data streams to support simulation and analytics in maritime systems. You will work with advanced tools and platforms to build scalable,...

  • Kafka Real-Time Data Pipelines Specialist

    2 weeks ago

    Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 12,50,000 - ₹ 17,50,000

    Real-Time Data EngineerJob Description:A forward-thinking company dedicated to empowering businesses with intelligent automation and seamless digital integration is seeking a skilled Real-Time Data Engineer. The ideal candidate will be responsible for designing, implementing, and managing real-time data pipelines using Apache Kafka.The successful candidate...