Senior Real-Time Data Engineer Wanted

17 hours ago

Chennai, Tamil Nadu, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,00,00,000

About Us

We are a global healthcare partner delivering strategic innovation and IT expertise to organizations in the healthcare sector.

As a leading provider of next-generation solutions, we bring unique insights into healthcare operations, helping our partners deliver superior consumer experiences.

We are committed to integrity, diversity, and inclusion, making us an equal opportunity employer.

Job Overview

We seek a seasoned Lead Data Engineer with expertise in Apache Kafka, Apache Flink, and real-time data processing to build and optimize data pipelines, stream processing applications, and scalable ingestion architectures using Confluent Kafka ecosystem components.

This role requires passion for building high-performance, real-time data systems in a fast-paced collaborative environment.

Key Responsibilities

  • Design and develop scalable real-time and batch data pipelines using Kafka, Flink, Kafka Connect, and ksqlDB.
  • Implement and manage Kafka Connectors to integrate with diverse data sources (APIs, databases, message queues).
  • Build robust Flink applications for complex event processing, enrichment, and real-time analytics.
  • Write and optimize ksqlDB queries for transformations, filters, and aggregations.
  • Implement data quality monitoring, validation, and automated testing for pipelines.
  • Identify performance bottlenecks and optimize streaming architectures.
  • Contribute to DevOps automation for deployment, monitoring, and maintenance of data pipelines.
  • Stay updated with industry best practices in streaming technologies and lead internal adoption of standards.
  • Collaborate with architects and tech leads to deliver Proof of Concepts (POCs) and Minimum Viable Products (MVPs).
  • Participate in Agile ceremonies, code reviews, and provide project updates.

Required Skills

  • Bachelor or Master degree in Computer Science, Engineering, or related field.
  • 8+ years of experience in Data Engineering, with strong background in Kafka and Big Data systems.
  • Deep expertise in Apache Flink for stream processing.
  • Strong experience with Confluent Kafka, including Kafka Brokers, Producers/Consumers, and Schema Registry.
  • Solid knowledge of Kafka Connect and ksqlDB.
  • Proficient in building and deploying large-scale ETL/ELT and ingestion frameworks.
  • Hands-on experience with big data stack on cloud platform.
  • Self-motivated with ability to work independently and within team.

Preferred Qualifications

  • Experience working on Google Cloud Platform.
  • Prior exposure to Healthcare domain and data compliance practices.
  • Familiarity with Agile development methodologies.

  • Senior Data Engineering Specialist

    6 days ago

    Chennai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Senior Data Engineering SpecialistAbout the Role:We are seeking a highly skilled and experienced Senior Data Engineering Specialist to join our organization. The ideal candidate will have expertise in designing, building, and maintaining robust data pipelines, optimizing data workflows, and ensuring high-quality data availability for business...

  • Digital Engineering Senior Engineer

    2 days ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Req ID 305565NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Digital Engineering Senior Engineer to join our team in Chennai Tamil Nxc4x81du IN-TN India IN Job Duties ...

  • Real-Time Data Solutions Architect

    18 hours ago

    Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 22,00,000 - ₹ 28,00,000

    Real-Time Data EngineerThis role will be instrumental in building and maintaining robust, scalable, and reliable data pipelines using Confluent Kafka, ksqlDB, Kafka Connect, and Apache Flink.The ideal candidate will have a strong understanding of data streaming concepts, experience with real-time data processing, and a passion for building high-performance...

  • Data Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India Quantrail Data Full time

    Location: Chennai, India (On-site)Duration: 3 monthsStipend: UnpaidEligibility: 2025 graduates onlyConversion: Opportunity for a full-time role based on performance Note: Please apply only if you are serious about joining us. This is a learning-focused internship, and we expect interns to be committed to upskilling themselves and contributing to real-world...

  • Kafka Real-Time Data Pipelines Specialist

    1 day ago

    Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 12,50,000 - ₹ 17,50,000

    Real-Time Data EngineerJob Description:A forward-thinking company dedicated to empowering businesses with intelligent automation and seamless digital integration is seeking a skilled Real-Time Data Engineer. The ideal candidate will be responsible for designing, implementing, and managing real-time data pipelines using Apache Kafka.The successful candidate...

  • Senior Data Engineering Specialist

    5 days ago

    Chennai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Senior Data Engineering SpecialistWe are seeking a highly skilled and experienced Senior Data Engineering Specialist to design, develop, and maintain large-scale data processing systems using Hadoop ecosystem, Spark, and other distributed frameworks.Key Responsibilities:Develop scalable Big Data solutions that meet business needs and drive...

  • Senior Data Engineer

    5 days ago

    Chennai, Tamil Nadu, India APPIT Software Inc Full time

    Senior Data EngineerLocation: ChennaiJob Type: Contract, 5 monthsExperience: 5-7 yearsJob Summary:We are hiring a Senior Data Engineer to architect enterprise data integration initiatives. This role requires deep technical expertise in data engineering. Familiarity with Oracle Data Integrator (ODI) is preferred, especially in environments using the Oracle...

  • Senior Artificial Intelligence Engineer

    24 minutes ago

    Chennai, Tamil Nadu, India Eucloid Data Solutions Full time US$ 1,50,000 - US$ 2,00,000 per year

    About The Role: Senior Artificial Intelligence Engineer - Gen AIWe are looking for a high-energy tech-savvy individual for the role of Senior AI Engineer- GenAI at Eucloid. The candidate will solve complex problems, picking up new technologies and working at the cutting edge of innovation.The candidate is expected to lead following work-streams:Develop and...

  • Senior Data Engineer

    3 days ago

    Chennai, Tamil Nadu, India APPIT Software Inc Full time

    Senior Data Engineer Location: Chennai Job Type: Contract, 5 months Experience: 5-7 years Job Summary: We are hiring a Senior Data Engineer to architect enterprise data integration initiatives. This role requires deep technical expertise in data engineering. Familiarity with Oracle Data Integrator (ODI) is preferred, especially in environments using...

  • Real-Time Analytics Systems Engineer

    3 days ago

    Chennai, Tamil Nadu, India beBeeData Full time ₹ 18,00,000 - ₹ 25,00,000

    Job TitleAs a Data Architect, you will lead the design and implementation of real-time analytics systems using Apache Druid. This role is ideal for professionals with a passion for data engineering who can drive business insights through scalable data architectures.Key Responsibilities:Design and implement robust data models leveraging expertise in SQL,...