Kafka Real-Time Data Pipelines Specialist

1 day ago


Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 12,50,000 - ₹ 17,50,000
Real-Time Data Engineer

Job Description:

A forward-thinking company dedicated to empowering businesses with intelligent automation and seamless digital integration is seeking a skilled Real-Time Data Engineer. The ideal candidate will be responsible for designing, implementing, and managing real-time data pipelines using Apache Kafka.

The successful candidate will have hands-on experience deploying and scaling Kafka clusters in production, as well as proficiency in Linux administration and shell scripting. Familiarity with Kafka Connect, Schema Registry, and Kafka Streams is also essential. Additionally, the candidate should have a solid understanding of networking, security, and data serialization formats.

Responsibilities:

  • Design and deploy real-time data pipelines using Apache Kafka
  • Manage and maintain Kafka clusters across on-prem and cloud environments
  • Build automated deployment pipelines for Kafka using tools like Ansible, Terraform, Helm, or Kubernetes
  • Ensure high availability, disaster recovery, and fault tolerance for Kafka clusters
  • Integrate Kafka with downstream systems (databases, data lakes, stream processors, analytics platforms)

Required Skills:

  • Strong hands-on experience deploying and scaling Kafka clusters in production
  • Proficiency in Linux administration and shell scripting
  • Familiarity with Kafka Connect, Schema Registry, and Kafka Streams
  • Experience with CI/CD pipelines and infrastructure-as-code tools

Benefits:

  • Competitive salary and benefits package
  • Opportunities for career growth and professional development
  • Collaborative and dynamic work environment


  • Chennai, Tamil Nadu, India beBeeKafkaIntegration Full time ₹ 1,04,000 - ₹ 1,30,878

    Kafka Integration ProfessionalWe are seeking a highly skilled Kafka Integration Specialist with extensive experience in designing, developing, and integrating Apache Kafka solutions. You will be responsible for creating and maintaining robust, real-time integration pipelines, ensuring high availability, scalability, and performance.Key...


  • Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 22,00,000 - ₹ 28,00,000

    Real-Time Data EngineerThis role will be instrumental in building and maintaining robust, scalable, and reliable data pipelines using Confluent Kafka, ksqlDB, Kafka Connect, and Apache Flink.The ideal candidate will have a strong understanding of data streaming concepts, experience with real-time data processing, and a passion for building high-performance...


  • Chennai, Tamil Nadu, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,00,00,000

    About UsWe are a global healthcare partner delivering strategic innovation and IT expertise to organizations in the healthcare sector.As a leading provider of next-generation solutions, we bring unique insights into healthcare operations, helping our partners deliver superior consumer experiences.We are committed to integrity, diversity, and inclusion,...


  • Chennai, Tamil Nadu, India beBeeSpecialist Full time ₹ 17,00,000 - ₹ 23,00,000

    Real-Time Calling SpecialistWe are seeking a skilled Real-Time Calling Specialist to join our team and play a pivotal role in designing, scaling, and optimizing real-time calling pipelines for AI voice agents.Key Responsibilities:Design and scale real-time calling pipelines for ultra-low latency and reliability.Develop and integrate LiveKit, SIP/CPaaS, and...


  • Chennai, Tamil Nadu, India beBeeInfrastructure Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Kafka Infrastructure EngineerResponsibilitiesKafka Cluster Deployment and Management: Deploy and manage production-grade Kafka clusters, ensuring high availability and fault tolerance.Automated Installation and Configuration: Automate the installation and configuration of Kafka clusters using tools such as Ansible and Chef.Critical Issue...

  • Kafka Engineer

    1 day ago


    Chennai, Tamil Nadu, India BAPON Full time

    Job DescriptionCompany DescriptionBAPON is a forward-thinking IT consulting company dedicated to empowering businesses with intelligent automation, seamless digital integration, and transformative cloud solutions. We are Cyber Essential Plus and ISO 9001 & ISO 27001 certified, ensuring the highest standards of quality, security, and compliance. Our core...


  • Chennai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Key Responsibilities:Develop and implement large-scale data infrastructureDesign and build real-time data processing systems using technologies like Kafka, Flink, and SparkRequirements:Proficiency in Data Engineering, including experience with Kafka, Flink, and SparkExpertise in Data Architecture and DesignExperience with Extract Transform Load (ETL)...


  • Chennai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 9,00,000 - ₹ 12,00,000

    Data Engineering SpecialistWe are seeking an experienced professional to fill a Data Engineer role at our organization.Key Responsibilities:Design and implement data pipelines using Azure Data Factory, Apache Kafka, and Microsoft Event Hubs.Develop real-time and close-to-real-time data integrations using Python and relevant tools.Experience developing...


  • Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    About the JobRole Overview :The ideal candidate will have deep expertise in real-time data streaming, cloud-based data platforms, and large-scale data processing, particularly within the healthcare domain. We're seeking a highly skilled individual with a strong background in Kafka, Python, and Azure Databricks to drive our projects.This role demands strong...


  • Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Exciting Data Engineer Role AwaitsWe are seeking an accomplished Data Engineer to spearhead the design, development, and optimization of large-scale data systems. Strong expertise in ETL/ELT, big data, and real-time data streaming is essential.Key Responsibilities:Design, develop, and optimize complex Flink applications for real-time stream processing and...