
Kafka Real-Time Data Pipelines Specialist
1 day ago
Job Description:
A forward-thinking company dedicated to empowering businesses with intelligent automation and seamless digital integration is seeking a skilled Real-Time Data Engineer. The ideal candidate will be responsible for designing, implementing, and managing real-time data pipelines using Apache Kafka.
The successful candidate will have hands-on experience deploying and scaling Kafka clusters in production, as well as proficiency in Linux administration and shell scripting. Familiarity with Kafka Connect, Schema Registry, and Kafka Streams is also essential. Additionally, the candidate should have a solid understanding of networking, security, and data serialization formats.
Responsibilities:
- Design and deploy real-time data pipelines using Apache Kafka
- Manage and maintain Kafka clusters across on-prem and cloud environments
- Build automated deployment pipelines for Kafka using tools like Ansible, Terraform, Helm, or Kubernetes
- Ensure high availability, disaster recovery, and fault tolerance for Kafka clusters
- Integrate Kafka with downstream systems (databases, data lakes, stream processors, analytics platforms)
Required Skills:
- Strong hands-on experience deploying and scaling Kafka clusters in production
- Proficiency in Linux administration and shell scripting
- Familiarity with Kafka Connect, Schema Registry, and Kafka Streams
- Experience with CI/CD pipelines and infrastructure-as-code tools
Benefits:
- Competitive salary and benefits package
- Opportunities for career growth and professional development
- Collaborative and dynamic work environment
-
Data Pipeline Engineer
2 days ago
Chennai, Tamil Nadu, India beBeeKafkaIntegration Full time ₹ 1,04,000 - ₹ 1,30,878Kafka Integration ProfessionalWe are seeking a highly skilled Kafka Integration Specialist with extensive experience in designing, developing, and integrating Apache Kafka solutions. You will be responsible for creating and maintaining robust, real-time integration pipelines, ensuring high availability, scalability, and performance.Key...
-
Real-Time Data Solutions Architect
18 hours ago
Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 22,00,000 - ₹ 28,00,000Real-Time Data EngineerThis role will be instrumental in building and maintaining robust, scalable, and reliable data pipelines using Confluent Kafka, ksqlDB, Kafka Connect, and Apache Flink.The ideal candidate will have a strong understanding of data streaming concepts, experience with real-time data processing, and a passion for building high-performance...
-
Senior Real-Time Data Engineer Wanted
18 hours ago
Chennai, Tamil Nadu, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,00,00,000About UsWe are a global healthcare partner delivering strategic innovation and IT expertise to organizations in the healthcare sector.As a leading provider of next-generation solutions, we bring unique insights into healthcare operations, helping our partners deliver superior consumer experiences.We are committed to integrity, diversity, and inclusion,...
-
Real-Time Calling Specialist
2 days ago
Chennai, Tamil Nadu, India beBeeSpecialist Full time ₹ 17,00,000 - ₹ 23,00,000Real-Time Calling SpecialistWe are seeking a skilled Real-Time Calling Specialist to join our team and play a pivotal role in designing, scaling, and optimizing real-time calling pipelines for AI voice agents.Key Responsibilities:Design and scale real-time calling pipelines for ultra-low latency and reliability.Develop and integrate LiveKit, SIP/CPaaS, and...
-
Kafka Infrastructure Specialist
3 days ago
Chennai, Tamil Nadu, India beBeeInfrastructure Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Job Title: Kafka Infrastructure EngineerResponsibilitiesKafka Cluster Deployment and Management: Deploy and manage production-grade Kafka clusters, ensuring high availability and fault tolerance.Automated Installation and Configuration: Automate the installation and configuration of Kafka clusters using tools such as Ansible and Chef.Critical Issue...
-
Kafka Engineer
1 day ago
Chennai, Tamil Nadu, India BAPON Full timeJob DescriptionCompany DescriptionBAPON is a forward-thinking IT consulting company dedicated to empowering businesses with intelligent automation, seamless digital integration, and transformative cloud solutions. We are Cyber Essential Plus and ISO 9001 & ISO 27001 certified, ensuring the highest standards of quality, security, and compliance. Our core...
-
Master Data Architect
4 days ago
Chennai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 1,20,00,000 - ₹ 2,00,00,000Key Responsibilities:Develop and implement large-scale data infrastructureDesign and build real-time data processing systems using technologies like Kafka, Flink, and SparkRequirements:Proficiency in Data Engineering, including experience with Kafka, Flink, and SparkExpertise in Data Architecture and DesignExperience with Extract Transform Load (ETL)...
-
Data Engineering Specialist
4 days ago
Chennai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 9,00,000 - ₹ 12,00,000Data Engineering SpecialistWe are seeking an experienced professional to fill a Data Engineer role at our organization.Key Responsibilities:Design and implement data pipelines using Azure Data Factory, Apache Kafka, and Microsoft Event Hubs.Develop real-time and close-to-real-time data integrations using Python and relevant tools.Experience developing...
-
Data Infrastructure Specialist
18 hours ago
Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000About the JobRole Overview :The ideal candidate will have deep expertise in real-time data streaming, cloud-based data platforms, and large-scale data processing, particularly within the healthcare domain. We're seeking a highly skilled individual with a strong background in Kafka, Python, and Azure Databricks to drive our projects.This role demands strong...
-
Chief Data Engineering Specialist
12 hours ago
Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Exciting Data Engineer Role AwaitsWe are seeking an accomplished Data Engineer to spearhead the design, development, and optimization of large-scale data systems. Strong expertise in ETL/ELT, big data, and real-time data streaming is essential.Key Responsibilities:Design, develop, and optimize complex Flink applications for real-time stream processing and...