Kafka Engineer

2 days ago

Chennai, Tamil Nadu, India BAPON Full time
Job Description

Company Description

BAPON is a forward-thinking IT consulting company dedicated to empowering businesses with intelligent automation, seamless digital integration, and transformative cloud solutions. We are Cyber Essential Plus and ISO 9001 & ISO 27001 certified, ensuring the highest standards of quality, security, and compliance. Our core services include intelligent automation, digital integration, cloud transformation, and IT strategy & planning. We specialize in delivering innovative IT solutions that enhance operational efficiency and drive growth, particularly for startups and emerging companies.

Role Description

This is a contract role for a Kafka Engineer, based in Chennai. The Kafka Engineer will be responsible for designing, implementing, and managing Kafka-based data pipelines, maintaining and enhancing Kafka clusters, and ensuring high availability and performance of Kafka infrastructure. Regular tasks include monitoring Kafka environments, troubleshooting issues, collaborating with development teams to integrate Kafka solutions, and optimizing data streaming processes.

Responsibilities

- Design, deploy, and manage Apache Kafka clusters across on-prem and cloud environments.
- Handle end-to-end setup, including installation, configuration, security hardening, and monitoring.
- Build automated deployment pipelines for Kafka using tools like Ansible, Terraform, Helm, or Kubernetes.
- Ensure high availability, disaster recovery, and fault tolerance for Kafka clusters.
- Manage topics, partitions, ACLs, quotas, and schemas in line with business requirements.
- Integrate Kafka with downstream systems (databases, data lakes, stream processors, analytics platforms).
- Implement monitoring and alerting (Prometheus, Grafana, Confluent Control Center, or similar).
- Optimize performance, troubleshoot issues, and provide root cause analysis for production incidents.
- Document deployment processes and provide knowledge transfer to operations teams.

Required Skills

- Strong hands-on experience deploying and scaling Kafka clusters in production.
- Proficiency in Linux administration and shell scripting.
- Familiarity with Kafka Connect, Schema Registry, and Kafka Streams.
- Experience with CI/CD pipelines and infrastructure-as-code tools.
- Solid understanding of networking, security, and data serialization formats (Avro, Protobuf, JSON).
- Prior experience with Confluent Platform or MSK (Managed Streaming for Kafka) is a plus.

Nice to Have

- Knowledge of containerization and orchestration (Docker, Kubernetes).
- Exposure to cloud platforms (AWS, Azure, GCP) for Kafka deployments.
- Experience in performance tuning and capacity planning.

  • Kafka Platform Engineer

    1 day ago

    Chennai, Tamil Nadu, India Intraedge Technologies Ltd. Full time

    Job Description :We're looking for a highly skilled Kafka Platform Engineer with 3+ years of experience to join our team. The ideal candidate will be responsible for designing, configuring, and deploying Kafka-based event streaming solutions for our clients. You'll be a key player in ensuring seamless integration with client applications and providing expert...

  • Kafka Developer

    14 hours ago

    Chennai, Tamil Nadu, India Edify Technologies Full time US$ 90,000 - US$ 1,20,000 per year

    We are seeking a Kafka Developer with a strong focus on real-time data streaming and distributed systems. This role requires expertise in developing and managing robust data pipelines, primarily using Python, and includes significant Kafka administration responsibilities.Responsibilities:Develop & Optimize Data Streaming Solutions: Design, develop, and...

  • Kafka Systems Architect

    7 days ago

    Chennai, Tamil Nadu, India beBeeKafka Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Opportunity:Kafka Platform Engineer Role OverviewThis is an exciting opportunity to join a team as a Kafka Platform Engineer, where you will play a key role in designing, configuring, and deploying the Kafka PubSub+ event broker platform. Your primary goal will be to ensure seamless integration with client applications by understanding their specific...

  • Kafka Platform Engineer

    6 days ago

    Chennai, Tamil Nadu, India IntraEdge Full time

    Experience:- 3+YearsKafka Platform Job description:Involves designing, configuring, and deploying the Kafka PubSub+ event broker platform within a client's environment,ensuring seamless integration with their applications by understanding their specific messaging needs, and providing ongoing support for the implemented system, including troubleshooting and...

  • Kafka Platform Engineer

    4 days ago

    Chennai, Tamil Nadu, India IntraEdge Full time

    Experience:- 3+Years Kafka Platform Job description: Involves designing, configuring, and deploying the Kafka PubSub+ event broker platform within a client's environment, ensuring seamless integration with their applications by understanding their specific messaging needs, and providing ongoing support for the implemented system, including troubleshooting...

  • Kafka Platform Engineer

    1 hour ago

    Chennai, Tamil Nadu, India IntraEdge Full time

    Experience:- 3+YearsKafka Platform Job description:Involves designing, configuring, and deploying the Kafka PubSub+ event broker platform within a client's environment, ensuring seamless integration with their applications by understanding their specific messaging needs, and providing ongoing support for the implemented system, including troubleshooting and...

  • Kafka Platform Engineer

    1 week ago

    Chennai, Tamil Nadu, India IntraEdge Full time

    Experience:- 3+YearsKafka Platform Job description:Involves designing, configuring, and deploying the Kafka PubSub+ event broker platform within a client's environment,ensuring seamless integration with their applications by understanding their specific messaging needs, and providing ongoing support for the implemented system, including troubleshooting and...

  • Kafka Infrastructure Specialist

    3 days ago

    Chennai, Tamil Nadu, India beBeeInfrastructure Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Kafka Infrastructure EngineerResponsibilitiesKafka Cluster Deployment and Management: Deploy and manage production-grade Kafka clusters, ensuring high availability and fault tolerance.Automated Installation and Configuration: Automate the installation and configuration of Kafka clusters using tools such as Ansible and Chef.Critical Issue...

  • Data Pipeline Engineer

    2 days ago

    Chennai, Tamil Nadu, India beBeeKafkaIntegration Full time ₹ 1,04,000 - ₹ 1,30,878

    Kafka Integration ProfessionalWe are seeking a highly skilled Kafka Integration Specialist with extensive experience in designing, developing, and integrating Apache Kafka solutions. You will be responsible for creating and maintaining robust, real-time integration pipelines, ensuring high availability, scalability, and performance.Key...

  • Kafka Real-Time Data Pipelines Specialist

    2 days ago

    Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 12,50,000 - ₹ 17,50,000

    Real-Time Data EngineerJob Description:A forward-thinking company dedicated to empowering businesses with intelligent automation and seamless digital integration is seeking a skilled Real-Time Data Engineer. The ideal candidate will be responsible for designing, implementing, and managing real-time data pipelines using Apache Kafka.The successful candidate...