Kafka Engineer

4 weeks ago

Bengaluru, India Risemet Staffing LLP Full time

We are seeking a highly skilled and experienced Kafka Engineer to join our growing data engineering team.

You will play a critical role in designing, developing, maintaining, and optimizing our Kafka streaming platform.

You will leverage your in-depth knowledge of Apache Kafka and related technologies to ensure the scalability, performance, and reliability of our real-time data pipelines.

Responsibilities :

- Design, develop, and implement scalable and fault-tolerant data pipelines using Kafka topics, producers, and consumers.

- Configure and manage Kafka clusters for high availability, performance, and security.

- Monitor and troubleshoot Kafka infrastructure to identify and resolve performance issues and potential bottlenecks.

- Implement security best practices for user access control, data encryption, and authorization within the Kafka ecosystem.

- Integrate Kafka with other data platforms and tools (e.g., Spark, Flink, databases) for efficient data processing and analysis.


- Collaborate with data analysts, data scientists, and software engineers to understand data needs and translate them into robust Kafka solutions.


- Automate Kafka deployments and configurations using infrastructure as code (IaC) tools (e.g., Terraform, Ansible).


- Stay up-to-date with the latest advancements in Kafka and related streaming technologies (KStream, Kafka Streams API).

- Develop and maintain documentation for Kafka configurations and deployments for ongoing maintenance and knowledge sharing.

Qualifications :

- Educational Qualifications : Bachelor's/Master's

- 4-7 years of experience as a Kafka Engineer, Data Engineer, or a similar role.

- In-depth knowledge of Apache Kafka architecture, concepts (producers, consumers, topics, partitions, etc.), and functionalities.

- Experience with configuring and managing Kafka clusters (single-node or distributed deployments).

- Experience with monitoring Kafka metrics (e.g., consumer lags, offsets, replication) and troubleshooting performance issues.

- Familiarity with Kafka security features (e.g., SASL, ACLs) and best practices for securing the platform.

- Experience with integrating Kafka with other big data tools and technologies.

- Experience with infrastructure as code (IaC) tools for infrastructure automation.

- Proficient in writing shell scripting for automation tasks.

- Excellent problem-solving, analytical, and debugging skills.

- Strong communication, collaboration, and teamwork skills.

- Ability to work independently, manage multiple tasks effectively, and meet deadlines.

(ref:hirist.tech)

  • Kafka Data Engineer

    2 months ago

    Bengaluru, India Codersbrain technology pvt ltd Full time

    Mandatory skills : - Azure, Kafka, Data Engineering or any Data Platforms background- Experience with Azure/MS Data Platforms: Postgres Single and Flex, Azure SQL, MS SQL server, Kubernetes- Terraform (Preferred not Compulsory), Bicep or other IaC.- Helm (helm deployments as well writing charts).- Azure DevOps pipelines.- Engineer, Data Engineer, or similar...

  • Kafka Data Engineer

    4 weeks ago

    Bengaluru, India Codersbrain technology pvt ltd Full time

    Mandatory skills : - Azure, Kafka, Data Engineering or any Data Platforms background- Experience with Azure/MS Data Platforms: Postgres Single and Flex, Azure SQL, MS SQL server, Kubernetes- Terraform (Preferred not Compulsory), Bicep or other IaC.- Helm (helm deployments as well writing charts).- Azure DevOps pipelines.- Engineer, Data Engineer, or similar...

  • Kafka Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Codersbrain technology pvt ltd Full time

    Mandatory skills :Azure, Kafka, Data Engineering or any Data Platforms background Experience with Azure/MSData Platforms: Postgres Single and Flex, Azure SQL, MS SQL server, Kubernetes Terraform (Preferred not Compulsory), Bicep or other IaC. Helm (helm deployments as well writing charts). Azure DevOps pipelines. Engineer, Data Engineer, or similar roles...

  • Kafka Developer

    2 weeks ago

    Bengaluru, Karnataka, India Horigine Consulting Pvt. Ltd Full time

    We are seeking a highly skilled Kafka Developer to join our team. As a Kafka Developer, you will be responsible for designing, developing, and implementing Kafka-based solutions for our organization. You will collaborate with cross-functional teams to understand business requirements, architect robust Kafka solutions, and ensure the reliable and efficient...

  • Kafka Developer

    2 weeks ago

    Bengaluru, Karnataka, India Horigine Consulting Pvt. Ltd Full time

    We are seeking a highly skilled Kafka Developer to join our team. As a Kafka Developer, you will be responsible for designing, developing, and implementing Kafka-based solutions for our organization. You will collaborate with cross-functional teams to understand business requirements, architect robust Kafka solutions, and ensure the reliable and efficient...

  • Kafka Architect

    2 months ago

    Bengaluru, India ConnectPro Management Consultants Pvt Ltd. Full time

    Work Location: Bangalore. Hybrid model - Working in office 3 days in a week. Experience : 8+ Years. We are looking for a Kafka Architect who can Work alongside multiple Production Support, Development, System Admin, Project Managers and Engineering teams.Key Responsibilities: - Design, deploy, and manage Kafka clusters in a production environment, ensuring...

  • Kafka Architect

    4 weeks ago

    Bengaluru, India ConnectPro Management Consultants Pvt Ltd. Full time

    Work Location: Bangalore. Hybrid model - Working in office 3 days in a week. Experience : 8+ Years. We are looking for a Kafka Architect who can Work alongside multiple Production Support, Development, System Admin, Project Managers and Engineering teams.Key Responsibilities: - Design, deploy, and manage Kafka clusters in a production environment, ensuring...

  • Kafka Architect

    2 weeks ago

    Bengaluru, Karnataka, India ConnectPro Management Consultants Pvt Ltd. Full time

    Work Location: Bangalore.Hybrid model - Working in office 3 days in a week.Experience : 8+ Years. We are looking for a Kafka Architect who can Work alongside multiple Production Support, Development, System Admin, Project Managers and Engineering teams.Key Responsibilities: Design, deploy, and manage Kafka clusters in a production environment, ensuring high...

  • Kafka Administrator

    3 weeks ago

    Bengaluru, India Atos Full time

    Hiring Kafka Administrator, strong in Migration experience. Please find below details for the reference.Location: Bangalore/ChennaiExperience: 8-14 yearsInterested can drop your profile to Kafka migration engineer• Hands-on Kafka Administration experience in managing all applications.• Design, create, and manage Kafka topics based on business...

  • Kafka Administrator

    2 weeks ago

    Bengaluru, Karnataka, India Atos Full time

    Hiring Kafka Administrator, strong in Migration experience. Please find below details for the reference.Location: Bangalore/Chennai Experience: 8-14 years Interested can drop your profile to Kafka migration engineer Hands-on Kafka Administration experience in managing all applications. Design, create, and manage Kafka topics based on business requirements....

  • Kafka Administrator

    4 weeks ago

    Bengaluru, India Atos Full time

    Hiring Kafka Administrator, strong in Migration experience. Please find below details for the reference. Location: Bangalore/Chennai Experience: 8-14 years Interested can drop your profile to Kafka migration engineer • Hands-on Kafka Administration experience in managing all applications. • Design, create, and manage Kafka topics based on business...

  • Kafka Administrator

    2 weeks ago

    Bengaluru, Karnataka, India Atos Full time

    Hiring Kafka Administrator, strong in Migration experience. Please find below details for the reference.Location: Bangalore/ChennaiExperience: 8-14 yearsInterested can drop your profile to Kafka migration engineer Hands-on Kafka Administration experience in managing all applications. Design, create, and manage Kafka topics based on business requirements....

  • Kafka Administrator

    1 month ago

    Bengaluru, India Atos Full time

    Hiring Kafka Administrator, strong in Migration experience. Please find below details for the reference.Location: Bangalore/ChennaiExperience: 8-14 yearsInterested can drop your profile to saravanan.g@atos.netKafka migration engineer• Hands-on Kafka Administration experience in managing all applications.• Design, create, and manage Kafka topics based on...

  • Kafka Administrator

    1 month ago

    Bengaluru, India Atos Full time

    Hiring Kafka Administrator, strong in Migration experience. Please find below details for the reference.Location: Bangalore/ChennaiExperience: 8-14 yearsInterested can drop your profile to saravanan.g@atos.netKafka migration engineer• Hands-on Kafka Administration experience in managing all applications.• Design, create, and manage Kafka topics based on...

  • Kafka Administrator

    2 weeks ago

    Bengaluru, Karnataka, India Atos Full time

    Hiring for a skilled Kafka Administrator with a focus on Migration expertise. Take note of the details provided below:Location: Bangalore/ChennaiExperience: 8-14 yearsIf this opportunity interests you, kindly share your profile details.Kafka Migration EngineerHands-on experience in Kafka Administration to manage all applications efficiently.Design, create,...

  • Kafka Administrator

    3 weeks ago

    Bengaluru, India Atos Full time

    Hiring Kafka Administrator, strong in Migration experience. Please find below details for the reference.Location: Bangalore/ChennaiExperience: 8-14 yearsInterested can drop your profile to saravanan.g@atos.netKafka migration engineer• Hands-on Kafka Administration experience in managing all applications.• Design, create, and manage Kafka topics based on...

  • Kafka Administrator

    4 weeks ago

    Bengaluru, India Atos Full time

    Hiring Kafka Administrator, strong in Migration experience. Please find below details for the reference.Location: Bangalore/ChennaiExperience: 8-14 yearsInterested can drop your profile to saravanan.g@atos.netKafka migration engineer• Hands-on Kafka Administration experience in managing all applications.• Design, create, and manage Kafka topics based on...

  • Kafka engineer

    2 weeks ago

    Noida, Bengaluru / Bangalore, India Anri FS Private Limited Full time

    1. Linux knowledge, security permissions as well as shell scripting and SSH for binary deployments.2. GIT and source code management3. Java and its upgrades, JMX, JVM monitoring, Threading, debugging4. Spring Cloud Streams API, Spring Integration API5. Networking, Firewall, Load Balancer concepts to be able to troubleshoot data access issues and new...

  • KAFKA Developer

    4 days ago

    Bengaluru, India Tata Technologies Full time

    At least 6-7 years of relevant experience in designing and implementing software solutions, using Apache Kafka.Experience and deep understanding of event-driven architectures, including hands-on experience in managing Kafka platform. Solid understanding of Site Reliability Engineering principles and methodologies. Strong communication and collaboration...

  • KAFKA Developer

    2 weeks ago

    Bengaluru, India Tata Technologies Full time

    At least 6-7 years of relevant experience in designing and implementing software solutions, using Apache Kafka.Experience and deep understanding of event-driven architectures, including hands-on experience in managing Kafka platform. Solid understanding of Site Reliability Engineering principles and methodologies. Strong communication and collaboration...