Leading Kafka Engineer

1 week ago

Ghaziabad, Uttar Pradesh, India beBeeKafka Full time ₹ 20,00,000 - ₹ 25,00,000

Job Overview

We are seeking a seasoned Kafka Engineer to lead the development and maintenance of our production-grade Kafka infrastructure. In this role, you will be responsible for designing and implementing high-availability and fault-tolerant Kafka clusters using industry-standard tools.

You will develop automation scripts using Ansible and Chef to streamline the installation and configuration process, troubleshoot critical production issues, optimize Kafka performance, and minimize downtime. Additionally, you will configure MirrorMaker for data replication between two data centers, ensuring effective disaster recovery and deploying Provectus Kafka UI on a Kubernetes cluster for real-time monitoring and management.

You will integrate Schema Registry and deploy multiple Kafka Connectors to facilitate seamless data flow, onboard new users by managing ACL permissions, creating topics, and implementing end-to-end security with SSL/TLS. Furthermore, you will design and manage Kafka infrastructure to enhance message processing efficiency, conduct performance testing to optimize partitioning, replication, and retention policies, and integrate Kafka with ELK Stack and Solr for scalable data storage and analysis.

Requirements

Bachelor's degree in Computer Science or related field.

3+ years of experience with Kafka clusters, MirrorMaker, Kafka Streams, Schema Registry, Kubernetes, Docker, Ansible, Terraform, Monitoring & Logging, Programming & Scripting, Shell Scripting.

About the Role

This is an exciting opportunity to work with a team passionate about delivering high-quality products and services that meet the evolving needs of our customers.

  • Lead Kafka Developer

    7 days ago

    Ghaziabad, Uttar Pradesh, India beBeeKafka Full time ₹ 12,00,000 - ₹ 20,00,000

    Job OpportunityWe are seeking a skilled Kafka Architect to join our team. As a Kafka Architect, you will play a crucial role in designing and implementing large-scale messaging infrastructure, ensuring the smooth delivery, security, retention, and recoverability of topics and messages.You will be responsible for overseeing and managing multi-node Kafka...

  • Lead Data Engineering Specialist

    2 days ago

    Ghaziabad, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 1,80,00,000 - ₹ 2,10,00,000

    Senior Data Engineer JobWe are seeking a skilled Senior Data Engineer to spearhead our data engineering initiatives. The ideal candidate will have a strong background in ETL, Cloud, Data Warehousing, and Big Data ecosystems.Key Responsibilities:Design and optimize data pipelines using AWS Glue, Airflow, Databricks, StreamSets, and Snowflake.Architect...

  • Data Engineer

    4 days ago

    Ghaziabad, Uttar Pradesh, India E Solutions Full time

    Job Description- Proficiency in Python, Java, or SQL for data processing and automation.- Hands-on experience with cloud platforms (especially Azure, Snowflake, and Databricks).- Expertise in big data technologies (such as Apache Spark, Hadoop, or Kafka).- Deep understanding of data modeling, performance tuning, and optimization.- Familiarity with...

  • Expert Large Scale Distributed Systems Engineer

    2 days ago

    Ghaziabad, Uttar Pradesh, India beBeeKafkaAdministrator Full time ₹ 20,00,000 - ₹ 25,00,000

    Welcome to our Kafka Administration and Engineering roleWith 5+ years of experience in Kafka administration and engineering, you will be responsible for installing, configuring, and managing large-scale Kafka clusters.Kafka AdministrationConfluent and AWS MSK expertiseBroad knowledge of big data and Hadoop ecosystemCore SkillsKafka (brokers, topics, ACLs,...

  • Senior Data Engineering Position

    5 days ago

    Ghaziabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Key Data Engineer RoleWe are seeking a highly skilled data engineer to design, build and maintain high-performance, scalable data pipelines.The successful candidate will work closely with cross-functional teams to develop and implement data models, ETL processes and data warehousing solutions.Job Description:Design and build data pipelines using big data...

  • Senior Data Engineer Lead

    2 days ago

    Ghaziabad, Uttar Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 24,00,000

    About UsWe are a global leader in the quick-service industry, operating in over 100 countries and employing hundreds of thousands of people.">Our company is dedicated to delivering high-quality products and services to our customers, and we are committed to creating a diverse and inclusive workplace culture.">Position Summary:We are seeking an experienced...

  • Leading Banking Technology Programs

    7 days ago

    Ghaziabad, Uttar Pradesh, India beBeeProgramDirector Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Program Director-Banking Job DescriptionOur organization is seeking a highly skilled Program Director to lead the development and delivery of large-scale banking platforms. The ideal candidate will possess a strong technical background with hands-on experience in Java, Spring Boot, Microservices, Kafka, and cloud platforms.This role involves overseeing the...

  • Sr Staff Engineer

    6 days ago

    Ghaziabad, Uttar Pradesh, India Weekday AI (YC W21) Full time ₹ 20,00,000 - ₹ 45,00,000 per year

    This role is for one of the Weekday's clientsSalary range: Rs Rs ie INR 20-45 LPA)Min Experience: 6 yearsLocation: NOIDA, Gurugram, GhaziabadJobType: full-timeWe are seeking a customer-focused and highly analyticalSr. Staff Engineerto lead the development and expansion of our Tax Compliance product suite. In this role, you will architect and scale innovative...

  • Experienced Cloud Native Architect for Distributed Systems

    5 days ago

    Ghaziabad, Uttar Pradesh, India beBeeService Full time ₹ 2,20,00,000 - ₹ 2,60,00,000

    Job Opportunity: Experienced Kafka and Service Mesh EngineerA leading banking client is seeking a highly skilled Kafka and Service Mesh Engineer to work on-site. The successful candidate will be responsible for upgrading the Service Mesh, migrating Kafka clusters, managing deployments on OpenShift, and ensuring secure integration within a restricted...

  • Cloud Data Engineering Specialist

    7 days ago

    Ghaziabad, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Cloud Data Engineering SpecialistWe are seeking an experienced Cloud Data Engineering Specialist to join our team. The ideal candidate will bring deep expertise in cloud-based data engineering, healthcare data modeling, and consulting with a strong background in Azure, Databricks, Azure Data Factory (ADF), Kafka, and Snowflake.Key Responsibilities:Design,...