Kafka Specialist

4 days ago

Pune, Maharashtra, India beBeeKafka Full time ₹ 1,04,000 - ₹ 1,30,878
Job Description

We are seeking a highly skilled Kafka specialist to join our team.

Key Responsibilities
  • Design and develop efficient Kafka producers and consumers for real-time data ingestion pipelines.
  • Develop strong hands-on expertise in Apache Kafka, Kafka Connect, Kafka Streams, and Schema Registry.
  • Implement data transformation and enrichment using Apache Spark (Structured Streaming).
  • Integrate with nProbe Cento and other network flow data formats.
  • Experience message serialization and schema evolution using Avro, JSON, or Protobuf.
  • Familiarity with Cloudera Data Platform components including HDFS, Hive, YARN, and Knox.
  • Develop data pipelines integrating Kafka with data lakes or warehouses using Parquet or Delta formats.
  • Write stream processing code in Scala, Java, or Python.
  • Knowledge of Kafka security protocols including TLS/SSL, Kerberos, and access control via Apache Ranger.
  • Implement monitoring and logging tools such as Prometheus, Grafana, and Splunk.
  • Understand CI/CD pipelines, Git-based workflows, and containerization (Docker/Kubernetes).
Benefits

This role offers the opportunity to work on challenging projects and collaborate with a talented team.

What We Offer

We provide a competitive salary and benefits package.

  • Kafka Cluster Specialist

    2 hours ago

    Pune, Maharashtra, India beBeeKafkaCluster Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Kafka Cluster SpecialistMain Responsibilities:Implement, configure, upgrade, and maintain large-scale Apache Kafka clusters to ensure high availability and reliability.Monitor Kafka cluster health, performance, and capacity planning to optimize data streaming and real-time analytics.Manage topics, partitions, brokers, consumer groups, and access...

  • Expert Kafka Cluster Administrator

    6 days ago

    Pune, Maharashtra, India beBeeKafka Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job TitleAs a Kafka Infrastructure Specialist, you will be responsible for deploying and managing production-grade Kafka clusters, ensuring high availability and fault tolerance.Key responsibilities include:Cluster Deployment: Deploy and upgrade production-grade Kafka clusters using tools such as Ansible and Chef.Automated Configuration: Automate the...

  • Kafka and Service Mesh Integration Specialist

    2 days ago

    Pune, Maharashtra, India beBeeServiceMesh Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Kafka and Service Mesh Integration ExpertAbout the Role:We are seeking a seasoned expert to lead our Kafka and Service Mesh integration efforts. The ideal candidate will have a strong background in distributed systems, cloud architecture, and container orchestration.Key Responsibilities:Migrate existing infrastructure from Mirror Maker and Zookeeper to KRaft...

  • Cloud & Infrastructure Management Specialist

    1 day ago

    Pune, Maharashtra, India beBeeInfrastructure Full time ₹ 10,00,000 - ₹ 20,00,000

    Job Title: Cloud & Infrastructure Management Specialist">Data Platform Engineer responsible for designing, implementing, and managing cloud-based data platforms.Expertise in Apache NiFi Administration including building clusters, upgrading cluster versions, and troubleshooting on Linux.Strong knowledge of Kafka administration and configuration management...

  • Software Configuration Specialist

    1 week ago

    Pune, Maharashtra, India beBeeConfiguration Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Job Title: Software Configuration Specialist">Job Description:As a software configuration specialist, you will play a key role in implementing the configuration management plan as directed by senior leadership. You will assist in designing software configuration and customization to meet business process design and application requirements.">Key...

  • Data Integration developer-Kafka

    2 days ago

    Pune, Maharashtra, India TVH Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Key ResponsibilitiesData Integration Development: ○ Develop, implement, and maintain robust and scalable data integration solutions on designated middleware platforms, adhering to project timelines and technical specifications. ○ Apply a DevOps mindset to development, contributing to the optimization of processes and tasks through automation (e.g., CI/CD...

  • Data Integration developer-Kafka

    3 days ago

    Pune, Maharashtra, India TVH Group Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    DepartmentIT & DataKey Responsibilities:Data Integration Development: Develop, implement, and maintain robust and scalable data integration solutions on designated middleware platforms, adhering to project timelines and technical specifications. Apply a DevOps mindset to development, contributing to the optimization of processes and tasks through automation...

  • Data Integration developer-Kafka

    3 days ago

    Pune, Maharashtra, India TVH Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Key Responsibilities: ● Data Integration Development: ○ Develop, implement, and maintain robust and scalable data integration solutions on designated middleware platforms, adhering to project timelines and technical specifications. ○ Apply a DevOps mindset to development, contributing to the optimization of processes and tasks through automation (e.g.,...

  • Data Specialist

    4 days ago

    Pune, Maharashtra, India beBeeDataSpecialist Full time ₹ 8,00,000 - ₹ 15,00,000

    Job Title: Data SpecialistWe seek a highly skilled Data Specialist to spearhead the development of our data infrastructure.Design and implement scalable data architectures using ELT processes targeting data warehouses.Utilize streaming or batch processing frameworks such as Apache Flink or Spark for efficient data processing.Deploy containerized applications...

  • Data Integration Platform Specialist-Kafka

    2 days ago

    Pune, Maharashtra, India TVH Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Key Responsibilities:● Data Integration Platform Management & Strategy:○ Administer, configure, and optimize the integration platform.○ Contribute to the strategic roadmap and evolution of our data integration platformlandscape, evaluating new technologies and features.○ Ensure the platform's security, compliance, and adherence to...