Kafka Engineer

1 day ago

Kolhapur, India EXL Full time

Role - Kafka Engineer Skills Required: Kafka, Java, SQL Experience: 5-8 Years Location: Hyderabad [3 Days a Week] We are looking for a skilled Kafka Engineer with 5–7 years of experience in designing, building, and maintaining real-time streaming pipelines using Apache Kafka. The ideal candidate will have strong expertise in Java-based development, Kafka architecture, and CI/CD integration. You’ll play a key role in enabling real-time data processing and ensuring the scalability, fault tolerance, and governance of data streaming across our enterprise systems.Key Responsibilities:Design and maintain Kafka-based streaming pipelines for high-throughput, low-latency real-time data processing.Ensure scalability, fault tolerance, and schema governance using tools like Schema Registry (Avro/Protobuf).Develop robust Kafka producers and consumers using Java, adhering to performance and reliability standards.Collaborate with DevOps teams to automate CI/CD pipelines, deployment, and infrastructure provisioning for Kafka components.Implement security best practices including encryption, authentication, and access control for Kafka clusters.Monitor and troubleshoot Kafka cluster health, latency, throughput, and message delivery guarantees.Document architecture, deployment strategies, and operational runbooks for Kafka-based systems.Participate in code reviews, knowledge-sharing sessions, and architectural discussions.Must-Have Skills:5–7 years of experience in backend or data engineering, with strong focus on Apache Kafka.Proficiency in Java for building Kafka producers/consumers and integration with backend services.Deep understanding of Kafka internals (brokers, partitions, consumer groups, offsets, replication, etc.).Experience with schema management using Confluent Schema Registry, Avro, or Protobuf.Experience with CI/CD pipelines for Kafka component deployment and integration.Strong collaboration skills with DevOps teams to manage Kafka infrastructure, security, and automation.Solid understanding of real-time data processing concepts, fault tolerance, and data consistency.Good-to-Have Skills:Experience with Kafka Streams, ksqlDB, or Apache Flink for stream processing.Familiarity with Kafka Connect and connectors for data ingestion and export.Exposure to Confluent Kafka Platform and Kafka REST Proxy.Experience with monitoring and observability tools (e.g., Grafana, ELK Stack).Understanding of container orchestration platforms like Kubernetes or OpenShift.Knowledge of cloud-native Kafka deployments (AWS MSK).Familiarity with Spring Boot for integrating Kafka in microservice environments

  • Engineering Manager

    1 day ago

    Kolhapur, India Papaya Global Full time

    Papaya Global is reinventing global payroll and workforce management. Our automated platform helps companies hire, onboard, manage, and pay people in more than 160 countries. We are looking for a talented Engineering Manager to join our growing team. In this role, you will have a significant impact on the business by ensuring that your expertise translates...

  • Engineering Manager

    18 hours ago

    Kolhapur, India Papaya Global Full time

    Papaya Global is reinventing global payroll and workforce management. Our automated platform helps companies hire, onboard, manage, and pay people in more than 160 countries. We are looking for a talented Engineering Manager to join our growing team. In this role, you will have a significant impact on the business by ensuring that your expertise translates...

  • Senior Integration Developer

    4 weeks ago

    Kolhapur, India Resourceful Talent Group Full time

    We are seeking a highly skilled Senior Integration Developer (Senior Software Engineer) to join our client’s Professional Services Team. In this role, you will design, develop, and implement complex integration solutions that connect applications, APIs, cloud services, and data systems. The ideal candidate is hands-on, detail-oriented, and able to deliver...

  • Oracle Database Administrator

    1 week ago

    Kolhapur, India Cozzera Full time

    Job Title: SME – Database Administrator (Remote)Experience: 8+ YearsLocation: RemoteType: Full-TimeAbout the Role:We’re looking for a Senior Database SME/DBA with deep expertise in Oracle and MongoDB or MariaDB to manage, optimize, and automate mission-critical, large-scale databases in a distributed, high-availability environment.Key...

  • GCP Data Engineer

    2 weeks ago

    Kolhapur, India PamTen Inc Full time

    Where you come in: You will work ongoing support activities and support project efforts as neededYou triage identified issues across Account source platforms, integrations and Customer Data HubYou will analyze and triage API messages as part of ongoing platform supportYou perform CDH (Customer Data Hub) initial data loads and data cleanup working with...

  • GCP Data Engineer

    1 week ago

    Kolhapur, India PamTen Inc Full time

    Where you come in: You will work ongoing support activities and support project efforts as neededYou triage identified issues across Account source platforms, integrations and Customer Data HubYou will analyze and triage API messages as part of ongoing platform supportYou perform CDH (Customer Data Hub) initial data loads and data cleanup working with...

  • Java Consultant

    1 week ago

    Kolhapur, India Droisys Full time

    About Company,Droisys is an innovation technology company focused on helping companies accelerate their digital initiatives from strategy and planning through execution. We leverage deep technical expertise, Agile methodologies, and data-driven intelligence to modernize systems of engagement and simplify human/tech interaction.Amazing things happen when we...

  • Lead Data Architect

    1 week ago

    Kolhapur, India NexGen Tech Solutions Full time

    Job Title: Data Lead / Data Architect – Wealth ManagementLocation: [Noida/Gurgaon/Remote]Experience: 10+ yearsMust Have: Wealth Management DomainJob Summary:We are seeking a highly skilled Data Lead / Data Architect with deep expertise in the Wealth Management domain to design, implement, and manage scalable data solutions.Experience in building end-to-end...

  • Dataops lead

    2 weeks ago

    Kolhapur, India Sigmoid Full time

    As a Dev Ops Lead, you will be responsible for managing, design highly scalable and Available solution for data pipelines that provides the foundation for collecting, storing, modelling, and analysing massive data sets from multiple channels. ● Strategically support Technical Initiatives o Design, manage & deploy highly scalable and fault-tolerant...

  • Data scientist

    2 days ago

    Kolhapur, India The Trade Desk Full time

    Data Scientist – Digital Advertising & Marketing Technology Salary: $80,000 USD Employment Type: Full-Time About the Organization We are a global technology team responsible for building and managing advanced advertising platforms that power large-scale digital marketing ecosystems. Our mission is to deliver data-driven solutions that optimize ad...