Kafka Data Engineer

3 hours ago

Bengaluru Chennai Hyderabad, India Virtusa Full time ₹ 5,00,000 - ₹ 25,00,000 per year

Data Engineer to build and manage data pipelines that support batch and streaming data solutions. The role requires expertise in creating seamless data flows across platforms like Data Lake/Lakehouse in Cloudera, Azure Databricks, Kafka for both batch and stream data pipelines etc.

Responsibilities:

  • Strong experience in develop, test, and maintain data pipelines (batch & stream) using Cloudera, Spark, Kafka and Azure services like ADF, Cosmos DB, Databricks, NoSQL DB/ Mongo DB etc.
  • Strong programming skills in spark, python or scala & SQL.
  • Optimize data pipelines to improve speed, performance, and reliability, ensuring that data is available for data consumers as required.
  • Create ETL pipelines for downstream consumers by transform data as per business logic.
  • Work closely with Data Architects and Data Analysts to align data solutions with business needs and ensure the accuracy and accessibility of data.
  • Implement data validation checks and error handling processes to maintain high data quality and consistency across data pipelines.

  • Kafka Engineer

    3 days ago

    Hyderabad, India EXL Full time

    Role - Kafka Engineer Skills Required: Kafka, Java, SQL Experience: 5-8 Years Location: Hyderabad [3 Days a Week] We are looking for a skilled Kafka Engineer with 5–7 years of experience in designing, building, and maintaining real-time streaming pipelines using Apache Kafka. The ideal candidate will have strong expertise in Java-based development, Kafka...

  • Kafka Engineer

    3 days ago

    hyderabad, India EXL Full time

    Role - Kafka Engineer Skills Required: Kafka, Java, SQL Experience: 5-8 Years Location: Hyderabad [3 Days a Week] We are looking for a skilled Kafka Engineer with 5–7 years of experience in designing, building, and maintaining real-time streaming pipelines using Apache Kafka. The ideal candidate will have strong expertise in Java-based development, Kafka...

  • Kafka Engineer

    1 day ago

    Hyderabad, India EXL Full time

    Role - Kafka Engineer Skills Required : Kafka, Java, SQL Experience : 5-8 Years Location : Hyderabad (3 Days a Week) We are looking for a skilled Kafka Engineer with 5–7 years of experience in designing, building, and maintaining real-time streaming pipelines using Apache Kafka. The ideal candidate will have strong expertise in Java-based development ,...

  • Kafka Engineer

    2 days ago

    Hyderabad, India EXL Full time

    Role - Kafka EngineerSkills Required: Kafka, Java, SQLExperience: 5-8 YearsLocation: Hyderabad (3 Days a Week)We are looking for a skilled Kafka Engineer with 5–7 years of experience in designing, building, and maintaining real-time streaming pipelines using Apache Kafka. The ideal candidate will have strong expertise in Java-based development, Kafka...

  • Kafka Engineer

    20 hours ago

    Hyderabad, India EXL Full time

    Role - Kafka EngineerSkills Required: Kafka, Java, SQLExperience: 5-8 YearsLocation: Hyderabad (3 Days a Week)We are looking for a skilled Kafka Engineer with 5–7 years of experience in designing, building, and maintaining real-time streaming pipelines using Apache Kafka. The ideal candidate will have strong expertise in Java-based development, Kafka...

  • Kafka Engineer

    1 week ago

    Bengaluru, India Fractal Full time

    It's fun to work in a company where people truly BELIEVE in what they are doing! Job Summary We are looking for a skilled Kafka Engineer with hands-on experience in Confluent Platform to design, build, and maintain high-performance, real-time data streaming pipelines. The ideal candidate will have expertise in Kafka ecosystem components and be well-versed in...

  • Kafka /Streaming Data Engineer

    2 weeks ago

    Hyderabad, Visakhapatnam, Warangal, India Nexure Tech Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Description Kafka/Streaming Data EngineerOverview We are seeking a Kafka/Streaming Data Engineer to join our team and support a new high-volume data ingestion and fulfillment architecture. The role requires strong hands-on expertise in Kafka cluster management, monitoring, and performance tuning, along with the ability to troubleshoot issues, propose...

  • GCP Data Engineer

    3 weeks ago

    Chennai, India Jobted IN C2 Full time

    Overview: Overview: We are seeking a talented and motivated GCP Data Engineer with experience in real-time streaming technologies, specifically Apache Kafka, and proficiency in Java. The ideal candidate will be responsible for designing, developing, and maintaining data pipelines and streaming applications in a cloud environment. Responsibilities: Key...

  • Kafka Admin

    58 minutes ago

    Bengaluru, Chennai, Hyderabad, India Orcapod Consulting Services Full time ₹ 6,00,000 - ₹ 8,00,000 per year

    Role & responsibilitiesDesign, build, and manage Kafka clusters using the Confluent Platform.Implement Kafka Connect, Kafka Streams, and ksqlDB for real-time data pipelines.Monitor and tune Kafka clusters for high availability and performance.Use Terraform/Ansible scripts for platform set up.Implement Kafka security features including RBAC, ACLs, SSL, and...

  • Kafka Developer

    2 weeks ago

    Chennai, Tamil Nadu, India Optimum Solutions Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Confluent CDC System AnalystRole Overview:We are seeking an experienced Confluent Change Data Capture (CDC) System Analyst/ Tech lead to implement real-time data streaming solutions. The role involves implementing robust CDC frameworks using Confluent Kafka, ensuring seamless data integration between core banking systems and analytics platforms. The ideal...