Kafka Architect

3 weeks ago

Bengaluru, Karnataka, India EDGESOFT Full time
Job Title: Kafka Administrator

We are seeking a highly skilled Kafka Administrator to join our team at Edgesoft. As a key member of our technical team, you will be responsible for designing, implementing, and managing a scalable Kafka infrastructure on Google Kubernetes Engine (GKE).

Responsibilities:
  • Lead the migration of Kafka workloads from AWS to GCP using Kubernetes and GCP-native services.
  • Architect and implement a scalable Kafka infrastructure on GKE, ensuring high-throughput data processing and optimal performance.
  • Develop and maintain comprehensive performance metrics dashboards for the Kafka ecosystem, providing insights for optimization and improvement.
  • Collaborate with cross-functional teams to optimize Kafka API integration, ensuring seamless data flow and minimal latency.
  • Conduct in-depth assessments of existing AWS Kafka deployments to inform migration planning and strategy.
  • Develop and execute a robust migration strategy, encompassing data migration and consumer repointing, to ensure minimal disruption to business operations.
  • Optimize Kafka performance and scalability for high-throughput data processing, ensuring efficient data ingestion and processing.
  • Implement robust monitoring and alerting for system health and performance, ensuring prompt issue detection and resolution.
  • Guarantee data integrity and security throughout the migration process, adhering to industry standards and best practices.
  • Collaborate with engineering and data teams to ensure seamless integration and optimal performance, driving business success.
  • Design and implement a multi-tenant GKE environment to accommodate diverse workloads, ensuring efficient resource utilization and scalability.
  • Deploy and configure Kafka Strimzi on the underlying infrastructure, ensuring high availability and reliability.
  • Identify and implement efficient data ingestion pipelines, leveraging Kafka Connect and Dataflow to optimize data processing and analytics.
  • Conduct thorough fault simulation testing to mitigate potential risks and ensure system resilience.
  • Stay updated on Kafka developments and GCP services, recommending and implementing improvements to drive business success.
Requirements:
  • Bachelor's degree in Computer Science, Engineering, or related field (Master's degree preferred).
  • Proven hands-on experience as a Kafka Lead or similar role, with a minimum of 5 years of experience.
  • Deep knowledge of Kafka internals and ecosystem, including Kafka Connect, Kafka Streams, and KSQL.
  • Indepth knowledge of Apache Kafka architecture, internals, and ecosystem components.
  • Proficiency in scripting and automation for Kafka management and migration.
  • Hands-on experience with Kafka administration, including cluster setup, configuration, and tuning.
  • Proficiency in Kafka APIs, including Producer, Consumer, Streams, and Connect.
  • Strong programming skills in Java, Scala, or Python.
  • Experience with Kafka monitoring and management tools such as Confluent Control Center, Kafka Manager, or similar.
  • Solid understanding of distributed systems, data pipelines, and stream processing.
  • Experience leading migration projects to Google Cloud Platform (GCP), including migrating Kafka workloads.
  • Familiarity with GCP services such as Google Kubernetes Engine (GKE), Google Cloud Storage, Google Cloud Pub/Sub, and BigQuery.
  • Excellent communication and collaboration skills.
  • Ability to work independently and manage multiple tasks in a fast-paced environment.
  • Knowledge of containerization technologies such as Docker and Kubernetes.
  • Familiarity with related technologies such as Apache ZooKeeper, Apache Flink, or Apache Spark.
  • Working knowledge of hands-on experience with Strimzi Kafka.
Nice to Have:
  • Kafka certification (e.g., Confluent Certified Developer, Confluent Certified Operator).
  • Google Cloud certification (e.g., Google Cloud Certified Professional Cloud Architect, Google Cloud Certified Professional Data Engineer).
  • Additional experience with other cloud platforms such as AWS or Azure.

  • Kafka Architect

    3 days ago

    Bengaluru, Karnataka, India ITC Infotech Full time

    ITC Infotech is seeking a highly skilled Kafka Architect to design, develop, and maintain scalable and efficient Kafka producers, consumers, and stream processing applications.Main Responsibilities:Develop and implement Kafka producers, consumers, and stream processing applications using Confluent Kafka to ensure high availability and fault tolerance.Manage...

  • Kafka Solutions Architect

    3 weeks ago

    Bengaluru, Karnataka, India ScaleneWorks Full time

    Kafka ArchitectScaleneWorks is seeking a highly skilled Kafka Architect to design and implement scalable, high-performance streaming solutions using the Confluent Platform.Key Responsibilities:Design and architect Kafka-based streaming solutions to meet business requirements, leveraging Confluent Platform features and technologies.Develop and maintain Kafka...

  • Kafka Architect

    2 weeks ago

    Bengaluru, Karnataka, India LTIMindtree Full time

    **Role:** Kafka Solutions Engineer**Experience:** 6 to 12 years**Location:** Pan India**Job Summary:**We are seeking a highly skilled Kafka Solutions Engineer to join our team at LTIMindtree. The ideal candidate will have a strong background in integration technologies, data streaming technologies, and Kafka.Key Responsibilities:Design and implement...

  • Kafka Architect

    3 weeks ago

    Bengaluru, Karnataka, India LTIMindtree Full time

    Kafka Architecture RoleLTIMindtree is seeking a highly skilled Kafka Architecture professional to join our team.Key Responsibilities:Design and implement scalable and high-performance Kafka architecturesEnsure optimum performance, high availability, and stability of solutionsDevelop and maintain Kafka deployment and configurationCollaborate with...

  • Kafka Architect

    7 days ago

    Bengaluru, Karnataka, India IBCScorp Full time

    Key Responsibilities:Design and implement high-performance data pipelines using Apache Kafka.Lead the integration of Kafka with various data sources and sinks, collaborating closely with other development teams.Develop scalable streaming applications by leveraging Kafka Streams and Kafka Connect.Troubleshoot and optimize Kafka clusters for maximum...

  • Principal Confluent Kafka Architect

    3 days ago

    Bengaluru, Karnataka, India Torry Harris Integration Solutions Full time

    Confluent Kafka Developer Role About the RoleTorry Harris Integration Solutions is seeking an experienced Confluent Kafka Developer to join our team as a Senior Confluent Kafka Developer. As a key member of our team, the Senior Confluent Kafka Developer will be responsible for designing, developing and implementing high-performance, scalable, and reliable...

  • Kafka Migration Specialist

    3 weeks ago

    Bengaluru, Karnataka, India EDGESOFT Full time

    Job Title: Kafka LeadTalentpro Edge is seeking a highly skilled Kafka Lead to join our team. As a key member of our engineering team, you will be responsible for leading the migration of Kafka workloads from AWS to GCP, utilizing Kubernetes and GCP-native services.Responsibilities:Design and implement a scalable Kafka infrastructure on Google Kubernetes...

  • Spring Boot Kafka Developer

    7 days ago

    Bengaluru, Karnataka, India Rohini IT Consulting LLP Full time

    Job Title: Spring Boot Kafka DeveloperAbout the Role: Rohini IT Consulting LLP is seeking a skilled Spring Boot Kafka Developer to join our team.Key Responsibilities:Design, develop, and maintain high-quality Spring Boot applications using best practices and industry standards.Implement and optimize Kafka-based messaging systems for real-time data processing...

  • Senior Data Architect

    2 days ago

    Bengaluru, Karnataka, India KrtrimaIQ Cognitive Solution Full time

    Job Description :We are looking for a highly skilled Data Architect with extensive experience in designing and implementing robust data processing pipelines using Kafka, PySpark, Python/Scala, and Spark.Key Responsibilities: Main Responsibilities :- Design, develop, and maintain scalable data processing pipelines using Kafka, PySpark, Python/Scala, and...

  • Cloud Solutions Architect

    7 days ago

    Bengaluru, Karnataka, India SmartGig Technologies Pvt Ltd Full time

    **Cloud Solutions Architect at SmartGig Technologies Pvt Ltd**We are a Boutique Tech Consulting partner, specializing in Cloud Native Solutions. We are looking for a Cloud Solutions Architect to join our team and help us design and implement robust and secure infrastructure with a security-first mindset.The successful candidate will be able to design a...

  • Data Architect

    2 weeks ago

    Bengaluru, Karnataka, India Synechron Full time

    About the RoleWe are seeking a highly skilled Data Architect to join our team at Synechron. As a Data Architect, you will be responsible for designing and implementing large-scale data lake solutions using Hadoop for on-premise systems and cloud data architectures on Azure or AWS.Key ResponsibilitiesDesign and architect data platforms in cloud environments,...

  • Java Tech Architect

    3 weeks ago

    Bengaluru, Karnataka, India Squareroot Consulting Pvt Ltd Full time

    Job Title: Technical ArchitectWe are seeking a highly skilled and experienced Technical Architect to join our team at Squareroot Consulting Pvt Ltd. As a Technical Architect, you will play a crucial role in shaping our technology landscape, designing scalable and innovative solutions, and leading the implementation of complex projects.Key...

  • Java Architect

    3 weeks ago

    Bengaluru, Karnataka, India Philips Full time

    Job Title: Java ArchitectAt Philips, we are seeking a highly skilled Java Architect to join our team. As a Java Architect, you will be responsible for designing, developing, and maintaining large-scale software systems using Java and related technologies.Key Responsibilities:Analyze and design software systems to meet business requirementsDevelop and...

  • Senior Java Architect

    3 weeks ago

    Bengaluru, Karnataka, India HCLTech Full time

    Job DescriptionExperience: 7 to 15 yearsLocation: Bangalore, Chennai, Hyderabad, Pune, NoidaNotice Period: Immediate to 60 DaysJob Summary:We are seeking a highly skilled Java Architect with experience in SaaS (OMS) to join our team at HCLTech. The ideal candidate will have a strong background in Java 11 and above, as well as experience with Microservices,...

  • Senior Software Architect

    1 week ago

    Bengaluru, Karnataka, India NR Consulting - India Full time

    Job Title: Senior Software ArchitectLocation: HybridExperience: 8-10 yearsKey Skills:Technical Architect /Development Expert, Java, J2EE, Micro Services and Web services. least one RDBMS system (e.g. Oracle) Java - good in programming skillsExperience on Micro Service Development using Spring BootGood in SQL/Hana DBHaving a working knowledge in Kafka and...

  • Cloud Data Architect

    3 days ago

    Bengaluru, Karnataka, India NeerInfo Solutions Full time

    Job Title: Cloud Data ArchitectWe are looking for a skilled Cloud Data Architect to join our team at NeerInfo Solutions. This role involves designing, architecting, deploying, and maintaining big data solutions on the Microsoft Azure cloud platform.Key Responsibilities:Design and architect cloud-based data lake solutions using Microsoft Azure...

  • Backend Systems Architect

    2 weeks ago

    Bengaluru, Karnataka, India Freelancer Recruiter Full time

    Job Title: Backend ArchitectJob Summary: We are seeking a highly skilled Backend Architect to join our team at Freelancer Recruiter. The ideal candidate will have a strong background in designing and implementing large-scale distributed systems, with expertise in Java/J2EE and multithreading.Key Responsibilities:Design and implement scalable systems, with a...

  • Cloud Native Architect

    3 weeks ago

    Bengaluru, Karnataka, India Blue Yonder Full time

    Job Title: Cloud Native ArchitectJob Summary:We are seeking a highly skilled Cloud Native Architect to join our team at Blue Yonder. As a Cloud Native Architect, you will be responsible for designing and implementing cloud-native solutions using Azure. You will work closely with our team to architect and design scalable, resilient, and secure...

  • Senior Technical Architect

    3 days ago

    Bengaluru, Karnataka, India NR Consulting - India Full time

    Job Title: Senior Technical ArchitectLocation: Bangalore (Hybrid)Experience: 8-10 yearsSkills:Technical Architect/Development Expert, Java, J2EE, Micro Services and Web services. least one RDBMS system (e.g. Oracle) Java - good in programming skillsExperience on Micro Service Development using Spring BootGood in SQL/Hana DBHaving a working knowledge in Kafka...

  • Senior Data Solutions Architect

    2 days ago

    Bengaluru, Karnataka, India Synechron Full time

    Job Title: Senior Data Solutions ArchitectJob Summary:We are seeking a highly experienced Senior Data Solutions Architect to join our team at Synechron. As a Senior Data Solutions Architect, you will be responsible for designing, architecting, and implementing large-scale data lake solutions using Hadoop for on-premise systems and cloud data architectures on...