Kafka Administrator

2 days ago

BangaloreDelhiPune, India EDGESOFT Full time

Responsibilities :

- Lead the migration of Kafka workloads from AWS to GCP utilising Kubernetes and GCP-native services.

- Architect, implement, and manage a scalable Kafka infrastructure on GKE.

- Develop and maintain comprehensive performance metrics dashboards for the Kafka ecosystem.

- Collaborate with cross-functional teams to optimise Kafka API integration.

- Conduct in-depth assessments of existing AWS Kafka deployments for migration planning.

- Develop and execute a robust migration strategy encompassing data migration and consumer repointing.

- Optimise Kafka performance and scalability for high-throughput data processing.

- Implement robust monitoring and alerting for system health and performance.

- Guarantee data integrity and security throughout the migration process.

- Collaborate with engineering and data teams for seamless integration and optimal performance.

- Design and implement a multi-tenant GKE environment to accommodate diverse workloads.

- Deploy and configure Kafka Strimzi on the underlying infrastructure.

- Identify and implement efficient data ingestion pipelines (e.g., Kafka Connect, Dataflow).

- Conduct thorough fault simulation testing to mitigate potential risks.

- Stay updated on Kafka developments and GCP services to recommend and implement improvements.

Requirements :

- Bachelor's degree in Computer Science, Engineering, or related field (Master's degree preferred).

- Proven hands on experience as a Kafka Lead or similar role, with a minimum of 5 years of experience.

- Deep knowledge of Kafka internals and ecosystem, including Kafka Connect, Kafka Streams, and KSQL.

- In-depth knowledge of Apache Kafka architecture, internals, and ecosystem components.

- Proficiency in scripting and automation for Kafka management and migration.

- Hands-on experience with Kafka administration, including cluster setup, configuration, and tuning.

- Proficiency in Kafka APIs, including Producer, Consumer, Streams, and Connect.

- Strong programming skills in Java, Scala, or Python.

- Experience with Kafka monitoring and management tools such as Confluent Control Center, Kafka Manager, or similar.

- Solid understanding of distributed systems, data pipelines, and stream processing.

- Experience leading migration projects to Google Cloud Platform (GCP), including migrating Kafka workloads.

- Familiarity with GCP services such as Google Kubernetes Engine (GKE), Google Cloud Storage, Google Cloud Pub/Sub, and BigQuery.

- Excellent communication and collaboration skills.

- Ability to work independently and manage multiple tasks in a fast-paced environment.

- Knowledge of containerization technologies such as Docker and Kubernetes.

- Familiarity with related technologies such as Apache ZooKeeper, Apache Flink, or Apache Spark.

- Working knowledge of hands-on experience with Strimzi Kafka

Nice to Have :

- Kafka certification (e.g., Confluent Certified Developer, Confluent Certified Operator).

- Google Cloud certification (e.g., Google Cloud Certified - Professional Cloud Architect, Google Cloud Certified - Professional Data Engineer).

- Additional experience with other cloud platforms such as AWS or Azure.

(ref:hirist.tech)

  • Kafka Administrator

    2 months ago

    Bangalore/Delhi,Pune, IN EDGESOFT Full time

    Responsibilities : - Lead the migration of Kafka workloads from AWS to GCP utilising Kubernetes and GCP-native services.- Architect, implement, and manage a scalable Kafka infrastructure on GKE.- Develop and maintain comprehensive performance metrics dashboards for the Kafka ecosystem.- Collaborate with cross-functional teams to optimise Kafka API...

  • Kafka Administrator

    1 month ago

    Pune, India Wizzgeeks private limited Full time

    Job Title : Kafka Admin (Only Female)Experience : 7-10 YearsLocation : PuneRoles and Responsibilities : - Manage large scale multi-nodes Kafka cluster environments residing on GCP and on-prem Linux Redhat platform. - Handle all Kafka environment builds, including design, capacity planning, cluster setup, performance tuning and ongoing monitoring. -...

  • Kafka admin

    3 weeks ago

    Bangalore, India Eximietas Design Full time

    About Eximietas: Eximietas, a technology services and solutions company headquartered in San Jose, CA with a global footprint that extends to Bangalore, Chennai, and Bhubaneswar in India. Specializing in Cloud Computing, Cybersecurity, , Embedded Software, and Artificial Intelligence, Eximietas is dedicated to empowering businesses with cutting-edge...

  • Kafka Admin

    4 weeks ago

    Bangalore, India Eximietas Design Full time

    About Eximietas: Eximietas, a technology services and solutions company headquartered in San Jose, CA with a global footprint that extends to Bangalore, Chennai, and Bhubaneswar in India. Specializing in Cloud Computing, Cybersecurity, , Embedded Software, and Artificial Intelligence, Eximietas is dedicated to empowering businesses with cutting-edge...

  • Kafka Admin

    4 weeks ago

    Bangalore, India Eximietas Design Full time

    About Eximietas: Eximietas, a technology services and solutions company headquartered in San Jose, CA with a global footprint that extends to Bangalore, Chennai, and Bhubaneswar in India. Specializing in Cloud Computing, Cybersecurity, , Embedded Software, and Artificial Intelligence, Eximietas is dedicated to empowering businesses with cutting-edge...

  • Kafka Specialist

    1 month ago

    Pune, India Wizzgeeks private limited Full time

    Job Title : Kafka SpecialistExperience : 7-10 YearsLocation : PuneRoles and Responsibilities :Design, build, and configure large-scale multi-node Kafka cluster environments for Wizzgeeks private limited.Manage all aspects of Kafka environment builds, including capacity planning, cluster setup, performance tuning, and ongoing monitoring.Perform high-level,...

  • Kafka Architect

    2 weeks ago

    bangalore, India Connectpro Management Consultants Private Limited Full time

    Location- Bangalore Years of experience - 8 to 15 Years Qualification - B.Tech / MCA Key Responsibilities : Design, deploy, and manage Kafka clusters in a production environment, ensuring high availability, scalability, and reliability. Collaborate with engineering teams to understand data processing requirements and design Kafka solutions that meet...

  • Kafka Admin

    3 weeks ago

    bangalore, India Eximietas Design Full time

    - 3+ years of experience managing and administering Kafka clusters. ● Proficiency in scripting languages such as Shell and Python for automation. ● Strong experience in Linux administration and troubleshooting. ● Proven experience managing large-scale production environments with Kafka. ● Familiarity with CI/CD technologies and hands-on...

  • Kafka Admin

    3 weeks ago

    bangalore, India Eximietas Design Full time

    3+ years of experience managing and administering Kafka clusters. ● Proficiency in scripting languages such as Shell and Python for automation. ● Strong experience in Linux administration and troubleshooting. ● Proven experience managing large-scale production environments with Kafka. ● Familiarity with CI/CD technologies and hands-on experience...

  • Kafka Architect

    2 weeks ago

    bangalore, India Connectpro Management Consultants Private Limited Full time

    Location- BangaloreYears of experience - 8 to 15 YearsQualification - B.Tech / MCAKey Responsibilities :Design, deploy, and manage Kafka clusters in a production environment, ensuring high availability, scalability, and reliability.Collaborate with engineering teams to understand data processing requirements and design Kafka solutions that meet their...

  • Kafka Admin

    4 weeks ago

    bangalore, India Eximietas Design Full time

    - 3+ years of experience managing and administering Kafka clusters.● Proficiency in scripting languages such as Shell and Python for automation.● Strong experience in Linux administration and troubleshooting.● Proven experience managing large-scale production environments with Kafka.● Familiarity with CI/CD technologies and hands-on experience with...

  • Kafka Admin

    3 weeks ago

    bangalore, India Eximietas Design Full time

    3+ years of experience managing and administering Kafka clusters.● Proficiency in scripting languages such as Shell and Python for automation.● Strong experience in Linux administration and troubleshooting.● Proven experience managing large-scale production environments with Kafka.● Familiarity with CI/CD technologies and hands-on experience with...

  • Kafka admin

    1 month ago

    Bangalore, India Eximietas Design Full time

    3+ years of experience managing and administering Kafka clusters. ● Proficiency in scripting languages such as Shell and Python for automation. ● Strong experience in Linux administration and troubleshooting. ● Proven experience managing large-scale production environments with Kafka. ● Familiarity with CI/CD technologies and hands-on experience...

  • Kafka Cluster Engineer

    1 month ago

    Pune, India Wizzgeeks private limited Full time

    Job Title : Kafka Cluster EngineerExperience : 7-10 YearsLocation : RemoteRoles and Responsibilities : Design, build, and maintain large-scale Kafka cluster environments on GCP and on-prem Linux Redhat platforms.Develop and implement high-level operational maintenance, support, and upgrades for the Kafka Cluster.Collaborate with product managers and lead...

  • Kafka Developer and Administrator

    3 weeks ago

    Bangalore Metropolitan Area, India ITC Infotech Full time

    Job Title: Kafka BigData AnalyticsJob Description:Design, Develop, and Maintain: Kafka producers, consumers, and stream processing applications using Confluent Kafka.Administer Kafka Clusters: Setting up brokers, topics, partitions, and replication to ensure high availability and fault tolerance.Monitor and Troubleshoot: Kafka cluster performance, ensuring...

  • Kafka Cluster Architect

    4 weeks ago

    Delhi, Delhi, India Talpro Full time

    Job SummaryWe are seeking a highly skilled Kafka Cluster Architect to join our team at Talpro. As a key member of our corporate messaging infrastructure team, you will play a crucial role in designing, building, and maintaining our enterprise-wide messaging architecture.Key ResponsibilitiesDesign and implement high-quality messaging and streaming solutions...

  • Kafka Systems Architect

    24 hours ago

    Delhi, Delhi, India Talpro Full time

    Job Description for Kafka AdministratorAt Talpro, we are seeking an experienced Kafka Administrator to play a pivotal role in the development and maintenance of our corporate messaging infrastructure. As a key member of our team, you will be responsible for ensuring the smooth delivery, security, retention, and recoverability of topics and messages.Main...

  • Kafka Admin

    1 month ago

    bangalore, India Eximietas Design Full time

    3+ years of experience managing and administering Kafka clusters. ● Proficiency in scripting languages such as Shell and Python for automation. ● Strong experience in Linux administration and troubleshooting. ● Proven experience managing large-scale production environments with Kafka. ● Familiarity with CI/CD technologies and hands-on experience...

  • Kafka Admin

    1 month ago

    bangalore, India Eximietas Design Full time

    3+ years of experience managing and administering Kafka clusters.● Proficiency in scripting languages such as Shell and Python for automation.● Strong experience in Linux administration and troubleshooting.● Proven experience managing large-scale production environments with Kafka.● Familiarity with CI/CD technologies and hands-on experience with...

  • Admin Kafka

    3 months ago

    Yerawada, Pune, Maharashtra, India Niyara Consulting Full time

    **Job Title**: Kafka Admin **Location**: Hybrid (Pune, Yerwada Area) **Experience**: 5 to 9 Years We are looking for an experienced Kafka Admin to manage Kafka clusters with additional skills in Kubernetes and Jenkins. Key responsibilities include implementing Stretch Kafka Clusters, creating topics, setting up DR clusters, and deploying monitoring tools....