Kafka Administrator

2 weeks ago


Bengaluru, India Western Digital Full time

Company Description

At Western Digital, our vision is to power global innovation and push the boundaries of technology to make what you thought was once impossible, possible.

At our core, Western Digital is a company of problem solvers. People achieve extraordinary things given the right technology. For decades, we’ve been doing just that. Our technology helped people put a man on the moon.

We are a key partner to some of the largest and highest growth organizations in the world. From energizing the most competitive gaming platforms, to enabling systems to make cities safer and cars smarter and more connected, to powering the data centers behind many of the world’s biggest companies and public cloud, Western Digital is fueling a brighter, smarter future.

Binge-watch any shows, use social media or shop online lately? You’ll find Western Digital supporting the storage infrastructure behind many of these platforms. And, that flash memory card that captures and preserves your most precious moments? That’s us, too.

We offer an expansive portfolio of technologies, storage devices and platforms for business and consumers alike. Our data-centric solutions are comprised of the Western Digital®, G-Technology, SanDisk® and WD® brands.

Today’s exceptional challenges require your unique skills. It’s You & Western Digital. Together, we’re the next BIG thing in data.

ABOUT ADVANCED ANALYTICS OFFICE (AAO) and BIG DATA PLATFORM (BDP)

AAO is missioned with accelerating Analytics solutions at scale across the Enterprise to rapidly capture business value. These solutions target key business metrics, such as, reducing manufacturing cost, improve capital efficiency, reduce time-to market to develop new products, improve operational efficiency, and improve customer experience. These solutions are built using cutting edge Industrial 4.0 technologies and are delivered through a platform approach to enable rapid scaling. The solutions span AI/ML for improving manufacturing yield, quality, equipment uptime, and adaptive testing, Operations Research for capacity and scheduling optimization, Digital Twin for inventory and logistics optimization, and Product Telematics for managing customer fleet management solutions.

**Job Description**:

- As an Administrator of message-based software platform, you are responsible for architecting, designing, managing and supporting message-based real time solutions.
- You will be responsible in maintaining overall health of message-based platform including troubleshooting storage, network, and necessary compute.
- You will also be responsible in building healthy DevOps platform with policies and procedures around implementing and supporting our global hybrid cloud container strategies using Kubernetes deployed in Google Cloud Platform (GCP) and Amazon Web Services (AWS).
- Experience in setting up continuous integration of source code pipelines using Bitbucket, Jenkins, Terraform, Ansible, etc., is preferred.
- Ability to build continuous deployments using Docker, Artifactory, Spinnaker, etc., is required with a strong advocate of DevOps principles.
- service (SaaS) design principles using preferred cloud service provides or on-premises solutions.
- This position requires partnering with various Western Digital manufacturing, engineering, and IT teams in understanding factory-critical workloads and designing solutions.
- Communication with internal customers, external vendors and co-workers in a clear and professional manner is expected.

**Qualifications**:
**REQUIRED QUALIFICATIONS**
- Bachelor of Engineering (or) Master of Engineering in Computer Science, Information Technology, Computer Information Systems (or) relevant working experience in IT field
- Minimum 4+ years of operationalizing and/or deploying asynchronous message-based microservices architecture, preferably Kafka based solutions for manufacturing environment.
- Strong troubleshooting skills in finding root cause of an incident with respect to compute, network, storage resource bottlenecks and proactively identifying corrective actions of existing production Kafka workloads is required.
- Hands-on Python and Unix shell scripting is required with a strong advocate of DevOps principles in setting up continuous integration of source code pipelines using Bitbucket, Jenkins, Terraform, Ansible and continuous deployment pipelines using Artifactory and Spinnaker.
- Experience in using monitoring/alerting observability tools such as Splunk, Prometheus & Grafana

**PREFERRED QUALIFICATIONS**
- Any certification in message-based architecture administration such as Kafka, JMS, TIBCO MQ, IBM MQ, Microsoft WCF, SonicMQ, etc., is preferred
- Kubernetes work experience in GCP Anthos and/or AWS EKS knowledge is preferred
- Handling automation scripts using Terraform and/or Cloud Formation is preferred
- Familiarity with data services such as ElasticSearch, Redis, NiFi, MongoDB, MySQL, PostgreSQL,etc., is preferred

Additiona


  • Kafka Administrator

    2 weeks ago


    Bengaluru, India Human Horizon Full time

    Description :Responsibilities :- Design, build, and manage Kafka clusters using the Confluent Platform for enterprise-grade data streaming solutions.- Implement Kafka Connect, Kafka Streams, and ksqlDB to develop and manage real-time data pipelines and stream processing applications.- Monitor, maintain, and optimize Kafka cluster performance, ensuring high...

  • Kafka Administrator

    4 days ago


    Bengaluru, Karnataka, India Human Horizon Pvt Ltd Full time

    Description : Responsibilities : - Design, build, and manage Kafka clusters using the Confluent Platform for enterprise-grade data streaming solutions. - Implement Kafka Connect, Kafka Streams, and ksqlDB to develop and manage real-time data pipelines and stream processing applications. - Monitor, maintain, and optimize Kafka cluster performance,...

  • Kafka Administrator

    2 days ago


    Bengaluru, Karnataka, India Acesoft Labs Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Job DescriptionExperience - 4 to 6 YearsLocation - BangaloreNotice Period - Immediate to Serving 15 Days.Mandatory Skills : Kafka Admin, shell and python, Kafka infrastructure.Relevant 4+ Years of experience. Perform administrator support for Kafka infrastructure. Responsible for maintaining the availability, performance and security of Kafka infrastructure....

  • Kafka Administrator

    2 weeks ago


    Bengaluru, Karnataka, India SOFTENGER Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Profile :Kafka AdministratorJob Location :BangaloreExperience Required :3-4 yrsJob Description :Key Responsibilities:Deploy and upgrade production-grade Kafka clusters, ensuring high availability and fault tolerance.Automate the installation and configuration of Kafka clusters using tools such as Ansible and Chef.Troubleshoot critical production issues,...

  • Kafka Administrator

    2 weeks ago


    Bengaluru, India Creeno Solutions Pvt ltd Full time

    Job Title : Kafka AdministratorLocation : Bangalore / Pune / Chennai / Noida / HyderabadExperience : 4+ YearsEmployment Type : Full TimeKey Responsibilities : - Install, configure, upgrade, and maintain Apache Kafka clusters.- Monitor Kafka cluster health, performance, and capacity planning.- Manage topics, partitions, brokers, consumer groups, and access...


  • Bengaluru, Karnataka, India Hewlett Packard Enterprise | HPE Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Senior Kafka AdministratorThis role has been designed as 'Hybrid' with an expectation that you will work on average 2 days per week from an HPE office.Who We Are:Hewlett Packard Enterprise is the global edge-to-cloud company advancing the way people live and work. We help companies connect, protect, analyze, and act on their data and applications wherever...

  • Kafka Administrator

    1 week ago


    Bengaluru, Karnataka, India Eminence Technosystem Full time ₹ 2,50,000 - ₹ 7,50,000 per year

    Seeking Kafka Admin strong Unix skills,deep knowledge of Kafka administration.Have incident, problem, and change management. Excellent communication and collaboration skills.

  • Kafka Administrator

    2 weeks ago


    Greater Bengaluru Area, India Softenger Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    ResponsibilitiesDeploy and upgrade production-grade Kafka clusters, ensuring high availability and fault tolerance.Automate the installation and configuration of Kafka clusters using tools such as Ansible and Chef.Troubleshoot critical production issues, optimizing Kafka performance and minimizing downtime.Configure MirrorMaker for data replication between...


  • Bengaluru, Karnataka, India Hewlett Packard Enterprise Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    This role has been designed as 'Hybrid' with an expectation that you will work on average 2 days per week from an HPE office.Who We AreHewlett Packard Enterprise is the global edge-to-cloud company advancing the way people live and work. We help companies connect, protect, analyze, and act on their data and applications wherever they live, from edge to...


  • Bengaluru, Karnataka, India Hewlett Packard Enterprise Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Senior Kafka AdministratorThis role has been designed as 'Hybrid' with an expectation that you will work on average 2 days per week from an HPE office Who We Are: Hewlett Packard Enterprise is the global edge-to-cloud company advancing the way people live and work. We help companies connect, protect, analyze, and act on their data and applications wherever...