Kubernetes Spark Administrator

2 weeks ago

Mumbai, India timesjobs Full time
Please share your resume at ruchita.parsekar@e-stonetech.com

Experience: 4 Years
Location : Mumbai

Job Description:

Spark Cluster Deployment: Deploy, configure, and maintain Apache Spark clusters on Kubernetes, ensuring scalability, reliability, and performance.
Application Deployment: Collaborate with data engineers and data scientists to deploy Spark applications and workloads, ensuring they run efficiently.
Monitoring and Optimization: Implement monitoring solutions to track cluster performance, resource utilization, and application health. Proactively identify and resolve performance bottlenecks.
Resource Management: Manage cluster resources, including CPU, memory, and storage allocation, to ensure optimal utilization and cost efficiency.
Security: Implement and maintain security measures, including authentication, authorization, and encryption, to protect sensitive data and Spark clusters.
Backup and Recovery: Develop and maintain backup and recovery strategies to ensure data integrity and availability in case of failures.
Documentation: Maintain clear and comprehensive documentation of Spark cluster configurations, deployment procedures, and best practices.
Troubleshooting: Quickly diagnose and resolve issues related to Spark clusters, applications, and Kubernetes infrastructure.
Collaboration: Work closely with cross-functional teams, including data engineers, data scientists, and DevOps, to understand application requirements and optimize Spark clusters accordingly.
Qualifications:

Proven experience deploying and managing Apache Spark on Kubernetes in a production environment.
Proficiency in containerization technologies, particularly Docker and Kubernetes.
Strong knowledge of Spark architecture, including cluster, driver, and worker nodes.
Familiarity with Spark tuning, optimization, and performance monitoring.
Experience with resource management tools like Kubernetes Resource Quotas and LimitRanges.
Understanding of data processing and analytics workflows.
Excellent problem-solving and troubleshooting skills.
Strong communication and collaboration skills.

Preferred Qualifications:

Experience with Spark cluster orchestration tools like Helm.
Knowledge of Spark ecosystem components such as Spark SQL, Spark Streaming, and MLlib.
Familiarity with cloud-based solutions (e.g., AWS, Azure, Google Cloud).
Certification in Kubernetes (e.g., Certified Kubernetes Administrator CKA).
Knowledge of CI/CD pipelines and infrastructure as code (IaC) tools (e.g., Terraform).
Scripting skills in languages like Python, Bash, or Shell.
Understanding of DevOps practices and automation.

Kindly share your updated resume in word format.

  • Kubernetes Spark Administrator

    2 weeks ago

    Mumbai, Maharashtra, India timesjobs Full time

    Please share your resume at ruchita.-Experience: 4 YearsLocation : MumbaiJob Description:Spark Cluster Deployment: Deploy, configure, and maintain Apache Spark clusters on Kubernetes, ensuring scalability, reliability, and performance.Application Deployment: Collaborate with data engineers and data scientists to deploy Spark applications and workloads,...

  • Kubernetes Administrator

    1 month ago

    Navi Mumbai, India Mahity System Pvt Full time

    Mahity Systems is a company that helps businesses navigate the complex world of technology.We offer a range of services designed to help businesses stay ahead of the curve. Our team ofexperienced and knowledgeable professionals provide expert guidance and support to ourclients. We pride ourselves on our customer-centric approach, working closely with our...

  • Kubernetes Administrator

    1 month ago

    navi mumbai, India Mahity System Pvt Full time

    Mahity Systems is a company that helps businesses navigate the complex world of technology. We offer a range of services designed to help businesses stay ahead of the curve. Our team of experienced and knowledgeable professionals provide expert guidance and support to our clients. We pride ourselves on our customer-centric approach, working closely with our...

  • Kubernetes Administrator

    3 weeks ago

    Navi Mumbai, India Mahity System Pvt Full time

    Mahity Systems is a company that helps businesses navigate the complex world of technology.We offer a range of services designed to help businesses stay ahead of the curve. Our team ofexperienced and knowledgeable professionals provide expert guidance and support to ourclients. We pride ourselves on our customer-centric approach, working closely with our...

  • Senior DevOps Engineer

    1 day ago

    Mumbai, India Jio Platforms Limited Full time

    Role: Senior Devops Engineer(Kubernetes Administrator)Job descriptionInstalling, deploying, configuring, recommending improvements and maintaining the docker/Kubernetes cluster itself through deployment pipelines and automation.Strong understanding of networking and infrastructure architectureExperience in Container technologies; ECS, Docker and...

  • Senior DevOps Engineer

    4 days ago

    Mumbai, India Jio Platforms Limited Full time

    Role: Senior Devops Engineer(Kubernetes Administrator) Job description      Installing, deploying, configuring, recommending improvements and maintaining the docker/Kubernetes cluster itself through deployment pipelines and automation.       Strong understanding of networking and infrastructure architecture       Experience in Container...

  • Senior DevOps Engineer

    3 days ago

    Mumbai, India Jio Platforms Limited Full time

    Role: Senior Devops Engineer(Kubernetes Administrator)   Job description       Installing, deploying, configuring, recommending improvements and maintaining the docker/Kubernetes cluster itself through deployment pipelines and automation.        Strong understanding of networking and infrastructure architecture        Experience in...

  • Kubernetes Administrator 9 to 12 Years

    1 month ago

    Mumbai, India Capgemini Full time

    Kubernetes, Managed Kubernetes Service, Swarm, Docker, Automation - K8s administration, Linux L3 administration, Network & Storage troubleshooting. - CKA/CKAD, RHCE/RHCSA preferred. - AWS/Azure/GCP certifications preferred. - ITIL v3/4 Certified. - Docker Enterprise/Merantis Kubernetes Engine/Red Hat OpenShift/Cloud Foundry/VMware Tanzu knowledge preferred -...

  • Sr. Python Developer with Kubernete...

    1 month ago

    mumbai, India Anicalls (Pty) Ltd Full time

    Candidate should have:• Excellent interpersonal skills; strong desire to move projects forward and be proactive. Seeks opportunities to learn and improve• Strong communication skills and Good knowledge of query optimization and performance tuning.• Strong understanding of Bigdata technologies like HIVE, HBASE, HDFS, and any cloud storage like Blob...

  • Kubernetes Administrator

    5 days ago

    navi mumbai, India Yotta Data Services Private Limited Full time

    Greetings from Yotta Data Services Pvt Ltd!!!Position: Kubernetes Administrator L2 & L3Location: Airoli/PanvelYears of experience: 5-15 yearsJob responsibilities:Cloud Platform Management Specialist ((Kubernetees, Docker, Ceph) / Storage, Backup and Archival / Cloud networking, Hybrid connectivity and Security/Modern Application (Containers, DevOps, etc.) /...

  • Kubernetes Administrator

    6 days ago

    Navi Mumbai, India Yotta Data Services Private Limited Full time

    Greetings from Yotta Data Services Pvt Ltd!!!Position: Kubernetes Administrator L2 & L3Location: Airoli/PanvelYears of experience: 5-15 yearsJob responsibilities:Cloud Platform Management Specialist ((Kubernetees, Docker, Ceph) / Storage, Backup and Archival / Cloud networking, Hybrid connectivity and Security/Modern Application (Containers, DevOps, etc.) /...

  • Kubernetes Administrator

    5 days ago

    Navi Mumbai, India Yotta Data Services Private Limited Full time

    Greetings from Yotta Data Services Pvt Ltd!!! Position: Kubernetes Administrator L2 & L3 Location: Airoli/Panvel Years of experience: 5-15 years Job responsibilities: Cloud Platform Management Specialist ((Kubernetees, Docker, Ceph) / Storage, Backup and Archival / Cloud networking, Hybrid connectivity and Security/Modern Application (Containers, DevOps,...

  • Kubernetes Administrator

    5 days ago

    Navi Mumbai, India Yotta Data Services Private Limited Full time

    Greetings from Yotta Data Services Pvt Ltd!!!Position: Kubernetes Administrator L2 & L3Location: Airoli/PanvelYears of experience: 5-15 yearsJob responsibilities:Cloud Platform Management Specialist ((Kubernetees, Docker, Ceph) / Storage, Backup and Archival / Cloud networking, Hybrid connectivity and Security/Modern Application (Containers, DevOps, etc.) /...

  • L2 Kubernetes Engineer

    7 days ago

    Mumbai, India Jio Platforms Limited Full time

    Education:B.E./B.Tech/MCA in Computer ScienceExperience:2 to 4 Years of Experience in Kubernetes/GKE/AKS/OpenShift AdministrationJob Description:Should have basic understanding of various components of various types of kubernetes clusters (Community/AKS/GKE/OpenShift)Should have provisioning experience of various type of kubernetes clusters...

  • L2 Kubernetes Engineer

    1 week ago

    Mumbai, India Jio Platforms Limited Full time

    Education: B.E./B.Tech/MCA in Computer Science Experience: 2 to 4 Years of Experience in Kubernetes/GKE/AKS/OpenShift Administration Job Description: Should have basic understanding of various components of various types of kubernetes clusters (Community/AKS/GKE/OpenShift) Should have provisioning experience of various type of kubernetes clusters...

  • Sr Engineer Kubernetes Operations

    1 day ago

    Mumbai, India Jio Platforms Limited Full time

    Education:B.E./B.Tech/MCA in Computer ScienceExperience:6 to 10 Years of Experience in Kubernetes/GKE/AKS/OpenShift AdministrationJob Description:Should have very very good understanding of various components of various types of kubernetes clusters (Community/AKS/GKE/OpenShift)Should have provisioning experience of various type of kubernetes clusters...

  • Sr Engineer Kubernetes Operations

    7 days ago

    Mumbai, India Jio Platforms Limited Full time

    Education: B.E./B.Tech/MCA in Computer ScienceExperience: 6 to 10 Years of Experience in Kubernetes/GKE/AKS/OpenShift AdministrationJob Description: Should have very very good understanding of various components of various types of kubernetes clusters (Community/AKS/GKE/OpenShift) Should have provisioning experience of various type of kubernetes clusters...

  • Sr Engineer Kubernetes Operations

    1 week ago

    Mumbai, India Jio Platforms Limited Full time

    Education: B.E./B.Tech/MCA in Computer Science Experience: 6 to 10 Years of Experience in Kubernetes/GKE/AKS/OpenShift Administration Job Description: Should have very very good understanding of various components of various types of kubernetes clusters (Community/AKS/GKE/OpenShift) Should have provisioning experience of various type of kubernetes...

  • Cateina Technologies

    2 weeks ago

    Mumbai, India Cateina Technologies Full time

    Job Title : Red Hat OpenShift AdministratorJob Summary : As a Red Hat OpenShift Administrator, you will be responsible for designing, deploying, and maintaining Red Hat OpenShift Container Platform environments. Your primary focus will be on ensuring the availability, scalability, and security of containerized applications while collaborating with...

  • Cateina Technologies

    1 month ago

    mumbai, India Cateina Technologies Full time

    Job Title : Red Hat OpenShift AdministratorJob Summary : As a Red Hat OpenShift Administrator, you will be responsible for designing, deploying, and maintaining Red Hat OpenShift Container Platform environments. Your primary focus will be on ensuring the availability, scalability, and security of containerized applications while collaborating with...