Kubernetes Spark Administrator

3 weeks ago


Mumbai, Maharashtra, India timesjobs Full time
Please share your resume at ruchita.-Experience: 4 Years

Location :
Mumbai

Job Description:

Spark Cluster Deployment:
Deploy, configure, and maintain Apache Spark clusters on Kubernetes, ensuring scalability, reliability, and performance.

Application Deployment:
Collaborate with data engineers and data scientists to deploy Spark applications and workloads, ensuring they run efficiently.

Monitoring and Optimization:
Implement monitoring solutions to track cluster performance, resource utilization, and application health. Proactively identify and resolve performance bottlenecks.

Resource Management:
Manage cluster resources, including CPU, memory, and storage allocation, to ensure optimal utilization and cost efficiency.

Security:
Implement and maintain security measures, including authentication, authorization, and encryption, to protect sensitive data and Spark clusters.

Backup and Recovery:
Develop and maintain backup and recovery strategies to ensure data integrity and availability in case of failures.

Documentation:
Maintain clear and comprehensive documentation of Spark cluster configurations, deployment procedures, and best practices.

Troubleshooting:
Quickly diagnose and resolve issues related to Spark clusters, applications, and Kubernetes infrastructure.

Collaboration:

Work closely with cross-functional teams, including data engineers, data scientists, and DevOps, to understand application requirements and optimize Spark clusters accordingly.



Qualifications:

Proven experience deploying and managing Apache Spark on Kubernetes in a production environment.
Proficiency in containerization technologies, particularly Docker and Kubernetes.
Strong knowledge of Spark architecture, including cluster, driver, and worker nodes.
Familiarity with Spark tuning, optimization, and performance monitoring.
Experience with resource management tools like Kubernetes Resource Quotas and LimitRanges.
Understanding of data processing and analytics workflows.
Excellent problem-solving and troubleshooting skills.
Strong communication and collaboration skills.

Preferred

Qualifications:

Experience with Spark cluster orchestration tools like Helm.
Knowledge of Spark ecosystem components such as Spark SQL, Spark Streaming, and MLlib.
Familiarity with cloud-based solutions (e.g., AWS, Azure, Google Cloud).
Certification in Kubernetes (e.g., Certified Kubernetes Administrator CKA).
Knowledge of CI/CD pipelines and infrastructure as code (IaC) tools (e.g., Terraform).
Scripting skills in languages like Python, Bash, or Shell.
Understanding of DevOps practices and automation.

Kindly share your updated resume in word format.

  • Navi Mumbai, Maharashtra, India Mahity System Pvt Full time

    Mahity Systems is a company that helps businesses navigate the complex world of technology. We offer a range of services designed to help businesses stay ahead of the curve. Our team of experienced and knowledgeable professionals provide expert guidance and support to our clients. We pride ourselves on our customer-centric approach, working closely with our...


  • Mumbai, Maharashtra, India Jio Full time

    Role: Senior Kubernetes AdministratorJob descriptionInstalling, deploying, configuring, recommending improvements and maintaining the docker/Kubernetes cluster itself through deployment pipelines and automation.Strong understanding of networking and infrastructure architectureExperience in Configuring End to end kubernetes cluster solutionExperience in Large...


  • Mumbai, Maharashtra, India Jio Full time

    Role: Senior Kubernetes Administrator Job description Installing, deploying, configuring, recommending improvements and maintaining the docker/Kubernetes cluster itself through deployment pipelines and automation. Strong understanding of networking and infrastructure architecture. Experience in Configuring End to end kubernetes cluster solution. Experience...


  • Navi Mumbai, Maharashtra, India SettleMint Full time

    Roles and Responsibilities Design, build and implement cloudnative architectures with Kubernetes and related technologies for us. Responsible for overall Docker & Kubernetes setup, configuration and Architecture. Configuring and maintaining/ supporting a large scale Docker based environment using kubernetes. Troubleshoot and resolve issues within the Docker...


  • Navi Mumbai, Maharashtra, India Mahity System Pvt Full time

    Mahity Systems is a company that helps businesses navigate the complex world of technology.We offer a range of services designed to help businesses stay ahead of the curve. Our team ofexperienced and knowledgeable professionals provide expert guidance and support to ourclients. We pride ourselves on our customer-centric approach, working closely with our...


  • Navi Mumbai, Maharashtra, India Yotta Data Services Private Limited Full time

    Greetings from Yotta Data Services Pvt Ltd Position: Kubernetes Administrator L2 & L3 Location: Airoli/Panvel Years of experience: 5-15 years Job responsibilities: Cloud Platform Management Specialist ((Kubernetees, Docker, Ceph) / Storage, Backup and Archival / Cloud networking, Hybrid connectivity and Security/Modern Application (Containers, DevOps, etc.)...


  • Navi Mumbai, Maharashtra, India Yotta Data Services Private Limited Full time

    Greetings from Yotta Data Services Pvt LtdPosition: Kubernetes Administrator L2 & L3Location: Airoli/PanvelYears of experience: 5-15 yearsJob responsibilities:Cloud Platform Management Specialist ((Kubernetees, Docker, Ceph) / Storage, Backup and Archival / Cloud networking, Hybrid connectivity and Security/Modern Application (Containers, DevOps, etc.) / DBA...


  • Mumbai, Maharashtra, India Capgemini Full time

    Managed Kubernetes Service Swarm Docker Automation Managed Kubernetes services K8s administration Linux L3 administration Network Storage troubleshooting CKA CKAD RHCE RHCSA preferred AWS Azure GCP certifications preferred ITIL v3 4 Certified Docker Enterprise Mirantis Kubernetes Engine Red Hat OpenShift Cloud Foundry VMware Tanzu knowledge preferred...


  • Mumbai, Maharashtra, India Pricewaterhouse Coopers Private Limited Full time

    Job Description : 4 - 5 Years of experience in Kubernetes, : MumbaiResponsibilities : - Design, provision and manage Kubernetes clusters for applications based on micro-services and event-driven architectures Ensure seamless integration of applications with Kubernetes orchestrated environments Configure and manage Kubernetes resources including pods,...


  • Mumbai, Maharashtra, India Pricewaterhouse Coopers Private Limited Full time

    Job Description :4 - 5 Years of experience in Kubernetes, : MumbaiResponsibilities : - Design, provision and manage Kubernetes clusters for applications based on micro-services and event-driven architectures - Ensure seamless integration of applications with Kubernetes orchestrated environments - Configure and manage Kubernetes resources including pods,...


  • Mumbai, Maharashtra, India Pricewaterhouse Coopers Private Limited Full time

    Job Description :4 - 5 Years of experience in Kubernetes, : MumbaiResponsibilities : - Design, provision and manage Kubernetes clusters for applications based on micro-services and event-driven architectures - Ensure seamless integration of applications with Kubernetes orchestrated environments - Configure and manage Kubernetes resources including pods,...


  • Mumbai, Maharashtra, India Jio Full time

    Education:B.E./B.Tech/MCA in Computer ScienceExperience:2 to 4 Years of Experience in Kubernetes/GKE/AKS/OpenShift AdministrationJob Description:Should have basic understanding of various components of various types of kubernetes clusters (Community/AKS/GKE/OpenShift)Should have provisioning experience of various type of kubernetes clusters...


  • Mumbai, Maharashtra, India Jio Full time

    Education: B.E./B.Tech/MCA in Computer ScienceExperience: 6 to 10 Years of Experience in Kubernetes/GKE/AKS/OpenShift AdministrationJob Description: Should have very very good understanding of various components of various types of kubernetes clusters (Community/AKS/GKE/OpenShift) Should have provisioning experience of various type of kubernetes clusters...

  • Cateina Technologies

    2 months ago


    Mumbai, Maharashtra, India Cateina Technologies Full time

    Job Title : Red Hat OpenShift AdministratorJob Summary : As a Red Hat OpenShift Administrator, you will be responsible for designing, deploying, and maintaining Red Hat OpenShift Container Platform environments. Your primary focus will be on ensuring the availability, scalability, and security of containerized applications while collaborating with...

  • Cateina Technologies

    3 weeks ago


    Mumbai, Maharashtra, India Cateina Technologies Full time

    Job Title : Red Hat OpenShift AdministratorJob Summary : As a Red Hat OpenShift Administrator, you will be responsible for designing, deploying, and maintaining Red Hat OpenShift Container Platform environments. Your primary focus will be on ensuring the availability, scalability, and security of containerized applications while collaborating with...


  • Mumbai, Maharashtra, India Capgemini Full time

    Ansible and Automation Ansible administration and configuration AWX for Ansible Playbooks AWX scheduler AWX Templates Understanding writing customizing existing Playbooks or writing New Playbooks for automation Yaml scripting to write modify customize playbooks GitLaB GitLaB administration Customizing Playbooks on GitLaB Creating own Playbooks in GitLaB...


  • Mumbai, Maharashtra, India Cateina Technologies Full time

    Job Title : Red Hat OpenShift AdministratorJob Summary :As a Red Hat OpenShift Administrator, you will be responsible for designing, deploying, and maintaining Red Hat OpenShift Container Platform environments. Your primary focus will be on ensuring the availability, scalability, and security of containerized applications while collaborating with development...


  • Navi Mumbai, Maharashtra, India SETTLEMINT INDIA SERVICES PRIVATE LIMITED Full time

    SettleMint India:SettleMint India was formed in 2019, with headquarters in Delhi, India. The India team focuses on client deliverables and the development of high-performance low-code Blockchain. We operate from Delhi, and Bengaluru along with certain project locations.We are looking for a Certified Hyperledger Fabric Administrator with solid working...


  • Mumbai, Maharashtra, India Atlas Corp Full time

    The Atlas Corp. and Seaspan teams are goal-driven and share a high-performance culture, focusing on building services offerings to become a leading asset manager. Seaspan provides many of the world's major shipping lines with alternatives to vessel ownership by offering long-term leases on large, modern containerships combined with industry leading ship...

  • Linux Administrator

    3 weeks ago


    Mumbai, Maharashtra, India Careerfit.ai Full time

    Responsibilities :- Install, configure, and maintain Linux operating systems and server infrastructure to ensure high availability and performance of critical systems.- Monitor system performance, identify and troubleshoot issues, and optimize Linux servers to enhance efficiency and reliability.- Manage user accounts, permissions, and access controls on...