Hadoop Cluster Specialist

6 days ago


Bengaluru, Karnataka, India Eximietas Design Full time
Job Title: Hadoop Administrator

Job Summary:

We are seeking a skilled Hadoop Administrator to manage and maintain our large-scale Hadoop clusters. The ideal candidate will have a strong understanding of the Hadoop ecosystem, including technologies like Spark, Hive, and Presto. The role also involves scripting with Shell and Python, managing production workloads, and leveraging AWS infrastructure for optimal performance.

Key Responsibilities:

• Manage and administer Hadoop clusters in production and non-production environments
• Monitor and optimize the performance of the Hadoop ecosystem
• Perform cluster configuration, upgrades, scaling, and security implementations
• Implement and manage CI/CD pipelines to ensure continuous integration and delivery of Hadoop applications
• Collaborate with development and data engineering teams to resolve cluster-related issues and optimize resource usage
• Develop and maintain automation scripts using Shell and Python to support Hadoop operations
• Troubleshoot cluster issues, including jobs failing, node failures, and other infrastructure-related incidents
• Monitor cluster health and performance using observability tools such as New Relic, Prometheus, and Grafana
• Ensure high availability and disaster recovery strategies are in place
• Handle user management, security configurations, and access controls within the Hadoop ecosystem
• Perform regular system maintenance, including backups, patches, and updates
• Work closely with cloud infrastructure teams to manage Hadoop workloads on AWS, utilizing S3, EC2, and other AWS services

Requirements:

• 3+ years of experience in Hadoop cluster administration
• Hands-on experience with Hadoop ecosystem technologies such as Spark, Hive, and Presto
• Proficient in Linux administration and managing large-scale production workloads
• Strong scripting skills in Shell and Python
• Experience with CI/CD tools (e.g., Jenkins, GitLab CI) and observability tools (e.g., New Relic, Prometheus, Grafana)
• Practical experience with AWS services including S3, EC2, EMR, and VPC
• Knowledge of Hadoop cluster scaling, performance tuning, and troubleshooting
• Strong understanding of network, storage, and system architecture within a distributed environment

  • Bengaluru, Karnataka, India BayOne Solutions Full time

    Job Title : Hadoop Cluster SpecialistJob Location : RemoteSalary agreed: market standardsBENEFITSMonthly Food CouponsMedical InsuranceJob Description:Hadoop Cluster Specialist required to work on troubleshooting issues related to stability, reliability, and security of Linux and Hadoop systems within a production environment.Incident ManagementITILExperience...


  • Bengaluru, Karnataka, India Eximietas Design Full time

    Hadoop Administrator Job DescriptionWe are seeking a highly skilled Hadoop Administrator to join our team at Eximietas Design. The ideal candidate will have 3+ years of experience in Hadoop cluster administration and a strong background in Linux administration and managing large-scale production workloads.Key Responsibilities:1. Installation and maintenance...


  • Bengaluru, Karnataka, India Eximietas Design Full time

    Hadoop Cluster AdministrationWe are seeking a skilled Hadoop Cluster Administrator to join our team at Eximietas Design. The ideal candidate will have 3+ years of experience in Hadoop cluster administration, with a strong focus on installation, maintenance, and troubleshooting.Key Responsibilities:Installation and maintenance of Hadoop ecosystem technologies...


  • Bengaluru, Karnataka, India Growel Softech Pvt. Ltd. Full time

    Job Title: Hadoop AdministratorWe are seeking a highly skilled Hadoop Administrator to join our team at Growel Softech Pvt. Ltd.Job Summary:The successful candidate will be responsible for designing, implementing, and maintaining large-scale Hadoop clusters, ensuring high availability, performance, and security. They will also be responsible for...

  • Hadoop Cluster Expert

    3 weeks ago


    Bengaluru, Karnataka, India BayOne Solutions Full time

    Job Title: Hadoop Cluster ExpertJob Summary:We are seeking a highly skilled Hadoop Cluster Expert to join our team at BayOne Solutions. As a Hadoop Cluster Expert, you will be responsible for troubleshooting issues related to stability, reliability, and security of Linux and Hadoop systems within a production environment.Key Responsibilities:* Troubleshoot...

  • Hadoop Cluster Expert

    3 weeks ago


    Bengaluru, Karnataka, India BayOne Solutions Full time

    About the Role:We are seeking a highly skilled Hadoop Cluster Expert to join our team at BayOne Solutions. As a key member of our Big Data Services team, you will be responsible for designing, implementing, and managing large-scale Hadoop clusters.Key Responsibilities:Design and implement Hadoop cluster architectures to meet business requirementsManage and...


  • Bengaluru, Karnataka, India Eximietas Design Full time

    About Eximietas:We are a technology services and solutions company headquartered in San Jose, CA, with a global footprint that extends to Bangalore, Chennai, and Bhubaneswar in India.Our company specializes in Cloud Computing, Cybersecurity, VLSI, Embedded Software, and Artificial Intelligence, empowering businesses with cutting-edge innovations to ensure...

  • Hadoop Cluster Expert

    2 weeks ago


    Bengaluru, Karnataka, India Eximietas Design Full time

    Hadoop Administrator Job DescriptionWe are seeking a highly skilled Hadoop Administrator to join our team at Eximietas Design. The ideal candidate will have 3+ years of experience in Hadoop cluster administration and a strong understanding of the Hadoop ecosystem.Key Responsibilities:Installation and maintenance of Hadoop clustersTroubleshooting techniques...


  • Bengaluru, Karnataka, India BayOne Solutions Full time

    About the RoleBayOne Solutions is seeking a skilled Hadoop Admin to join our team. As a Hadoop Admin, you will be responsible for ensuring the stability, reliability, and security of our Linux and Hadoop systems within a production environment.Key ResponsibilitiesIncident Management and ITILExperience in Hadoop support and administrationRoot cause analysis...


  • Bengaluru, Karnataka, India Eximietas Design Full time

    Eximietas Design seeks a skilled Hadoop Administrator to oversee the smooth operation of its big data infrastructure. Key Responsibilities:Installation and maintenance of Hadoop clustersTroubleshooting techniques for optimal cluster performanceHands-on experience with high availability setup and load balancing techniquesInstallation and maintenance of...

  • Hadoop Administrator

    3 weeks ago


    Bengaluru, Karnataka, India BayOne Solutions Full time

    Hadoop Admin Job DescriptionWe are seeking a skilled Hadoop Admin to join our team at BayOne Solutions. As a Hadoop Admin, you will be responsible for troubleshooting issues related to stability, reliability, and security of Linux and Hadoop systems within a production environment.Key Responsibilities:Incident Management: Identify and resolve issues related...

  • Hadoop Administrator

    3 weeks ago


    Bengaluru, Karnataka, India BayOne Solutions Full time

    About the RoleWe are seeking a highly skilled Hadoop Administrator to join our team at BayOne Solutions. As a Hadoop Administrator, you will be responsible for ensuring the stability, reliability, and security of our Linux and Hadoop systems within a production environment.Key ResponsibilitiesIncident Management: Investigate and resolve issues related to...

  • Hadoop Administrator

    3 weeks ago


    Bengaluru, Karnataka, India BayOne Solutions Full time

    About the RoleWe are seeking a highly skilled Hadoop Administrator to join our team at BayOne Solutions. As a Hadoop Administrator, you will be responsible for ensuring the stability, reliability, and security of our Linux and Hadoop systems within a production environment.Key ResponsibilitiesIncident Management: Investigate and resolve issues related to...

  • Hadoop Administrator

    3 weeks ago


    Bengaluru, Karnataka, India BayOne Solutions Full time

    About the RoleWe are seeking a highly skilled Hadoop Administrator to join our team at BayOne Solutions. As a Hadoop Administrator, you will be responsible for designing, implementing, and maintaining large-scale Hadoop clusters.Key ResponsibilitiesDesign and implement Hadoop clusters for big data processing and analyticsConfigure and manage Hadoop...


  • Bengaluru, Karnataka, India Eximietas Design Full time

    We are seeking a highly skilled Hadoop Administrator to join our team at Eximietas Design. In this role, you will be responsible for the installation, maintenance, and troubleshooting of Hadoop clusters.Key Responsibilities:Install and configure Hadoop clusters on Linux-based systems.Manage and maintain large-scale production workloads.Develop and implement...

  • Hadoop Expert

    5 days ago


    Bengaluru, Karnataka, India BayOne Solutions Full time

    Job Title : Hadoop AdminJob SummaryWe are seeking a highly skilled Hadoop admin with expertise in troubleshooting issues related to stability, reliability, and security of Linux and Hadoop systems within a production environment. The ideal candidate will have a solid understanding of Hadoop cluster management, performance tuning and optimization, and...

  • Hadoop Administrator

    3 weeks ago


    Bengaluru, Karnataka, India @ Six Sigma Full time

    Job DetailsJob Title: Hadoop AdminJob Level: Middle ManagementJob Description:We are seeking a skilled Hadoop Admin to join our team at @ Six Sigma. The successful candidate will be responsible for administering and maintaining our Hadoop cluster, ensuring optimal performance and data integrity.Key Responsibilities:Administer and maintain Hadoop...


  • Bengaluru, Karnataka, India BayOne Solutions Full time

    Hadoop Admin Expertise: We are seeking a highly skilled Hadoop Admin to join our team at BayOne Solutions. The ideal candidate will have extensive experience in troubleshooting issues related to stability, reliability, and security of Linux and Hadoop systems within a production environment.Key Responsibilities:• Hadoop cluster management• Performance...

  • Hadoop Administrator

    3 weeks ago


    Bengaluru, Karnataka, India BayOne Solutions Full time

    About the RoleWe are seeking a highly skilled Hadoop administrator to join our team at BayOne Solutions. As a Hadoop administrator, you will be responsible for ensuring the stability, reliability, and security of our Linux and Hadoop systems within a production environment.Key ResponsibilitiesManage and maintain Hadoop clusters to ensure optimal performance...


  • Bengaluru, Karnataka, India PNR Software Solutions Full time

    Job Title: Kubernetes Cluster SpecialistOverview: We are seeking a highly skilled Kubernetes Cluster Specialist to join our team at PNR Software Solutions.Key Responsibilities:Design and implement highly available and scalable Kubernetes clustersConfigure and manage SUSE Linux environments for deploymentImplement K3S software networking design and persistent...