Hadoop Cluster Manager Professional

2 days ago

Bengaluru, Karnataka, India beBeeHadop Full time US$ 1,25,000 - US$ 1,75,000

Senior Hadoop Cluster Manager

Job Description:

We are seeking a highly skilled Senior Hadoop Cluster Manager to oversee the installation, configuration, and maintenance of large-scale Cloudera Hadoop clusters in on-premises or cloud environments.

As a Senior Hadoop Cluster Manager, you will work closely with cross-functional teams to ensure seamless integration of Hadoop with other systems. You will be responsible for monitoring cluster health, performance, and capacity planning to optimize resource utilization.

Key Responsibilities:

  1. Install, configure, and maintain Cloudera Hadoop clusters to ensure optimal system operation.
  2. Monitor cluster health, performance, and capacity planning to optimize resource utilization.
  3. Perform cluster maintenance tasks, including upgrades, patches, and backups.
  4. Manage various Cloudera services such as HDFS, Hive, Impala, HBase, YARN, Spark, and others.
  5. Troubleshoot and resolve complex issues related to the Hadoop ecosystem.
  6. Implement and monitor security protocols, including Kerberos and Ranger.
  7. Optimize and tune performance for Hadoop jobs and clusters.
  8. Manage data ingestion pipelines and workflows within the Hadoop ecosystem.
  9. Collaborate with DevOps and infrastructure teams to integrate Hadoop with other systems.
  10. Maintain proper documentation of processes, configurations, and changes.
  11. Provide support during disaster recovery and high-availability scenarios.

Required Skills and Qualifications:

  • Proven experience as a Cloudera Hadoop Administrator or similar role.
  • Expertise in Cloudera Manager, CDH, CDP, and Hadoop ecosystem tools.
  • Strong understanding of Hadoop components, including HDFS, Hive, Impala, HBase, YARN, Spark, etc.
  • Experience with cluster security protocols, Kerberos, and TLS.
  • Proficiency in Linux/Unix systems administration and shell scripting.
  • Knowledge of cloud platforms (AWS, Azure, GCP) and integrating Hadoop clusters.
  • Familiarity with backup and disaster recovery strategies for Hadoop environments.
  • Problem-solving skills and ability to troubleshoot complex issues.
  • Excellent communication and documentation skills.

  • Hadoop Admin

    3 weeks ago

    Bengaluru, Karnataka, India Harman Full time

    OS loading configuration of name nodes data nodes and edge nodes in Hadoop cluster Configure NFS shares on Data Lake storage nodes mount across Hadoop cluster nodes Installing and upgrading Java on Hadoop nodes Installing Hadoop packages Performance management CPU Memory disk performance issues Kernel parameter tuning Disk management ...

  • Hadoop Administrator

    4 weeks ago

    Bengaluru, Karnataka, India Tehno Right Full time

    Job Role : Hadoop Administrator (Role open for multiple locations) - WFH and WFOJob description :What is your Role ?- You will manage Hadoop clusters, data storage, server resources, and other virtual computing platforms. - You perform a variety of functions, including data migration, virtual machine set-up and training, troubleshooting end-user problems,...

  • Cloudera Hadoop Administrator

    2 days ago

    Bengaluru, Karnataka, India Bay Area Tek Solutions Full time

    Role Cloudera Hadoop AdministratorExperience 5 to 10 YrsWork Location BangaloreEducation Bachelor s degree in computer science Information Technology or a related field Key Responsibilities Install configure and maintain Cloudera Hadoop clusters in on-premises or cloud environments Monitor cluster health performance and capacity planning to...

  • Big data-Pyspark Developer-Hadoop

    4 weeks ago

    Bengaluru, Karnataka, India Infosys Limited Full time

    Job DescriptionKey Responsibilities:- 1- Deploying a hadoop cluster maintaining a hadoop cluster adding and removing nodes using cluster monitoring tools like Cloudera Manager configuring the NameNode high availability and keeping a track of all the running hadoop jobs- Implementing managing and administering the overall hadoop infrastructure- Knowledge all...

  • Expert Hadoop Support Specialist

    2 days ago

    Bengaluru, Karnataka, India beBeeHadoop Full time ₹ 80,00,000 - ₹ 1,00,00,000

    Job Opportunity">This role is ideal for candidates passionate about Hadoop administration and customer support, looking to deepen their expertise in a focused, high-impact environment.">Key Responsibilities:">">Provide technical assistance for Hadoop clusters, addressing customer concerns with empathy and professionalism.">Troubleshoot and resolve problems...

  • Hadoop Admin

    3 weeks ago

    Bengaluru, Karnataka, India TapTalent Full time

    Primary Skill- Hadoop AdminLocation - Hyderbad ChennaiExperience - 6-9 Years -IT experience in the areas of Bigdata tech stack and Administration 6 years Cloudera Hadoop administration including installation configuration monitoring and upgrades in large-scale enterprise environments on Linux platforms 3 years of Linux Shell scripting experience ...

  • Hadoop Ecosystem Data Infrastructure Engineer

    3 days ago

    Bengaluru, Karnataka, India beBeeDataInfrastructureEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job OpportunityWe are seeking a skilled professional to manage and administer Hadoop ecosystem components, automate operational workflows using Airflow or scripting languages, monitor and troubleshoot system-level issues across hybrid cloud environments, and collaborate with security and platform teams to enhance data infrastructure.Key RequirementsEvaluate...

  • Bigdata Hadoop Admin

    2 days ago

    Bengaluru, Karnataka, India Infosys Full time

    Responsibilities A day in the life of an Infoscion- As part of the Infosys consulting team your primary role would be to actively aid the consulting team in different phases of the project including problem definition effort estimation diagnosis solution generation and design and deployment You will explore the alternatives to the recommended...

  • Junior Hadoop Admin

    1 day ago

    Bengaluru, Karnataka, India Capco Full time

    Hadoop Admin Location Bangalore Experience - 5-10 yrs About Us Capco a Wipro company is a global technology and management consulting firm Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar Seramount With our presence across 32 cities across globe we support...

  • Cloudera Hadoop – Subject Matter Expert

    1 day ago

    Bengaluru, Karnataka, India Kyndryl Full time US$ 80,000 - US$ 1,50,000 per year

    Who We AreAt Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day. So why work at Kyndryl? We are always moving forward – always pushing ourselves to go further in our efforts to build a more equitable, inclusive world for our employees, our customers and our communities.The...