Senior Hadoop Cluster Specialist

1 day ago

Pune, Maharashtra, India beBeeHadoop Full time ₹ 18,00,000 - ₹ 20,10,000
Senior Hadoop Cluster Specialist

We are looking for an experienced Senior Hadoop Cluster Specialist to manage and support our Hadoop ecosystem. The ideal candidate will possess in-depth knowledge of Unix-based system administration, Cloudera and Hortonworks distributions, and configuring secure and highly available Hadoop clusters in both on-premise and cloud environments.

Key Responsibilities:

  • Deploy, configure, and manage Hadoop ecosystems (Cloudera CDP/CDH, Hortonworks HDP) across on-premises and cloud environments.
  • Perform system administration tasks on Linux-based platforms (RedHat, CentOS, Ubuntu).
  • Set up and configure Hadoop services such as HDFS, YARN, Zookeeper, Hive, Spark, HBase, etc.
  • Implement and manage Kerberos-based authentication and data-at-rest encryption for Hadoop clusters.
  • Manage and troubleshoot data replication peers and policies across environments.
  • Set up and maintain security frameworks such as Ranger, Atlas, and SSL configurations.
  • Monitor and audit Hadoop environments and ensure data integrity, availability, and compliance.
  • Utilize shell scripting, bash, and Python for automation, cluster configuration, and monitoring.
  • Support the platform deployment using AWS cloud-native services.
  • Collaborate with infrastructure, networking, and development teams for platform maintenance and upgrades.
  • Use Hadoop CLI for routine cluster operations and troubleshooting tasks.

Required Skills:

  • Hadoop Administration (CDP/CDH/HDP)
  • Unix/Linux OS (RedHat, CentOS, Ubuntu)
  • Hadoop Services: HDFS, YARN, Hive, Spark, HBase, Zookeeper
  • Kerberos, Ranger, SSL, Atlas
  • Scripting (Shell/Bash, Python)
  • Data encryption (at-rest and in-transit)
  • Cloud Platforms: AWS (Cloud-native deployment)
  • 24x7 Production Support

  • Senior Hadoop Cluster Engineer

    2 days ago

    Pune, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Description:Hadoop Administrators are responsible for overseeing the installation and maintenance of Hadoop environments, ensuring seamless operations in both cloud and on-premises settings.They should possess extensive experience with Cloudera CDP and CDH, Hortonworks HDP Distribution, and Linux (RedHat, CentOS, Ubuntu).The ideal candidate will have a...

  • Hadoop Administrator

    2 days ago

    Pune, Maharashtra, India LIFTU TECHNOLOGY PRIVATE LIMITED Full time

    Job Summary : We are looking for an experienced Hadoop Administrator with 4+ years of hands-on experience in managing and supporting Hadoop ecosystems. The ideal candidate will have deep expertise in Unix-based system administration, Cloudera and Hortonworks distributions, and configuring secure and highly available Hadoop clusters in both on-premise and...

  • Hadoop Admin

    1 day ago

    Pune, Maharashtra, India Tata Consultancy Services Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Dear Candidate Greetings from TCS Role: Hadoop AdminLocation: PuneExperience Range: 8 to 13 YearsJob Description:hands on experience managing a multi-node Hadoop cluster (preferably Cloudera distribution) Python or Shell scripting)hands on experience administering HDFS, YARN, Hive, HBase, Impala services for stability and scalability Strong understanding of...

  • Hadoop Admin

    22 hours ago

    Pune, Maharashtra, India CRUTZ LEELA ENTERPRISES Full time ₹ 1,00,000 - ₹ 9,00,000 per year

    Experience: 4 to 7 YearsJob Description: -4+ years of hands-on experience - Hadoop, System administration with sound knowledgeIn Unix based Operating System internals. Working experience on Cloudera CDP and CDH and Hortonworks HDP Distribution. Linux experience (RedHat, CentOS, Ubuntu). Experience in setting up and supporting Hadoop environment...

  • Hadoop Admin/Consultant Specialist

    6 days ago

    Pune, Maharashtra, India HSBC Full time

    Job DescriptionJob descriptionSome careers shine brighter than others.If you're looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.HSBC is one...

  • BigData-Hadoop/Scala Engineer, AVP

    5 days ago

    Pune, Maharashtra, India Deutsche Bank Full time

    Job DescriptionBigData-Hadoop/Scala Engineer, AVPPosition OverviewJob Title : BigData-Hadoop/Scala Engineer, AVPLocation : Pune, IndiaRole DescriptionA Senior Engineer is responsible for designing and developing entire engineering solutions to accomplish business goals. Key responsibilities of this role include ensuring that solutions are well architected,...

  • BigData-Hadoop/Scala Engineer. AS

    5 days ago

    Pune, Maharashtra, India Deutsche Bank Full time

    Job DescriptionBigData-Hadoop/Scala Engineer. ASPosition OverviewJob Title :BigData-Hadoop/Scala EngineerLocation : Pune, IndiaRole DescriptionAn Associate Engineer is responsible for developing and delivering elements of engineering solutions to accomplish business goals. Awareness is expected of the important engineering principles of the Bank. Root cause...

  • Big Data Infrastructure Specialist

    2 days ago

    Pune, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Big Data Administration Job OpportunityOur organization is seeking a skilled Hadoop Administrator to manage the installation, configuration, monitoring, and maintenance of Hadoop clusters.The ideal candidate will work closely with data engineers, software developers, and system administrators to ensure the performance, availability, and security of our big...

  • Expert Kafka Cluster Administrator

    4 days ago

    Pune, Maharashtra, India beBeeKafka Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job TitleAs a Kafka Infrastructure Specialist, you will be responsible for deploying and managing production-grade Kafka clusters, ensuring high availability and fault tolerance.Key responsibilities include:Cluster Deployment: Deploy and upgrade production-grade Kafka clusters using tools such as Ansible and Chef.Automated Configuration: Automate the...

  • Cluster Sales Manager

    2 days ago

    Pune, Maharashtra, India Workassist Full time

    Job DescriptionWork Level: Senior LeadershipCore: DisciplinedLeadership: Allocation of ResourcesIndustry Type: BankingFunction: BFSI, Investments & Trading - OKey Skills: Cluster Head,Zonal Head,Branch Banking,Retail Liabilities,Regional HeadEducation: PG/ MasterNote: This is a requirement for one of the Workassist Hiring Partner.Role & Responsibilities1....