Hadoop Administrator

2 days ago

Pune, Maharashtra, India LIFTU TECHNOLOGY PRIVATE LIMITED Full time

Job Summary :

We are looking for an experienced Hadoop Administrator with 4+ years of hands-on experience in managing and supporting Hadoop ecosystems. The ideal candidate will have deep expertise in Unix-based system administration, Cloudera and Hortonworks distributions, and configuring secure and highly available Hadoop clusters in both on-premise and cloud environments. You will be responsible for ensuring the reliability, security, and performance of big data platforms while collaborating with cross-functional teams to support enterprise-level data initiatives.

Roles & Responsibilities :

- Deploy, configure, and manage Hadoop ecosystems (Cloudera CDP/CDH, Hortonworks HDP) across on-premises and cloud environments.

- Perform system administration tasks on Linux-based platforms (RedHat, CentOS, Ubuntu).

- Set up and configure Hadoop services such as HDFS, YARN, Zookeeper, Hive, Spark, HBase, etc.

- Implement and manage Kerberos-based authentication and data-at-rest encryption for Hadoop clusters.

- Manage and troubleshoot data replication peers and policies across environments.

- Set up and maintain security frameworks such as Ranger, Atlas, and SSL configurations.

- Monitor and audit Hadoop environments and ensure data integrity, availability, and compliance.

- Utilize shell scripting, bash, and Python for automation, cluster configuration, and monitoring.

- Support the platform deployment using AWS cloud-native services.

- Participate in a 24x7 rotating support model, including weekends and public holidays.

- Collaborate with infrastructure, networking, and development teams for platform maintenance and upgrades.

- Use Hadoop CLI for routine cluster operations and troubleshooting tasks.

Key Skills Required :

- Hadoop Administration (CDP/CDH/HDP)

- Unix/Linux OS (RedHat, CentOS, Ubuntu)

- Hadoop Services : HDFS, YARN, Hive, Spark, HBase, Zookeeper

- Kerberos, Ranger, SSL, Atlas

- Scripting (Shell/Bash, Python)

- Data encryption (at-rest and in-transit)

- Cloud Platforms : AWS (Cloud-native deployment)

- 24x7 Production Support

(ref:hirist.tech)

  • Hadoop Admin

    16 hours ago

    Pune, Maharashtra, India Tata Consultancy Services Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Dear Candidate Greetings from TCS Role: Hadoop AdminLocation: PuneExperience Range: 8 to 13 YearsJob Description:hands on experience managing a multi-node Hadoop cluster (preferably Cloudera distribution) Python or Shell scripting)hands on experience administering HDFS, YARN, Hive, HBase, Impala services for stability and scalability Strong understanding of...

  • Hadoop Admin

    13 hours ago

    Pune, Maharashtra, India CRUTZ LEELA ENTERPRISES Full time ₹ 1,00,000 - ₹ 9,00,000 per year

    Experience: 4 to 7 YearsJob Description: -4+ years of hands-on experience - Hadoop, System administration with sound knowledgeIn Unix based Operating System internals. Working experience on Cloudera CDP and CDH and Hortonworks HDP Distribution. Linux experience (RedHat, CentOS, Ubuntu). Experience in setting up and supporting Hadoop environment...

  • Senior Hadoop Cluster Specialist

    1 day ago

    Pune, Maharashtra, India beBeeHadoop Full time ₹ 18,00,000 - ₹ 20,10,000

    Senior Hadoop Cluster SpecialistWe are looking for an experienced Senior Hadoop Cluster Specialist to manage and support our Hadoop ecosystem. The ideal candidate will possess in-depth knowledge of Unix-based system administration, Cloudera and Hortonworks distributions, and configuring secure and highly available Hadoop clusters in both on-premise and cloud...

  • Senior Hadoop Cluster Engineer

    1 day ago

    Pune, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Description:Hadoop Administrators are responsible for overseeing the installation and maintenance of Hadoop environments, ensuring seamless operations in both cloud and on-premises settings.They should possess extensive experience with Cloudera CDP and CDH, Hortonworks HDP Distribution, and Linux (RedHat, CentOS, Ubuntu).The ideal candidate will have a...

  • Lead Apache Hadoop Engineer

    3 days ago

    Pune, Maharashtra, India Deutsche Bank Full time

    Job DescriptionLead Apache Hadoop EngineerPosition OverviewJob Title: Lead Apache Hadoop EngineerLocation: Pune, IndiaCorporate Title: Vice PresidentRole Description- Technology serves as the foundation of our entire organization. Our Technology, Data, and Innovation (TDI) strategy aims to enhance engineering capabilities, implement an agile delivery...

  • Big Data Infrastructure Specialist

    1 day ago

    Pune, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Big Data Administration Job OpportunityOur organization is seeking a skilled Hadoop Administrator to manage the installation, configuration, monitoring, and maintenance of Hadoop clusters.The ideal candidate will work closely with data engineers, software developers, and system administrators to ensure the performance, availability, and security of our big...

  • Data Architect

    1 day ago

    Pune, Maharashtra, India beBeeHadoop Full time US$ 1,40,000 - US$ 1,70,000

    We are seeking an experienced administrator to manage and optimize our extensive Hadoop platforms, which span thousands of nodes per cluster. This role is crucial for Big Data Administration and Engineering activities across multiple open-source platforms, focusing on improving performance, reliability, and efficiency.Key Responsibilities:Perform...

  • Senior Data Architect

    6 days ago

    Pune, Maharashtra, India beBeeDataArchitecture Full time

    **Job Title:** Data Architect**Overview:We are seeking a highly skilled Data Architect to lead our data modeling efforts and develop strategic data solutions.The ideal candidate will have expertise in translating business requirements into effective data models and possess strong knowledge of SSIS, Hadoop, Hive, Spark, and banking...

  • Data Site Reliability Engineer

    2 weeks ago

    Pune, Maharashtra, India Techno Wise Full time

    Data Site Reliability Engineer (SRE) Location : Pune Experience : 4-7 Years Education : UG - AnyAbout the Role :- We are looking for a highly motivated Site Reliability Engineer (SRE) to join our EDH team at Lending Club Bank.- The ideal candidate will ensure operational excellence, reliability, and performance across our Linux-based systems, Hadoop...

  • Senior Snowflake Administrator

    14 hours ago

    Pune, Maharashtra, India Securonix Full time US$ 1,50,000 - US$ 2,00,000 per year

    At Securonix, we're on a mission to secure the world by staying ahead of cyber threats, reinforcing all layers of our platform with AI capabilities. OurSecuronix Unified Defense SIEMprovides organizations with the first and only AI-Reinforced solution built with a cybersecurity mesh architecture on a highly scalable data cloud. Enhanced bySecuronix EON's AI...