Hadoop Administrator

16 hours ago


Bengaluru Karnataka, India Techrevive Full time

**Key Responsibilities**:

- Hadoop Ecosystem Management: Administer, configure, and optimize Big Data platforms, including Hortonworks, Cloudera, and MapR, in both secured and unsecured environments.
- Security & Compliance: Implement and manage security technologies such as Kerberos, Knox, Ranger, KMS, SSL certificates, and encryption zones.
- Cluster Administration: Perform capacity planning for HDFS file systems and YARN resources; ensure high availability for core Hadoop services.
- Performance Optimization: Fine-tune Java heap settings and allied parameters to maintain optimal performance for Hadoop services.
- Troubleshooting: Analyze logs to identify issues, collaborate with product vendors for root cause analysis, and propose optimization solutions.
- Product Upgrades & Maintenance: Conduct product upgrades, cluster expansions, and ongoing maintenance of the Big Data environment.
- Data Ingestion & Management: Manage data pipeline tools like Sqoop, Distcp, and file ingestion workflows; recommend appropriate file formats and compression techniques.
- Cloud Integration: Work with AWS and GCP services relevant to Big Data, ensuring seamless integration and administration.
- Disaster Recovery: Develop and implement disaster recovery solutions using platform-native tools or custom scripts.
- Scripting & Automation: Create and maintain shell scripts, Python, or Perl scripts for automation and administration tasks.
- Version Control & DevOps: Use tools like Git, GitHub, Jenkins, Bamboo, and Ansible for deployment and testing within Agile/DevOps environments.
- Database Administration: Administer open-source RDBMS like MySQL, PostgreSQL, and MariaDB, particularly for services like Ambari and Ranger.
- Service Operations: Align with ITIL concepts to manage service operations activities efficiently in a critical infrastructure environment.

**Required Skills and Qualifications**:

- Technical Expertise:

- Strong experience in Hadoop ecosystem administration with distributions like Hortonworks, Cloudera, and MapR.
- Deep knowledge of Hive, HBase, Kafka, Spark, and related Hadoop ecosystem tools.
- Experience with Hadoop security and compliance technologies (Kerberos, Knox, Ranger, etc.).
- Proficiency in Linux system administration and shell scripting (Python/Perl is a plus).
- Familiarity with disaster recovery, capacity planning, and high-availability setup.
- Working knowledge of RDBMS (MySQL, PostgreSQL) and integration with Hadoop components.
- Understanding of Agile/DevOps practices and experience with CI/CD tools like Ansible and Jenkins.
- Knowledge of cloud platforms (AWS/GCP) and their Big Data services.
- Soft Skills:

- Strong troubleshooting and problem-solving abilities.
- Effective communication and interpersonal skills.
- Ability to engage with stakeholders to drive effective decisions.
- Excellent time management and team collaboration skills.
- Certifications (preferred):

- Certifications in Hadoop, Cloudera, or related Big Data technologies.
- AWS or GCP certifications relevant to Big Data services.
- ITIL Foundation certification.

**Experience**:

- 5+ years of experience in Hadoop administration or related Big Data platform roles.
- Hands-on experience in Agile/DevOps-based projects.

**Work Environment**:

- Ability to work in an infrastructure-critical environment.
- Comfortable collaborating across cultures and distributed teams.

Pay: ₹600,000.00 - ₹1,100,000.00 per year

**Benefits**:

- Provident Fund

Schedule:

- Day shift

Supplemental Pay:

- Performance bonus

**Experience**:

- total work: 6 years (preferred)
- Hadoop: 5 years (preferred)

Work Location: In person



  • Bengaluru, India Namsbel Full time

    6 years of Hadoop Administration experience in a big data environment - Experience in Hadoop Administration activities such as installation, configuration, and management of clusters in Cloudera(CDH), Hortonworks (HDP) Distributions using Cloudera Manager, Ambari and Oracle enterprise manager. - Hands on experience in installing, configuring, and performance...

  • Hadoop Administrator

    4 weeks ago


    Bengaluru, India Maneva Consulting Pvt. Ltd Full time

    Greetings from Maneva! Job Description Job Title - Hadoop Administrator Experience - 6 - 12 Years Location - Bangalore Notice - Immediate to 15 days Requirements: - Install, configure, and manage Hadoop clusters (HDFS, YARN, Spark etc.).  Monitor the...

  • Hadoop Administrator

    4 weeks ago


    Bengaluru, India Maneva Consulting Pvt. Ltd Full time

    Greetings from Maneva! Job Description Job Title - Hadoop Administrator Experience - 6 - 12 Years Location - Bangalore Notice - Immediate to 15 days Requirements: - Install, configure, and manage Hadoop clusters (HDFS, YARN, Spark etc.).  Monitor the health and...


  • Bengaluru, India Capco Technologies Pvt Ltd Full time

    Position : Hadoop AdminExperience : 5 - 10 YearsLocation : Bangalore, IndiaWork Model : HybridJob Summary : We're looking for an experienced Hadoop Admin with 5 -10 years of experience to join our Big Data team. The ideal candidate will be a skilled professional responsible for managing and engineering our Hadoop platforms, with a strong focus on...


  • Bengaluru, India Tehno Right Full time

    Job Role : Hadoop Administrator (Role open for multiple locations) - WFH and WFOJob description :What is your Role ?- You will manage Hadoop clusters, data storage, server resources, and other virtual computing platforms. - You perform a variety of functions, including data migration, virtual machine set-up and training, troubleshooting end-user problems,...


  • Bangalore, Karnataka, India Maneva Consulting Full time

    Greetings from Maneva Job Title - Hadoop Administrator Experience - 6 - 12 Years Location - Bangalore Notice - Immediate to 15 days Requirements - Install configure and manage Hadoop clusters HDFS YARN Spark etc Monitor the health and performance of the Hadoop clusters and troubleshoot issues Implement and manage security policies and...


  • Bengaluru, India Circana Full time

    Sr/ Lead Engineer – Hadoop Let’s be unstoppable together! At Circana, we are fueled by our passion for continuous learning and growth, we seek and share feedback freely, and we celebrate victories both big and small in an environment that is flexible and accommodating to our work and personal lives. We have a global commitment to...


  • Bengaluru, India Circana Full time

    Sr/ Lead Engineer – Hadoop Let’s be unstoppable together! At Circana, we are fueled by our passion for continuous learning and growth, we seek and share feedback freely, and we celebrate victories both big and small in an environment that is flexible and accommodating to our work and personal lives. We have a global commitment to diversity,equity,and...


  • Bangalore, Karnataka, India Circana Full time

    Description Sr Lead Engineer - Hadoop Let s be unstoppable together At Circana we are fueled by our passion for continuous learning and growth we seek and share feedback freely and we celebrate victories both big and small in an environment that is flexible and accommodating to our work and personal lives We have a global commitment to diversity equity and...

  • Cloudera Hadoop

    16 hours ago


    Bengaluru, Karnataka, India Kyndryl Full time

    Who We Are At Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day. So why work at Kyndryl? We are always moving forward - always pushing ourselves to go further in our efforts to build a more equitable, inclusive world for our employees, our customers and our communities. The Role Are...