Emergys - Hadoop Administrator - On-Premises

5 days ago


Pune, Maharashtra, India Emergys labs Full time

About the Role :

We are seeking a highly skilled and experienced Hadoop Administrator to join our team.

In this role, you will be responsible for the setup, configuration, maintenance, and security of our Hadoop clusters, both on-premises and in the cloud.

You will leverage your deep understanding of Hadoop distributions and Unix-based operating systems to ensure the reliability and performance of our big data infrastructure.

Mandatory Skills and Responsibilities :

Hadoop Administration :

- Setup, configure, and manage Hadoop environments (Cloud and On-premises) using Cloudera CDP/CDH and Hortonworks HDP distributions.

- Install, configure, and maintain Hadoop services like YARN, HDFS, Zookeeper, Hive, Spark, HBase, etc.

- Perform capacity planning and performance tuning of Hadoop clusters.

- Monitor and troubleshoot Hadoop cluster performance and stability.

- Implement and manage data replication peers and policies.

Operating System and System Administration :

- Extensive hands-on experience with Hadoop and system administration.

- Sound knowledge of Unix-based Operating System internals.

- Proficiency in Linux administration (RedHat, CentOS, Ubuntu).

- Experience with Hadoop command-line interface.

Security Implementation :

- Setup and configure Kerberos for Hadoop cluster security.

- Implement data-at-rest encryption (required) and data-in-transit encryption (optional).

- Knowledge of Ranger, SSL, and Atlas for Hadoop security and governance.

- Knowledge of Hadoop data related Auditing methods.

Automation and Scripting :

- Strong scripting background (shell/bash, Python) for automation and configuration management.

- Automate routine Hadoop administration tasks.

Cloud Services :

- Setting up the Hadoop platform using AWS cloud native services.

Support and Operations :

- Provide 24x7 support for Hadoop clusters, including rotating shifts, weekends, and public holidays.

- Work closely with infrastructure, networking, and development teams.

- Troubleshoot and resolve Hadoop-related issues.

Communication and Collaboration :

- Excellent communication and interpersonal skills.

- Ability to work effectively in a team environment.

Required Technical Skills :

Hadoop Distributions :

- Cloudera CDP/CDH.

- Hortonworks HDP.

Hadoop Services :

- YARN, HDFS, Zookeeper, Hive, Spark, HBase.

Operating Systems :

- Linux (RedHat, CentOS, Ubuntu).

- Unix based Operating systems.

Security :

- Kerberos.

- Ranger.

- SSL.

- Atlas.

Scripting :

- Shell/Bash.

- Python.

Cloud Services :

- AWS cloud native services.

Required Experience :

- 4+ years of hands-on experience in Hadoop administration.

- Proven experience in setting up and supporting Hadoop environments (Cloud and On-premises).

Soft Skills :

- Excellent communication and interpersonal skills.

- Strong problem-solving and troubleshooting skills.

- Ability to work in a fast-paced environment.

- Ability to work in 24x7 rotating shifts.

- Ability to work closely with other teams

(ref:hirist.tech)

  • Pune, Maharashtra, India Emergys labs Full time

    About Emergys LabsWe're looking for a seasoned Hadoop administrator to join our team at Emergys Labs. As a key member of our infrastructure team, you'll play a vital role in maintaining the integrity and performance of our big data infrastructure.Responsibilities:Manage and maintain Hadoop environments (Cloud and On-premises) using Cloudera CDP/CDH and...


  • Pune, Maharashtra, India Emergys labs Full time

    About Emergys LabsWe are seeking a highly skilled and experienced Hadoop administrator to join our team at Emergys Labs. In this role, you will be responsible for the setup, configuration, maintenance, and security of our Hadoop clusters, both on-premises and in the cloud.Key Responsibilities:Setup, configure, and manage Hadoop environments (Cloud and...


  • Pune, Maharashtra, India Emergys labs Full time

    About Emergys LabsWe are seeking a highly skilled and experienced Hadoop administrator to join our team at Emergys Labs. As a key member of our team, you will play a critical role in ensuring the reliability and performance of our big data infrastructure.Key Responsibilities:Configure and manage Hadoop environments (Cloud and On-premises) using Cloudera...


  • Pune, Maharashtra, India Emergys labs Full time

    Emergys labs is seeking a Microsoft 365 Developer to join our team and work on designing, developing, and implementing custom SharePoint solutions.Responsibilities and Requirements:Develop custom SharePoint solutions, including sites, workflows, web parts, and applications.Customize SharePoint out-of-the-box features to meet business needs.Develop responsive...


  • Pune, Maharashtra, India Emergys labs Full time

    Job Summary : We are seeking a skilled and experienced SharePoint Developer to join our team in Pune. This role will focus on the design, development, and implementation of custom SharePoint solutions, ensuring seamless integration with our existing systems and meeting our business requirements. The ideal candidate will have a strong background in both...


  • Pune, Maharashtra, India Emergys labs Full time

    At Emergys labs, we are seeking a skilled and experienced SharePoint Developer to join our team in Pune.Key Responsibilities:Design, develop, and implement custom SharePoint solutions, including sites, workflows, web parts, and applications.Customize SharePoint out-of-the-box features to meet specific business needs.Develop responsive and user-friendly...


  • Pune, Maharashtra, India Emergys labs Full time

    Benefits: As a Linux Systems Support Engineer at Emergys Labs, you will have the opportunity to work with a talented team of professionals, gain experience in a fast-paced environment, and develop your skills in technical support, troubleshooting, and system administration.Personal Attributes:Strong problem-solving and analytical skills.Excellent...


  • Pune, Maharashtra, India Emergys labs Full time

    Job Summary :We are seeking a skilled and experienced SharePoint Developer to join our team in Pune. This role will focus on the design, development, and implementation of custom SharePoint solutions, ensuring seamless integration with our existing systems and meeting our business requirements. The ideal candidate will have a strong background in both...


  • Pune, Maharashtra, India IOWeb3 Technologies Full time

    Job Summary : We are seeking a skilled and experienced Hadoop Administrator with 3-5 years of experience to join our growing team. You will be responsible for the installation, configuration, maintenance, and performance tuning of our Hadoop clusters. This role requires a strong understanding of Hadoop architecture, ecosystem components, and best practices...

  • Hadoop Administrator

    3 weeks ago


    Pune, Maharashtra, India IOWeb3 Technologies Full time

    Job Summary : We are seeking a skilled and experienced Hadoop Administrator with 3-5 years of experience to join our growing team. You will be responsible for the installation, configuration, maintenance, and performance tuning of our Hadoop clusters. This role requires a strong understanding of Hadoop architecture, ecosystem components, and best practices...

  • Hadoop Administrator

    2 weeks ago


    Pune, Maharashtra, India IOWeb3 Technologies Full time

    Job Summary : We are seeking a skilled and experienced Hadoop Administrator with 3-5 years of experience to join our growing team. You will be responsible for the installation, configuration, maintenance, and performance tuning of our Hadoop clusters. This role requires a strong understanding of Hadoop architecture, ecosystem components, and best practices...


  • Pune, Maharashtra, India Emergys labs Full time

    Job Summary : We are seeking a highly skilled and experienced SharePoint Development Architect to lead the design, implementation, and management of our enterprise-level SharePoint solutions. The ideal candidate will possess deep technical expertise in both SharePoint Online (Microsoft 365) and on-premises environments, coupled with strong leadership and...


  • Pune, Maharashtra, India Emergys labs Full time

    Job Summary :We are seeking a highly skilled and experienced SharePoint Development Architect to lead the design, implementation, and management of our enterprise-level SharePoint solutions. The ideal candidate will possess deep technical expertise in both SharePoint Online (Microsoft 365) and on-premises environments, coupled with strong leadership and...


  • Pune, Maharashtra, India Emergys labs Full time

    You will play a crucial role in developing and implementing cutting-edge AI/ML solutions, leveraging your expertise in generative models, NLP, and deep learning to solve complex business challenges. This role requires a deep understanding of advanced statistical and machine learning techniques, excellent communication skills, and the ability to collaborate...


  • Pune, Maharashtra, India Emergys labs Full time

    You will play a crucial role in developing and implementing cutting-edge AI/ML solutions, leveraging your expertise in generative models, NLP, and deep learning to solve complex business challenges. This role requires a deep understanding of advanced statistical and machine learning techniques, excellent communication skills, and the ability to collaborate...


  • Pune, Maharashtra, India Emergys labs Full time

    Job Overview : We are seeking a highly skilled and experienced DevOps Engineer with a strong focus on Kubernetes and cloud-native technologies. In this role, you will be responsible for building, deploying, and maintaining our infrastructure and applications, ensuring high availability, scalability, and security. You will leverage your deep expertise in...


  • Pune, Maharashtra, India Emergys labs Full time

    Job Overview : We are seeking a highly skilled and experienced DevOps Engineer with a strong focus on Kubernetes and cloud-native technologies. In this role, you will be responsible for building, deploying, and maintaining our infrastructure and applications, ensuring high availability, scalability, and security. You will leverage your deep expertise in...


  • Pune, Maharashtra, India Emergys labs Full time

    Job Overview : We are seeking a highly skilled and experienced DevOps Engineer with a strong focus on Kubernetes and cloud-native technologies. In this role, you will be responsible for building, deploying, and maintaining our infrastructure and applications, ensuring high availability, scalability, and security. You will leverage your deep expertise in...


  • Pune, Maharashtra, India Emergys labs Full time

    Job headquartered in Morrisville, NC, USA, operates globally across North America, Asia, and Latin America. We specialize in delivering cutting-edge solutions such as SAP, ServiceNow, Salesforce, BMC, Data & Analytics, AI, Hyperautomation, and Low Code/No Code platforms.As a certified SAP Gold Partner and Strategic VAR, we integrate technology, people, and...


  • Pune, Maharashtra, India Emergys labs Full time

    Job headquartered in Morrisville, NC, USA, operates globally across North America, Asia, and Latin America. We specialize in delivering cutting-edge solutions such as SAP, ServiceNow, Salesforce, BMC, Data & Analytics, AI, Hyperautomation, and Low Code/No Code platforms.As a certified SAP Gold Partner and Strategic VAR, we integrate technology, people, and...