Hadoop Admin

**Who We Are**

At Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day. So why work at Kyndryl? We are always moving forward - always pushing ourselves to go further in our efforts to build a more equitable, inclusive world for our employees, our customers and our communities.

**The Role**

As a Data Scientist at Kyndryl you are the bridge between business problems and innovative solutions, using a powerful blend of well-defined methodologies, statistics, mathematics, domain expertise, consulting, and software engineering. You'll wear many hats, and each day will present a new puzzle to solve, a new challenge to conquer.

You will dive deep into the heart of our business, understanding its objectives and requirements - viewing them through the lens of business acumen, and converting this knowledge into a data problem. You’ll collect and explore data, seeking underlying patterns and initial insights that will guide the creation of hypotheses.

In this role, you will embark on a transformative process of business understanding, data understanding, and data preparation. Utilizing statistical and mathematical modeling techniques, you'll have the opportunity to create models that defy convention - models that hold the key to solving intricate business challenges. With an acute eye for accuracy and generalization, you'll evaluate these models to ensure they not only solve business problems but do so optimally.

Cluster management and maintenance
- Deployment: Install, configure, and deploy multi-node Hadoop clusters and all related ecosystem components on Linux environments.
- Node management: Commission and decommission data nodes to scale the cluster based on data and resource needs.
- Configuration: Manage and update service configurations for components like HDFS, YARN, Hive, and Spark.
- Upgrades and patches: Plan and execute upgrades, including rolling out patches and version upgrades for the Hadoop ecosystem.
- Automation: Use configuration management tools like Ansible, Puppet, or Chef to automate cluster deployment and management tasks.

Monitoring and performance tuning
- System health: Monitor the overall health and performance of the Hadoop cluster using tools like Cloudera Manager or Ambari.
- Job tracking: Keep a close eye on running jobs and resource utilization to ensure they are performing efficiently.
- Performance optimization: Tune the cluster, including Hadoop MapReduce routines and YARN resource allocation, to improve performance.

Security and access control
- Security setup: Implement and maintain security protocols, such as Kerberos authentication, across the Hadoop environment.
- User administration: Create and manage users and groups within Hadoop and the underlying Linux operating system.
- Access control: Manage permissions to ensure data governance policies are enforced.

Data management and administration
- Data migration: Manage the movement of data into and out of HDFS using tools like Sqoop and Flume.
- Capacity planning: Monitor disk space usage and forecast future storage needs to ensure sufficient capacity.
- Backup and recovery: Design and implement backup and disaster recovery procedures to protect cluster data.
- Log management: Collect, review, and manage log files from the Hadoop daemons for auditing and troubleshooting purposes.

Collaboration and support
- Escalation point: Serve as the point of contact for vendor escalation to resolve critical issues.Documentation: Maintain comprehensive documentation of cluster configurations, procedures, and best practices.

**Who You Are**

Who You Are
You’re good at what you do and possess the required experience to prove it. However, equally as important - you have a growth mindset; keen to drive your own personal and professional development. You are customer-focused - someone who prioritizes customer success in their work. And finally, you’re open and borderless - naturally inclusive in how you work with others.

Required Skills and Experience

**Required qualifications and skills**
- 10 years of experience as Hadoop Admin
- Technical expertise: Strong knowledge of the Hadoop ecosystem, including HDFS, YARN, MapReduce, Hive, and Spark.
- Linux proficiency: Excellent command of Linux/UNIX commands and shell scripting, as Hadoop is primarily run on Linux.
- Problem-solving: Exceptional analytical and troubleshooting skills to diagnose complex cluster issues.
- Communication: Strong interpersonal and communication skills to collaborate with various technical and business teams.
- Automation skills: Hands-on experience with automation tools like Ansible or Puppet.
- Cloud experience (optional): Experience with cloud-based Hadoop services like Amazon EMR or Azure HDInsight is a plus.
- Database knowledge: Familiarity with database concepts and SQL can be beneficial, particularly for managing Hive and HBase databases.

Preferred Skills and Experience
- Degree in