Hadoop Administrator

**Position Type**:
Full time
**Type Of Hire**:
Experienced (relevant combo of work and education)
**Education Desired**:
Bachelor's Degree
**Travel Percentage**:
0%
**Hadoop Administrator -** **Bangalore/** **Pune/Chennai/Gurgaon-** 6**-1**2**Years**

Are you curious, motivated, and forward-thinking? At FIS you’ll have the opportunity to work on some of the most challenging and relevant issues in financial services and technology. Our talented people empower us, and we believe in being part of a team that is open, collaborative, entrepreneurial, passionate and above all fun.

**What You Will Be Doing**:
**Service Management**:Administer, configure, and maintain Hadoop ecosystem services within both Cloudera Data Platform (CDP) and Cloudera Distributed Hadoop (CDH), including HDFS, YARN, Hive, Spark, Ranger, Sentry, Kerberos security, KMS, KTS, Zookeeper, and more.

**Job Scheduling and Workflow Management**: Utilize Oozie, Zena, Airflow to schedule and orchestrate complex data jobs and workflows, meeting business requirements efficiently. This includes day-end SLA jobs to ensure timely data processing.

**Security and Access Control**: Manage security measures such as Kerberos authentication, safeguarding Hadoop clusters and data in both CDP and CDH environments. Implement and maintain role-based access control (RBAC) policies in Ranger and Sentry.

**Job Monitoring and Tuning**: Set up robust monitoring systems, including advanced tools like Unravel, to track cluster health, job execution, and resource utilization in both CDP and CDH environments. Continuously fine-tune configurations for optimized performance.

**Issue Resolution and Troubleshooting**: Identify and troubleshoot issues related to job failures, data processing, and cluster performance in both CDP and CDH environments. Develop and implement solutions to mitigate recurring problems.

**Collaboration**: Collaborating with different team to install patch, Haodop updates, version upgrade across CDP and CDH environments. Contribute to the development of data engineering solutions when required.

**Documentation and Reporting**: Maintain detailed documentation of configurations, procedures, and best practices for both CDP and CDH environments. Generate reports on cluster health, job scheduling, and performance metrics.

**What You Will Bring**:

- Bachelor's degree in computer science, information technology, or a related field (Master's preferred).
- Proven experience as a Hadoop Administrator and Big Data Engineer, with expertise in managing a wide range of Hadoop ecosystem services across CDP and CDH environments, including day-end SLA jobs.
- Deep understanding of security practices, including Kerberos, Ranger, and Sentry, in both CDP and CDH.
- Proficiency in job scheduling and orchestration using Zena, Oozie, and Airflow across both environments.
- Strong scripting skills (e.g., Bash, Python) and experience with automation frameworks.
- Excellent problem-solving and troubleshooting abilities.
- Exceptional communication and collaboration skills, with the ability to engage effectively with diverse teams.
- Familiarity with advanced monitoring tools like Unravel.
- Relevant certifications (e.g., Cloudera Certified Administrator, AWS Certified Big Data) are advantageous.

**What we offer you**
- A multifaceted job with a high degree of responsibility and a broad spectrum of opportunities
- A broad range of professional education and personal development possibilities - FIS is your final career step
- A competitive salary and benefits
- A variety of career development tools, resources and opportunities

**Privacy Statement**

FIS is committed to protecting the privacy and security of all personal information that we process in order to provide services to our clients. For specific information on how FIS protects personal information online, please see the Online Privacy Notice.

**Sourcing Model**

Recruitment at FIS works primarily on a direct sourcing model; a relatively small portion of our hiring is through recruitment agencies. FIS does not accept resumes from recruitment agencies which are not on the preferred supplier list and is not responsible for any related fees for resumes submitted to job postings, our employees, or any other part of our company.

pridepass