Hadoop Administrator

Hadoop Administrator

Are you curious, motivated, and forward-thinking? At FIS you'll have the opportunity to work on some of the most challenging and relevant issues in financial services and technology. Our talented people empower us, and we believe in being part of a team that is open, collaborative, entrepreneurial, passionate and above all fun. 

About the team:  

• Total team consist of 10 Hadoop DBA across India and US
• Team provides 24*7 DBA support plus planned weekend changes.

What you will be doing:

• Service Management: Administer, configure, and maintain Hadoop ecosystem services within both Cloudera Data Platform (CDP) and Cloudera Distributed Hadoop (CDH), including HDFS, YARN, Hive, Spark, Ranger, Sentry, Kerberos security, KMS, KTS,  Zookeeper, and more.
• Job Scheduling and Workflow Management: Utilize Oozie, Zena, Airflow to schedule and orchestrate complex data jobs and workflows, meeting business requirements efficiently. This includes day-end SLA jobs to ensure timely data processing.
• Security and Access Control: Manage security measures such as Kerberos authentication, safeguarding Hadoop clusters and data in both CDP and CDH environments. Implement and maintain role-based access control (RBAC) policies in Ranger and Sentry.
• Job Monitoring and Tuning: Set up robust monitoring systems, including advanced tools like Unravel, to track cluster health, job execution, and resource utilization in both CDP and CDH environments. Continuously fine-tune configurations for optimized performance.
• Issue Resolution and Troubleshooting: Identify and troubleshoot issues related to job failures, data processing, and cluster performance in both CDP and CDH environments. Develop and implement solutions to mitigate recurring problems.
• Cross-Functional Collaboration: Act as a bridge between technical teams, including application support, development, and scheduling. Facilitate effective communication to understand and address their requirements and issues.

What you will need:

• 7 to 12 Years of experience as a Hadoop Administrator and Big Data Engineer, with expertise in managing a wide range of Hadoop ecosystem services across CDP and CDH environments, including day-end SLA jobs.
• Deep understanding of security practices, including Kerberos, Ranger, and Sentry, in both CDP and CDH.
• Proficiency in job scheduling and orchestration using Zena, Oozie, and Airflow across both environments.
• Strong scripting skills (e.g., Bash, Python) and experience with automation frameworks.
• Excellent problem-solving and troubleshooting abilities.
• Familiarity with advanced monitoring tools like Unravel.
• Relevant certifications (e.g., Cloudera Certified Administrator, AWS Certified Big Data) are advantageous.

Added bonus if you have:

• End to End automation integration know-how.
• Multi Cloud knowledge (Hands on Experience) .

What we offer you:

At FIS, you can learn, grow and make an impact in your career. Our benefits include:  

• Flexible and creative work environment 
• Diverse and collaborative atmosphere  
• Professional and personal development resources 
• Opportunities to volunteer and support charities 
• Competitive salary and benefits

Privacy Statement

FIS is committed to protecting the privacy and security of all personal information that we process in order to provide services to our clients. For specific information on how FIS protects personal information online, please see the Online Privacy Notice.

Sourcing Model

Recruitment at FIS works primarily on a direct sourcing model; a relatively small portion of our hiring is through recruitment agencies. FIS does not accept resumes from recruitment agencies which are not on the preferred supplier list and is not responsible for any related fees for resumes submitted to job postings, our employees, or any other part of our company.

#pridepass