Big Data Hadoop Administrator

3 weeks ago

Pune, India Dassault Systèmes Full time

Imagine new horizons...

Dassault Systèmes SE (French pronunciation:[daso sistem]) (abbreviated 3DS) is a French software corporation. It is among Fortune 50 list of the largest software companies that develops software for 3D product design, simulation, manufacturing and more. A Dassault Group subsidiary spun off from Dassault Aviation in 1981, it is headquartered in Vélizy-Villacoublay, France, and has around 20,000 employees in 140 different countries.

If we challenge the status quo, We can imagine the new horizons to improve the world #Weare3ds, #3ds.

In the News: Forbes Ranks us #48 in the list of World’s top Most Innovative Companies

and ranking at #55 in the list of Global 100 Most Sustainable Corporations.

Great to make Dassault Systemes as an informed choice of employer

**What will your role be**:

- Installing and monitoring Hadoop clusters
- For the efficient and continued operation of Hadoop clusters to prevent problems and to enhance the overall performance
- Keep the Hadoop clusters safe and running
- Monitoring of environments
- Automating run operations using scripting
- Support developers and end users

**The Challenges ahead**

You will be responsible on different facets of Database administration including sizing, monitoring, disaster recovery planning etc

**_ As part of operations, you will have to :_**
- Deploy and maintain hadoop cluster, add and remove nodes using cluster monitoring tools like Cloudera Manager, configure the NameNode high availability
- Keep a track of all the running hadoop jobs, scheduling and administration of jobs
- Capacity planning and estimating the requirements for lowering or increasing the capacity of the hadoop cluster
- Deciding the size of the hadoop cluster
- Manage and review Hadoop log files
- Backup and recovery tasks
- Resource and security management
- Understanding of Hadoop security, specifically Kerberos integration
- Understanding of job and task scheduling and administration of jobs
- Experience with Hadoop Ecosystem Security (Kerberos, AD integration, and/or other ecosystem components such as Ranger, Knox, Rhino, Falcon)
- Setup new Hadoop users

**Your Key expectations and success factors for future growth**:

- B.E./ B Tech in Computer Science Engineering or a related discipline from premier institutions with good academic track records
- 4 to 5 years of industry experience
- Strong Problem solving and analytical skills
- Good team spirit and interpersonal skills
- Effective communication skills

**_ Excellent knowledge of LINUX OS _**
- Configuration management and automation tools like SALT
- Knowledge of cluster monitoring tools like Ambari
- Good understanding of OS concepts, process management and resource scheduling
- Basics on JAVA
- System administration Basics on networking, CPU, memory and storage
- Good hold of shell scripting
- A knack of all the components in the Hadoop ecosystem like SPARK, SCOOP
- Shell scripting

  • Big Data Administrator

    1 month ago

    Pune, India TransUnion Full time

    TransUnion's Job Applicant Privacy Notice **What We'll Bring**: We’re looking for a Big Data Administrator to join our growing Big Data Administration team. You will be based both from our offices in Leeds and working remotely as part of our ‘flex together’ approach. In this fast-paced role you’ll work with Data Engineering and Data Science teams to...

  • Senior Hadoop Engineer

    1 month ago

    Pune, India HuQuo Consulting Pvt. Ltd. Full time

    Job Description : - 5-8 years of total experience of solid data engineering experience, especially in Open Source, data-intensive, distributed environments with minimum 5 years of experience in big data related technologies like Spark, Hive, HBase, Hadoop, etc. Programming background : - Mandatory- Scala, Spark and Java / Python - Experience in following...

  • Senior Hadoop Engineer

    1 month ago

    Pune, India HuQuo Consulting Pvt. Ltd. Full time

    Job Description :- 5-8 years of total experience of solid data engineering experience, especially in Open Source, data-intensive, distributed environments with minimum 5 years of experience in big data related technologies like Spark, Hive, HBase, Hadoop, etc. Programming background : - Mandatory- Scala, Spark and Java / Python - Experience in following...

  • Senior Hadoop Engineer

    4 weeks ago

    Pune, Maharashtra, India HuQuo Consulting Pvt. Ltd. Full time

    Job Description :- 5-8 years of total experience of solid data engineering experience, especially in Open Source, data-intensive, distributed environments with minimum 5 years of experience in big data related technologies like Spark, Hive, HBase, Hadoop, etc. Programming background : - Mandatory- Scala, Spark and Java / Python - Experience in following...

  • Hadoop Administrator

    4 weeks ago

    Pune, Maharashtra, India FIS Global Full time

    **Position Type**: Full time **Type Of Hire**: Experienced (relevant combo of work and education) **Education Desired**: Bachelor's Degree **Travel Percentage**: 0% **Hadoop Administrator -** **Bangalore/** **Pune/Chennai/Gurgaon-** 6**-1**2**Years** Are you curious, motivated, and forward-thinking? At FIS you’ll have the opportunity to work on some of...

  • Hadoop Administrator

    4 weeks ago

    Pune, Maharashtra, India FIS Global Full time

    **Position Type**: Full time **Type Of Hire**: Experienced (relevant combo of work and education) **Education Desired**: Bachelor's Degree **Travel Percentage**: 0% **Hadoop Administrator -** **Bangalore/** **Pune/Chennai/Gurgaon-** 6**-1**2**Years** Are you curious, motivated, and forward-thinking? At FIS you’ll have the opportunity to work on some of...

  • EY - Big Data Lead - Data Warehousing/Hadoop

    1 month ago

    Pune,Bangalore,Hyderabad,Mumbai,Navi Mumbai,Delhi NCR, India Ernst and Young Services Pvt. Ltd Full time

    Overview :The Data & Analytics team is looking for a Big Data Lead Engineer to drive our mission to unlock potential of data assets by consistently innovating, eliminating friction in how users access data from its Big Data repositories and enforce standards and principal in the Big Data space. The Hadoop Data Warehouse is being used by various groups to...

  • Big Data Expert

    1 month ago

    Pune, India Manning Global Full time

    Our client, a leading global IT service provider, is recruiting ** Big Data Expert** *** to join their pro ject in ** Pune, Bangalore, Kolkata.** **Position Title**: **Big Data Expert** **Position Type**: - Permanent**Start Date**: - ASAP**Location**: - India**Contact**: - Divya Shetty | +49 (0) 89 23 88 98 87**Requirements**: - Should have 3-4...

  • Big Data Engineer

    4 weeks ago

    Pune, Maharashtra, India Www.Huquo.com Full time

    Big Data Engineer( Lead assistant manager-Manager) Job Description : Must Have : Tech savvy engineer - willing and able to learn new skills, track industry trend.- 5 - 7 years of total experience of solid data engineering experience, especially in Open Source, data-intensive, distributed environments with minimum 5 years of experience in big data related...

  • Big Data Engineer

    1 month ago

    Pune, India Www.Huquo.com Full time

    Big Data Engineer( Lead assistant manager-Manager) Job Description : Must Have : Tech savvy engineer - willing and able to learn new skills, track industry trend.- 5 - 7 years of total experience of solid data engineering experience, especially in Open Source, data-intensive, distributed environments with minimum 5 years of experience in big data related...

  • Big Data Engineer

    1 month ago

    Pune, India Www.Huquo.com Full time

    Big Data Engineer( Lead assistant manager-Manager) Job Description : Must Have : Tech savvy engineer - willing and able to learn new skills, track industry trend.- 5 - 7 years of total experience of solid data engineering experience, especially in Open Source, data-intensive, distributed environments with minimum 5 years of experience in big data related...

  • Hadoop Administrator

    3 weeks ago

    Pune, India Consulting Pandits Full time

    Mandatory Skills:- 4+ years of hands-on experience - Hadoop, System administration with sound knowledge in Unix based Operating System internals.- Working experience on Cloudera CDP and CDH and Hortonworks HDP Distribution.- Linux experience (RedHat, CentOS, Ubuntu).- Experience in setting up and supporting Hadoop environment (Cloud and On-premises).-...

  • Hadoop Administrator

    3 weeks ago

    Pune, India Consulting Pandits Full time

    Mandatory Skills:- 4+ years of hands-on experience - Hadoop, System administration with sound knowledge in Unix based Operating System internals.- Working experience on Cloudera CDP and CDH and Hortonworks HDP Distribution.- Linux experience (RedHat, CentOS, Ubuntu).- Experience in setting up and supporting Hadoop environment (Cloud and On-premises).-...

  • Hadoop Administrator

    3 weeks ago

    Pune, Maharashtra, India Consulting Pandits Full time

    Mandatory Skills:- 4+ years of hands-on experience - Hadoop, System administration with sound knowledge in Unix based Operating System internals.- Working experience on Cloudera CDP and CDH and Hortonworks HDP Distribution.- Linux experience (RedHat, CentOS, Ubuntu).- Experience in setting up and supporting Hadoop environment (Cloud and On-premises).-...

  • Intern Iii-big Data and Lyve Cloud

    4 weeks ago

    Pune, India Seagate Technology Full time

    **About our group**: The group is part of the Seagate's Big data analytics & LYVE cloud solutions & services. LYVE Cloud Storage-as-a-Service platform is an S3-compatible storage-only cloud that enables always-on mass capacity data storage and activation. It is designed as a simple, trusted, and efficient service allowing enterprises to unlock the value of...

  • Hadoop Support

    4 weeks ago

    Pune, India Virtusa Full time

    Hadoop Support - CREQ184930 DescriptionJD : AWS SupportExperience : 6 to 12 yearsExpertise in data processing, data transformation, data Ingestion, data loading, Batch Processing and Stream Processing Should have experience in leading a team to complete development of new features. Experienced in SDLC concepts with extensive knowledge in development,...

  • Hadoop Developer

    4 weeks ago

    Pune, India Nityo Infotech Full time

    Should have Hands on Experience of Development on Cloudera Platform.• Developing Unix Shell scripts• Good understating of Hadoop Technologies such as Pig, Hive, HBase, HDFS, Spark,be able to analyze the issues on Hadoop Systems.• Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS...

  • Data Engineer

    1 month ago

    Pune, India TD NEWTON Full time

    Job Description : Must have Requirements : To be successful in this role, you should meet the following requirements : - Scala development and design using Scala 2.10+ or Java development and design using Java 1.8+. - Experience with most of the following technologies : Apache Hadoop, Scala, Apache Spark, Spark streaming, YARN, Kafka, Hive, Python, ETL...

  • Hadoop Developer

    1 month ago

    Pune, India Nityo Infotech Full time

    Should have Hands on Experience of Development on Cloudera Platform.• Developing Unix Shell scripts• Good understating of Hadoop Technologies such as Pig, Hive, HBase, HDFS, Spark, be able to analyze the issues on Hadoop Systems.• Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS...

  • Manager/Senior Manager

    1 month ago

    pune, India HuQuo Consulting Pvt. Ltd. Full time

    Responsibilities :- Meeting with the development team to assess the company's big data infrastructure.- Designing and coding hadoop applications to analyze data collections.- Creating data processing frameworks.- Extracting data and isolating data clusters.- Testing scripts and analyzing results.- Troubleshooting application bugs.- Maintaining the security...