Hadoop Admin Manager

4 weeks ago

Mumbai, India Smart Analytica Full time

Role : Hadoop Admin Manager CDP.

Years of Experience : 10-15 Yrs.

Location : Mumbai (Kurla).

Shifts : 24-7 (Rotational Shift).

Mode : Onsite.

Experience : 10+ yrs of experience in IT, with At least 7+ years of experience with cloud and system administration.

At least 5 years of experience with and strong understanding of 'big data' technologies in Hadoop ecosystem - Hive, HDFS, Map/Reduce, Flume, Pig, Cloudera, HBase Sqoop, Spark etc.

Empowering Your Digital Transformation with Data Modernization and AI.

Job Overview :


Smartavya Analytica Private Limited is seeking an experienced Hadoop Administrator to manage and support our Hadoop ecosystem.

The ideal candidate will have strong expertise in Hadoop cluster administration, excellent troubleshooting skills, and a proven track record of maintaining and optimizing Hadoop environments.

Key Responsibilities :

- Install, configure, and manage Hadoop clusters, including HDFS, YARN, Hive, HBase, and other ecosystem components.

- Monitor and manage Hadoop cluster performance, capacity, and security.

- Perform routine maintenance tasks such as upgrades, patching, and backups.

- Implement and maintain data ingestion processes using tools like Sqoop, Flume, and Kafka.

- Ensure high availability and disaster recovery of Hadoop clusters.

- Collaborate with development teams to understand requirements and provide appropriate Hadoop solutions.

- Troubleshoot and resolve issues related to the Hadoop ecosystem.

- Maintain documentation of Hadoop environment configurations, processes, and procedures.

Requirement :

- Experience in Installing, configuring and tuning Hadoop distributions.

- Hands on experience in Cloudera.

- Understanding of Hadoop design principals and factors that affect distributed system performance, including hardware and network considerations.

- Provide Infrastructure Recommendations, Capacity Planning, work load management.

- Develop utilities to monitor cluster better Ganglia, Nagios etc.

- Manage large clusters with huge volumes of data.

- Perform Cluster maintenance tasks.

- Create and removal of nodes, cluster monitoring and troubleshooting.

- Manage and review Hadoop log files.

- Install and implement security for Hadoop clusters.

- Install Hadoop Updates, patches and version upgrades.

- Automate the same through scripts.

- Point of Contact for Vendor escalation.

- Work with Hortonworks in resolving issues.

- Should have Conceptual/working knowledge of basic data management concepts like ETL, Ref/Master data, Data quality, RDBMS.

- Working knowledge of any scripting language like Shell, Python, Perl.

- Should have experience in Orchestration & Deployment tools.

Academic Qualification :

- BE / B.Tech in Computer Science or equivalent along with hands-on experience in dealing with large data sets and distributed computing in data warehousing and business intelligence systems using Hadoop.

(ref:hirist.tech)

  • Hadoop engineer

    2 weeks ago

    Mumbai, India Anicalls (Pty) Ltd Full time

    Strong conceptual understanding of the context and business requirements. To understand the business needs, High-Level design, and produce Low-level design documents, implement code by the best practices. • Hadoop development and Implementation. • Loading from disparate data sets. • Pre-processing using hive • Ability to perform data quality checks...

  • Office Admin

    5 days ago

    Lower Parel, Mumbai, Maharashtra, India Great Manager Institute Full time

    **Great Manager Institute®, Mumbai, India** Position**:Office Admin** **Admin Job Description** 1. Organizing and storing information in paper and digital form 2. Scanning, Printing documents 3. Arranging travel and accommodation 4. Keeping track of Laptop Inventory 5. Ordering office supplies 6. Manage phone calls and correspondence(E-Mail, Letter,...

  • Hadoop Administrator

    5 days ago

    Kanjurmarg, Mumbai, Maharashtra, India TrueView Technologies Full time

    **Job Title: Hadoop Administrator** **Location: Kanjurmarg, Mumbai** **Job Type: Full-Time** **Experience: 3-5 Years** **Key Responsibilities**: - Install, configure, and maintain Hadoop clusters and associated infrastructure. - Monitor cluster performance and ensure efficient resource usage. - Manage and optimize Hadoop services such as HDFS, YARN,...

  • Hadoop Developer

    3 weeks ago

    Mumbai City District, India Manek Consulting Full time

    We are looking for a Hadoop Developer with hands-on experience in managing, developing data solutions on Hadoop ecosystems.The candidate should have strong technical expertise in data lake design, data pipelines, and real-time/batch data processing. Required Candidate profile 3+ Yrs in Manage & support Cloudera Hadoop on-premise clusters.Work on data...

  • Big Data+ Aws Admin

    1 week ago

    Mumbai, India Vega Intellisoft Full time

    "Job Title Big Data + AWS Admin - Reports to Program Manager - Job Location Thane/Mumbai - 8-12 Years - 18 Lpa Max - Purpose of the Job: - This position is a technical position. The applicant will be involved in setting up & running big data frameworks in AWS environment. - Domain Knowledge: - Experience in manufacturing domain an added advantage, however...

  • Hadoop Architect

    9 hours ago

    Mumbai, India Smart Analytica Full time

    Job Title : Hadoop Solution Architect. Experience : 10-18 years in Analytics and Big Data with at least the last 3-4 years in CDP Hadoop solution Architect role. Location : Mumbai, India. Department : Big Data, Analytics and Cloud. Company : Smartavya Analytica Private limited is niche Data and AI company.Experience : 12-18 years of experience in Analytics...

  • Jobs For Database Administrator-Reputed IT Industry-Mumbai, Maharashtra, India-15LPA-Harshala

    6 days ago

    Mumbai, India Seven Consultancy Full time

    JOB DETAILS 1.Good working knowledge in Big data ecosystem related technologies. 2.Hands on experience in Hadoop ecosystem components. 3.Hands on experience in Hadoop Cluster and Maintenance. 4.Cluster Monitoring Assisted in tuning the performance of Hadoop eco-system.  5.Experienced in job workflow scheduling and monitoring tools like Oozie. ...

  • Jobs For Senior Database Administrator-Reputed IT Industry-Mumbai, Maharashtra, India-25LPA-Harshala

    6 days ago

    Mumbai, India Seven Consultancy Full time

    JOB DETAILS 1.Good working knowledge in Big data ecosystem related technologies. 2.Hands on experience in Hadoop ecosystem components. 3.Hands on experience in Hadoop Cluster and Maintenance. 4.Cluster Monitoring Assisted in tuning the performance of Hadoop eco-system.  5.Experienced in job workflow scheduling and monitoring tools like Oozie. ...

  • Jobs For Senior Database Administrator-Reputed IT Industry-Mumbai, Maharashtra, India-25LPA-Harshala

    2 weeks ago

    Mumbai, India Seven Consultancy Full time

    JOB DETAILS 1.Good working knowledge in Big data ecosystem related technologies. 2.Hands on experience in Hadoop ecosystem components. 3.Hands on experience in Hadoop Cluster and Maintenance. 4.Cluster Monitoring Assisted in tuning the performance of Hadoop eco-system.  5.Experienced in job workflow scheduling and monitoring tools like Oozie. ...

  • Jobs For Database Administrator-Reputed IT Industry-Mumbai, Maharashtra, India-15LPA-Harshala

    2 weeks ago

    Mumbai, India Seven Consultancy Full time

    JOB DETAILS 1.Good working knowledge in Big data ecosystem related technologies. 2.Hands on experience in Hadoop ecosystem components. 3.Hands on experience in Hadoop Cluster and Maintenance. 4.Cluster Monitoring Assisted in tuning the performance of Hadoop eco-system.  5.Experienced in job workflow scheduling and monitoring tools like Oozie. ...