Hadoop Administrator

3 weeks ago


Delhi, Delhi, India TechnoRight Full time

WFH and WFO

Job description :

Role : Hadoop Administrator

- General operational expertise such as good troubleshooting skills, understanding of systems capacity, bottlenecks, basics of memory, CPU, OS, storage, and networks.

- Very good hands on experience in managing Hadoop cluster skills like HDFS, Spark, Hive, H-Catalog, Pig, Flume, HBase, Kafka, NiFi, YARN, Impala, Zookeeper, Oozie, SOLR, Oozie, Sentry, Encryption etc

- Experience in Hadoop cluster security and Data Governance LDAP, Kerberos, encryption at rest & in-motion, Data privacy/protection, implementing RBAC rules and Define and setup ACL policies.

- Ability to deploy Hadoop cluster, add and remove nodes, keep track of jobs, monitor critical parts of the cluster, configure name node high availability, schedule and configure it and take backups.

- Good understanding of SDLC and agile methodologiesInstallation and configuration of Hadoop clusters, including HDFS, MapReduce, Hive, Pig, HBase, and other related tools

- Managing and monitoring Hadoop clusters to ensure high availability and performance

- Planning and implementing data backup and disaster recovery strategies for Hadoop clusters

- Proactively monitoring and tuning Hadoop cluster performance to optimize resource utilization and prevent bottlenecks

- Providing technical support to developers and end-users as needed

- Awareness of latest technologies and trends

- Logical thinking and problem solving skills along with an ability to collaborate

- Good knowledge of Linux as Hadoop runs on Linux, Administration, Shell, awk scripting

- Experience with open source Hadoop cluster and its configuration management

- Good understanding of OS concepts, process management and resource scheduling.

- Basics of networking, CPU, memory and storage.

- Perform Tuning and Increase Operational efficiency on a continuous basis

- Monitor health of the platforms and Generate Performance Reports and Monitor and provide continuous improvements

- Perform optimization capacity planning of a large multi-tenant cluster

- Allocate and manage compute, memory, storage, number of name-node objects for individual pools and user groups.

- Upgrading Hadoop software and its ecosystem

(ref:hirist.tech)

  • Delhi, Delhi, India huns info pvt ltd Full time

    Senior Data :- Skilled and experienced Sr. Data Engineer with proven experience in Spark, Kafka, Hadoop, Data Management.Skills :- Proficiency in programming languages Scala, Java, Python.- Experience with design and development of ELT workflows and data pipelines for high-volume data systems e.g. Datastage, Informatica, Talend, etc.- Experience in Data...

  • Hadoop Administrator

    3 weeks ago


    Gurugram, Delhi, Kolkata, India Robotics Technologies Full time

    Job DescriptionDescriptionWe are seeking an experienced Hadoop Administrator to manage and optimize our Hadoop ecosystem. The ideal candidate will have extensive experience in setting up, configuring, and maintaining Hadoop clusters, ensuring data availability, and collaborating with data engineering teams to support our data processing...


  • Delhi, Pune, Chennai, India beBeeDevops Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Title: Devops/Hadoop AdministratorWe are seeking an experienced Devops/Hadoop Administrator to join our team.Mandatory Skills:Hadoop (Apache, CDH), Yarn, Hive deployment experience - 3 yearsShell Scripting skills - 1 yearAWS/GCP Cloud computing knowledge - 1 yearApplication server deployment expertise - 1 yearSecurity understanding of HadoopDesirable...

  • Database Administrator

    21 hours ago


    New Delhi, India NMS Consultant Full time

    From 3 to 8 year(s) of experience ₹ Not Disclosed by Recruiter - New Delhi, Delhi / NCR **Roles and Responsibilities** **Responsibilities**: - Install, monitor, and maintain PostgreSQL & MySQL software, implement monitoring and alerting, implement backup and recovery processes, provide system and SQL performance tuning and assist in business process...


  • Mumbai, Kolkata, Delhi, India beBeeDataEngineer Full time ₹ 9,00,000 - ₹ 12,00,000

    Pursuing a career as a Senior Data EngineerKey ResponsibilitiesDemonstrated expertise in cloud-based data processing using Google Cloud Big Query, Snowflake, and AWSDeveloped proficiency in ETL tools such as Talend, Datastage, Informatica ISS, Data Fusion, Data Flow, and Data ProcMaintained strong knowledge of SQL and PL/SQL scripting for efficient database...

  • Cognos Admin

    3 days ago


    Delhi, India NuLeaf Consulting Full time

    Location (WFO): Mumbai, Pune, Chennai, Bangalore, Delhi NCR Secondary Skillset: (Not Mandatory, Good to have) **JD1 - Cognos Admin 7+ Years’ Experience - 2 Positions** 2. **6 months Contract to Hire Position** 3. Ability to provide 24 by 7 production support for Cognos in an on - rotation with excellent communication skills required 5. Cognos 11.1.x...