Hadoop Administrator

3 weeks ago

Anywhere in IndiaMultiple Locations ATS India Full time

Role : Hadoop Administrator

Industry Type : IT

Employment Type : Full Time

Role Category : Permanent

Department : Engineering

Job Description :

- Configure various property files like coresite.xml, hdfssite.xml, mapredsite.xml based on the job requirement.

- Manage and review Hadoop log files.

- Conduct performance tuning of Hadoop cluster and Hadoop jobs.

- Take complete ownership of disk space management and monitoring.

- Perform data balancing on clusters.

- Manage Hadoop Distributed File System (HDFS) cluster users and permissions.

- Analyze system failures, identify root causes, and recommend a course of action. Document the systems processes and procedures for future reference.

- Troubleshoot application errors and ensure that they do not occur again.

- Configure NameNode to ensure high availability.

- Analyze storage data volume and assign space in HDFS.

- Manage software and hardware deployment in the Hadoop ecosystem and the expansion of existing ones.

- Conduct implementation in a Hadoop cluster and its maintenance.

- Deploy and manage Hadoop infrastructure on a current basis.

- Install Hadoop on Linux.

- Monitor the Hadoop cluster to check whether it is up-to-date and is constantly running.

- Manage resources in a cluster ecosystem conduct new node development and eradication of non-functioning ones.

- Screen Hadoop cluster job performances and capacity planning.

- Monitor Hadoop cluster connectivity and security.

- Manage and review Hadoop log files.

- Monitor file system management in the team.

Skills and Experience :

- Mandatory 2+ years of production support (L2/L3) experience in DevOps and cloud/multi-cloud.

- Hands-on experience in at least one of the cloud technologies like AWS, Azure, or GCP.

- Should have good knowledge of Hadoop components like Airflow, Spark, Yarn, Hive, HBase, Zookeeper, HDFS, MapReduce, etc.

- Should know the Hadoop implementation procedure, which is responsible for maintaining the Hadoop clusters running seamlessly in production. They are in charge of clusters and other resources in the Hadoop ecosystem.

- Must have a good understanding of core concepts of Windows and Linux for administration and troubleshooting.

- Should be adept in configuration management: Ansible or Terraform.

- Proficiency in CI/CD, Jenkins or similar would be an advantage.

- Good understanding of support delivery processes/guidelines like problem management, incident management, change management, SLA compliance, productivity, and other application goals.

- Should be open for rotational shifts.

- Must have good communication, analysis, and debugging skills.

(ref:hirist.tech)

  • Hadoop Administrator

    2 months ago

    Anywhere in India,Multiple Locations ATS India Full time

    Role : Hadoop AdministratorIndustry Type : IT Employment Type : Full TimeRole Category : PermanentDepartment : Engineering Job Description :- Configure various property files like coresite.xml, hdfssite.xml, mapredsite.xml based on the job requirement.- Manage and review Hadoop log files.- Conduct performance tuning of Hadoop cluster and Hadoop jobs.- Take...

  • Hadoop Administrator

    2 months ago

    Metros,Anywhere in India,Multiple Locations Dotflick Solutions Full time

    Designation : Hadoop AdministratorOpen for Pan India(Any Location)Job Description :- Development and deployment of data applications- Design Implementation of infrastructure tooling and work on horizontal frameworks and libraries- Creation of data ingestion pipelines between legacy data warehouses and the big data stack- Automation of application back-end...

  • Hadoop Administrator

    2 months ago

    Metros/Anywhere in India/Multiple Locations, IN Dotflick Solutions Full time

    Designation : Hadoop AdministratorOpen for Pan India(Any Location)Job Description :- Development and deployment of data applications- Design Implementation of infrastructure tooling and work on horizontal frameworks and libraries- Creation of data ingestion pipelines between legacy data warehouses and the big data stack- Automation of application back-end...

  • Hadoop Administrator

    4 weeks ago

    Jaipur/Ahmedabad/Anywhere in India/Multiple Locations, IN ATech Full time

    Job Profile : Hadoop AdministratorWFH and WFO (Hiring Office Jaipur and Ahmedabad)Role: Big Data EngineerIndustry Type: IT Services & ConsultingJob description :- Good understanding of SDLC and agile methodologies- Installation and configuration of Hadoop clusters, including HDFS, MapReduce, Hive, Pig, HBase, and other related tools- Managing and monitoring...

  • Hadoop Administrator

    1 month ago

    Jaipur/Ahmedabad/Anywhere in India/Multiple Locations ATech Full time

    Job Profile : Hadoop AdministratorWFH and WFO (Hiring Office Jaipur and Ahmedabad)Role: Big Data EngineerIndustry Type: IT Services & ConsultingJob description :- Good understanding of SDLC and agile methodologies - Installation and configuration of Hadoop clusters, including HDFS, MapReduce, Hive, Pig, HBase, and other related tools- Managing and...

  • Hadoop Administrator

    3 weeks ago

    Jaipur/Ahmedabad/Anywhere in India/Multiple Locations ATech Full time

    Job Profile : Hadoop AdministratorWFH and WFO (Hiring Office Jaipur and Ahmedabad)Role: Big Data EngineerIndustry Type: IT Services & ConsultingJob description :- Good understanding of SDLC and agile methodologies - Installation and configuration of Hadoop clusters, including HDFS, MapReduce, Hive, Pig, HBase, and other related tools- Managing and...

  • Hadoop Administrator

    3 weeks ago

    Jaipur/Ahmedabad/Anywhere in India/Multiple Locations, IN ATech Full time

    Job Profile : Hadoop AdministratorWFH and WFO (Hiring Office Jaipur and Ahmedabad)Role: Big Data EngineerIndustry Type: IT Services & ConsultingJob description :- Good understanding of SDLC and agile methodologies- Installation and configuration of Hadoop clusters, including HDFS, MapReduce, Hive, Pig, HBase, and other related tools- Managing and monitoring...

  • Hadoop Administrator

    1 week ago

    India ATS India Full time

    Role : Hadoop AdministratorIndustry Type :ITEmployment Type : Full TimeRole Category : PermanentDepartment : Engineering Job Description : Configure various property files like , , based on the job requirement. Manage and review Hadoop log files. Conduct performance tuning of Hadoop cluster and Hadoop jobs. Take complete ownership of disk space management...

  • Hadoop Administrator

    1 week ago

    India Dotflick Solutions Full time

    Designation : Hadoop AdministratorOpen for Pan India(Any Location)Job Description : Development and deployment of data applications Design Implementation of infrastructure tooling and work on horizontal frameworks and libraries Creation of data ingestion pipelines between legacy data warehouses and the big data stack Automation of application backend...

  • Application Developer

    2 months ago

    Anywhere in India/Multiple Locations, IN Optivalue tek consulting Full time

    Summary : As an Application Developer, you will be responsible for designing, building, and configuring applications to meet business process and application requirements using PySpark. Your typical day will involve working with Hadoop Administration and collaborating with cross-functional teams to deliver impactful data-driven solutions.Roles &...

  • Application Developer

    2 months ago

    Anywhere in India,Multiple Locations Optivalue tek consulting Full time

    Summary : As an Application Developer, you will be responsible for designing, building, and configuring applications to meet business process and application requirements using PySpark. Your typical day will involve working with Hadoop Administration and collaborating with cross-functional teams to deliver impactful data-driven solutions. Roles &...

  • Application Developer

    3 weeks ago

    Anywhere in India/Multiple Locations Optivalue tek consulting Full time

    Summary : As an Application Developer, you will be responsible for designing, building, and configuring applications to meet business process and application requirements using PySpark. Your typical day will involve working with Hadoop Administration and collaborating with cross-functional teams to deliver impactful data-driven solutions. Roles &...

  • Application Developer

    3 weeks ago

    Anywhere in India/Multiple Locations, IN Optivalue tek consulting Full time

    Summary : As an Application Developer, you will be responsible for designing, building, and configuring applications to meet business process and application requirements using PySpark. Your typical day will involve working with Hadoop Administration and collaborating with cross-functional teams to deliver impactful data-driven solutions.Roles &...

  • Hadoop Administrator

    1 month ago

    india ATRIBS METSCON GROUP Full time

    Job Description ·        Design, deploy and support highly available and scalable Hadoop clusters for high data volumes.·        Atleast 12 years of experience in the field of IT with Degree in Computer science·        Ensure performance , security and availability of mission critical data.·        Experience in migrating from...

  • Hadoop Administrator

    1 week ago

    India ATRIBS METSCON GROUP Full time

    Job Description · Design, deploy and support highly available and scalable Hadoop clusters for high data volumes.· Atleast 12 years of experience in the field of IT with Degree in Computer science· Ensure performance , security and availability of mission critical data.· Experience in migrating from CDH to CDP cluster with on-premise...

  • IICL - Hadoop & Greenplum Developer - Data Migration

    13 hours ago

    india INTELLIGENCE INDIA.COM LIMITED Full time

    Skills : Hadoop, Greenplum & ClouderaLocation : Onsite Nigeria, LagosDuration : 1 Year Extendable Job Description : - Experience in installing, configuring, supporting and Managing Hadoop clusters using Cloudera & Horton works Hadoop distributions.- Experience in Migrating data from Greenplum to Hadoop.- Installing, Configuring, Upgrading and Maintaining...

  • Platform Engineer

    2 months ago

    Chennai/Anywhere in India/Multiple Locations, IN Mobile Programming LLC Full time

    Job Description :Job Description : Platform EngineerTitle : Platform Engineer Location : Chennai Work Mode : Hybrid (Remote and Chennai Office) Experience : 6+ years Responsibilities :- Administer systems including configuration, monitoring and maintenance of Application servers;- Able to discern stakeholder needs, effectively communicate development plans,...

  • Platform Engineer

    3 weeks ago

    Chennai/Anywhere in India/Multiple Locations Mobile Programming LLC Full time

    Job Description : Job Description : Platform EngineerTitle : Platform Engineer Location : Chennai Work Mode : Hybrid (Remote and Chennai Office) Experience : 6+ years Responsibilities :- Administer systems including configuration, monitoring and maintenance of Application servers;- Able to discern stakeholder needs, effectively communicate development...

  • Platform Engineer

    2 months ago

    Chennai/Anywhere in India/Multiple Locations Mobile Programming LLC Full time

    Job Description : Job Description : Platform EngineerTitle : Platform Engineer Location : Chennai Work Mode : Hybrid (Remote and Chennai Office) Experience : 6+ years Responsibilities :- Administer systems including configuration, monitoring and maintenance of Application servers;- Able to discern stakeholder needs, effectively communicate development...

  • Platform Engineer

    3 weeks ago

    Chennai/Anywhere in India/Multiple Locations, IN Mobile Programming LLC Full time

    Job Description :Job Description : Platform EngineerTitle : Platform Engineer Location : Chennai Work Mode : Hybrid (Remote and Chennai Office) Experience : 6+ years Responsibilities :- Administer systems including configuration, monitoring and maintenance of Application servers;- Able to discern stakeholder needs, effectively communicate development plans,...