Hadoop Cluster Specialist

7 days ago

Anywhere in IndiaMultiple LocationsAny LocationMetros TechnoRight Full time
Hadoop Administrator Job Description

We are seeking a highly skilled Hadoop Administrator to join our team at TechnoRight. As a Hadoop Administrator, you will be responsible for the day-to-day operations of our Hadoop cluster, ensuring high availability and performance.

Key Responsibilities:
  • General operational expertise, including troubleshooting, systems capacity, and understanding of memory, CPU, OS, storage, and networks.
  • Hands-on experience in managing Hadoop cluster skills, including HDFS, Spark, Hive, H-Catalog, Pig, Flume, HBase, Kafka, NiFi, YARN, Impala, Zookeeper, Oozie, SOLR, and Sentry.
  • Experience in Hadoop cluster security, including LDAP, Kerberos, encryption at rest and in motion, data privacy and protection, and implementing RBAC rules and ACL policies.
  • Ability to deploy Hadoop cluster, add and remove nodes, track jobs, monitor critical parts of the cluster, configure name node high availability, schedule, and configure backups.
  • Good understanding of SDLC and agile methodologies, installation and configuration of Hadoop clusters, including HDFS, MapReduce, Hive, Pig, HBase, and other related tools.
  • Managing and monitoring Hadoop clusters to ensure high availability and performance.
  • Planning and implementing data backup and disaster recovery strategies for Hadoop clusters.
  • Proactively monitoring and tuning Hadoop cluster performance to optimize resource utilization and prevent bottlenecks.
  • Providing technical support to developers and end-users as needed.
  • Awareness of latest technologies and trends, logical thinking, and problem-solving skills, along with an ability to collaborate.
  • Good knowledge of Linux, administration, shell, and awk scripting.
  • Experience with open-source Hadoop cluster and its configuration management.
  • Good understanding of OS concepts, process management, and resource scheduling.
  • Basics of networking, CPU, memory, and storage.
  • Performing tuning and increasing operational efficiency on a continuous basis.
  • Monitoring the health of the platforms and generating performance reports.
  • Performing optimization capacity planning of a large multitenant cluster.
  • Allocating and managing compute, memory, storage, and number of namenode objects for individual pools and user groups.
  • Upgrading Hadoop software and its ecosystem.

We offer a competitive salary and benefits package, as well as opportunities for professional growth and development. If you are a motivated and experienced Hadoop Administrator looking for a new challenge, please submit your application.

  • Hadoop Cluster Engineer

    6 days ago

    Anywhere in India/Multiple Locations/Any Location/Metros TechnoRight Full time

    Hadoop Administrator Job DescriptionAt TechnoRight, we're seeking a highly skilled Hadoop Administrator to join our team. As a Hadoop Administrator, you will be responsible for the day-to-day operation and maintenance of our Hadoop cluster.Key Responsibilities:General operational expertise, including troubleshooting skills, understanding of systems capacity,...

  • Hadoop Administrator

    3 weeks ago

    Anywhere in India/Multiple Locations/Any Location/Metros, IN TechnoRight Full time

    WFH and WFOJob description :Role : Hadoop Administrator- General operational expertise such as good troubleshooting skills, understanding of systems capacity, bottlenecks, basics of memory, CPU, OS, storage, and networks.- Very good hands on experience in managing Hadoop cluster skills like HDFS, Spark, Hive, H-Catalog, Pig, Flume, HBase, Kafka, NiFi, YARN,...

  • Hadoop Cluster Administrator

    4 days ago

    Metros/Anywhere in India/Multiple Locations Dotflick Solutions Full time

    Job DescriptionWe are seeking a highly skilled Hadoop Cluster Administrator to join our team at Dotflick Solutions. As a key member of our Big Data Infrastructure team, you will be responsible for designing, developing, and maintaining our Hadoop clusters.Key Responsibilities:Design and implement Hadoop cluster architecturesDevelop and maintain data...

  • Hadoop Cluster Specialist

    6 days ago

    Jaipur/Ahmedabad/Anywhere in India/Multiple Locations ATech Full time

    Job Profile : Hadoop AdministratorATech is seeking a highly skilled Hadoop Administrator to join our team. As a key member of our Big Data Engineering team, you will be responsible for designing, implementing, and managing large-scale Hadoop clusters.Key Responsibilities:Design and implement Hadoop clusters, including HDFS, MapReduce, Hive, Pig, HBase, and...

  • Hadoop Cluster Administrator

    7 days ago

    Jaipur/Ahmedabad/Anywhere in India/Multiple Locations ATech Full time

    Hadoop Administrator Job DescriptionWe are seeking a highly skilled Hadoop Administrator to join our team at ATech. As a Hadoop Administrator, you will be responsible for the installation, configuration, and management of Hadoop clusters, including HDFS, MapReduce, Hive, Pig, HBase, and other related tools.Key Responsibilities:Manage and monitor Hadoop...

  • Hadoop Cluster Manager

    6 days ago

    Mumbai/Bangalore/Bhubaneshwar/Anywhere in India/Multiple Locations Tehno Right Full time

    Job Role: Hadoop AdministratorJob Description:We are seeking a highly skilled Hadoop Administrator to join our team at Tehno Right. As a Hadoop Administrator, you will be responsible for managing Hadoop clusters, data storage, server resources, and other virtual computing platforms.Key Responsibilities:Manage Hadoop clusters, data storage, and server...

  • Hadoop Cluster Manager

    7 days ago

    Mumbai/Bangalore/Bhubaneshwar/Anywhere in India/Multiple Locations Tehno Right Full time

    Hadoop Administrator Job DescriptionWe are seeking a highly skilled Hadoop Administrator to join our team at Tehno Right. As a Hadoop Administrator, you will be responsible for managing Hadoop clusters, data storage, server resources, and other virtual computing platforms.Key Responsibilities:Manage Hadoop clusters, data storage, and server resourcesDesign,...

  • Hadoop Cluster Administrator

    7 days ago

    Metros/Anywhere in India/Multiple Locations Dotflick Solutions Full time

    Job Title: Hadoop AdministratorJob Summary:We are seeking a highly skilled Hadoop Administrator to join our team at Dotflick Solutions. The successful candidate will be responsible for designing, developing, and deploying data applications, as well as implementing infrastructure tooling and working on horizontal frameworks and libraries.Key...

  • Hadoop Administrator

    6 months ago

    Metros/Anywhere in India/Multiple Locations, IN Dotflick Solutions Full time

    Designation : Hadoop AdministratorOpen for Pan India(Any Location)Job Description :- Development and deployment of data applications- Design Implementation of infrastructure tooling and work on horizontal frameworks and libraries- Creation of data ingestion pipelines between legacy data warehouses and the big data stack- Automation of application back-end...

  • Hadoop Developer

    6 days ago

    Anywhere in India/Multiple Locations IT Source Global Full time

    Hadoop Developer Job DescriptionJob Summary: We are seeking a highly skilled Hadoop Developer to join our team at IT Source Global. The successful candidate will be responsible for designing, developing, and maintaining large-scale data processing applications using Hadoop and related Big Data technologies.Key Responsibilities:Design and develop complex data...

  • Hadoop Developer

    2 weeks ago

    Anywhere in India/Multiple Locations, IN IT Source Global Full time

    Role : Hadoop DeveloperJob Description :- Develop, implement, and maintain large-scale data processing applications using Hadoop and related Big Data technologies.- Design and develop complex data pipelines for ingestion, transformation, and processing of structured and unstructured data.- Work with tools in the Hadoop ecosystem such as HDFS, MapReduce, Pig,...

  • Hadoop Administrator

    5 months ago

    Jaipur/Ahmedabad/Anywhere in India/Multiple Locations, IN ATech Full time

    Job Profile : Hadoop AdministratorWFH and WFO (Hiring Office Jaipur and Ahmedabad)Role: Big Data EngineerIndustry Type: IT Services & ConsultingJob description :- Good understanding of SDLC and agile methodologies- Installation and configuration of Hadoop clusters, including HDFS, MapReduce, Hive, Pig, HBase, and other related tools- Managing and monitoring...

  • Big Data Infrastructure Specialist

    2 days ago

    Metros/Anywhere in India/Multiple Locations Dotflick Solutions Full time

    Job SummaryWe are seeking a highly skilled Data Engineering Expert to join our team at Dotflick Solutions. The ideal candidate will have a strong background in big data infrastructure and experience with Hadoop clusters.Key ResponsibilitiesDesign and implement data ingestion pipelines between legacy data warehouses and big data stacksDevelop and deploy data...

  • AppSierra Solutions

    3 weeks ago

    Anywhere in India/Multiple Locations AppSierra Solutions Pvt Ltd Full time

    Responsibilities :- Designing and developing big data processing pipelines using Pentaho and Hadoop- Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities- Implementing ETL process - Monitoring performance and advising any necessary infrastructure changes- Defining data retention policiesSkills and...

  • Hadoop Administrator

    4 months ago

    Mumbai/Bangalore/Bhubaneshwar/Anywhere in India/Multiple Locations, IN Tehno Right Full time

    Job Role : Hadoop Administrator (Role open for multiple locations) - WFH and WFOJob description :What is your Role ?- You will manage Hadoop clusters, data storage, server resources, and other virtual computing platforms. - You perform a variety of functions, including data migration, virtual machine set-up and training, troubleshooting end-user problems,...

  • Big Data Developer

    3 weeks ago

    Any Location, India PRONTO CONSULTING SERVICES Full time

    Job Description : - Collaborate with the client lead to understand business requirements, translating them into technical specifications for the development of Big Data systems.Application Development : - Design, develop, and implement Big Data applications using Hadoop, Spark, and Scala.- Optimize applications for performance, scalability, and...

  • Lead Hadoop Administrator

    1 month ago

    India ClearTrail Technologies Full time

    Job Title: Lead -Hadoop Technical Support Role Big Data Infrastructure Implementation and Support Experience: 8 to 12 years of experience in Big Data, Apache Hadoop System Implementation, and administration. Education: BE (IT/Computers), B.Tech, M.Tech, MCA Work Location : Riyadh, Saudi Arabia Certifications: Apache Hadoop...

  • Capgemini - AWS EMR Engineer

    3 weeks ago

    Anywhere in India/Multiple Locations, IN Capgemini Full time

    Roles & Responsibilities - AWS+EMR- Minimum 2-6 years of experience in AWS technologies.- Setting up and managing EMR clusters for processing large-scale data using frameworks like Apache Hadoop, Apache Spark, Apache Hive, etc.- Configuring EMR clusters based on specific requirements, including choosing the appropriate instance types, storage configurations,...

  • Big Data Engineer

    7 days ago

    Anywhere in India/Multiple Locations IT Source Global Full time

    Job Title: Hadoop DeveloperWe are seeking a skilled Hadoop Developer to join our team at IT Source Global.Job Summary:The successful candidate will be responsible for designing, developing, and maintaining large-scale data processing applications using Hadoop and related Big Data technologies.Key Responsibilities:Design and develop complex data pipelines for...

  • Data Engineering Specialist

    3 days ago

    Anywhere in India/Multiple Locations TalentXO Full time

    Key Responsibilities :As a Data Engineering Specialist at TalentXO, you will be responsible for designing and implementing data pipelines using AWS Glue and AWS MWAA (Airflow). You will work collaboratively with cross-functional teams and stakeholders to deliver high-impact data engineering projects.Required Qualifications :7-8 years of experience as a Data...