Hadoop Cluster Engineer

4 weeks ago


Anywhere in IndiaMultiple LocationsAny LocationMetros TechnoRight Full time
Hadoop Administrator Job Description

At TechnoRight, we're seeking a highly skilled Hadoop Administrator to join our team. As a Hadoop Administrator, you will be responsible for the day-to-day operation and maintenance of our Hadoop cluster.

Key Responsibilities:
  • General operational expertise, including troubleshooting skills, understanding of systems capacity, bottlenecks, basics of memory, CPU, OS, storage, and networks.
  • Hands-on experience in managing Hadoop cluster skills like HDFS, Spark, Hive, H-Catalog, Pig, Flume, HBase, Kafka, NiFi, YARN, Impala, Zookeeper, Oozie, SOLR, Oozie, Sentry, Encryption, etc.
  • Experience in Hadoop cluster security and Data Governance, including LDAP, Kerberos, encryption at rest & in-motion, Data privacy/protection, implementing RBAC rules, and Define and setup ACL policies.
  • Ability to deploy Hadoop cluster, add and remove nodes, keep track of jobs, monitor critical parts of the cluster, configure name node high availability, schedule and configure it, and take backups.
  • Good understanding of SDLC and agile methodologies, Installation and configuration of Hadoop clusters, including HDFS, MapReduce, Hive, Pig, HBase, and other related tools.
  • Managing and monitoring Hadoop clusters to ensure high availability and performance, Planning and implementing data backup and disaster recovery strategies for Hadoop clusters.
  • Proactively monitoring and tuning Hadoop cluster performance to optimize resource utilization and prevent bottlenecks, Providing technical support to developers and end-users as needed.
  • Awareness of latest technologies and trends, Logical thinking and problem-solving skills along with an ability to collaborate, Good knowledge of Linux as Hadoop runs on Linux, Administration, Shell, awk scripting.
  • Experience with open-source Hadoop cluster and its configuration management, Good understanding of OS concepts, process management, and resource scheduling.
  • Basics of networking, CPU, memory, and storage, Perform Tuning and Increase Operational efficiency on a continuous basis, Monitor health of the platforms and Generate Performance Reports and Monitor and provide continuous improvements.
  • Perform optimization capacity planning of a large multi-tenant cluster, Allocate and manage compute, memory, storage, number of name-node objects for individual pools and user groups, Upgrading Hadoop software and its ecosystem.

We're looking for a skilled professional with a strong background in Hadoop administration, security, and data governance. If you're passionate about working with big data and want to join a dynamic team, we encourage you to apply for this exciting opportunity.


  • Hadoop Administrator

    2 months ago


    Anywhere in India/Multiple Locations/Any Location/Metros, IN TechnoRight Full time

    WFH and WFOJob description :Role : Hadoop Administrator- General operational expertise such as good troubleshooting skills, understanding of systems capacity, bottlenecks, basics of memory, CPU, OS, storage, and networks.- Very good hands on experience in managing Hadoop cluster skills like HDFS, Spark, Hive, H-Catalog, Pig, Flume, HBase, Kafka, NiFi, YARN,...


  • Metros/Anywhere in India/Multiple Locations Dotflick Solutions Full time

    Job DescriptionWe are seeking a highly skilled Hadoop Cluster Administrator to join our team at Dotflick Solutions. As a key member of our Big Data Infrastructure team, you will be responsible for designing, developing, and maintaining our Hadoop clusters.Key Responsibilities:Design and implement Hadoop cluster architecturesDevelop and maintain data...


  • Jaipur/Ahmedabad/Anywhere in India/Multiple Locations ATech Full time

    Job Profile : Hadoop AdministratorATech is seeking a highly skilled Hadoop Administrator to join our team. As a key member of our Big Data Engineering team, you will be responsible for designing, implementing, and managing large-scale Hadoop clusters.Key Responsibilities:Design and implement Hadoop clusters, including HDFS, MapReduce, Hive, Pig, HBase, and...

  • Hadoop Administrator

    3 weeks ago


    Anywhere in India/Multiple Locations/Any Location/Metros TechnoRight Full time

    Hadoop Administrator Job DescriptionAt TechnoRight, we're seeking a skilled Hadoop Administrator to join our team. The ideal candidate will have a strong background in Hadoop cluster management, including HDFS, Spark, Hive, and other related tools.Key Responsibilities:• Manage and monitor Hadoop clusters to ensure high availability and performance• Plan...


  • Mumbai/Bangalore/Bhubaneshwar/Anywhere in India/Multiple Locations Tehno Right Full time

    Job Role: Hadoop AdministratorJob Description:We are seeking a highly skilled Hadoop Administrator to join our team at Tehno Right. As a Hadoop Administrator, you will be responsible for managing Hadoop clusters, data storage, server resources, and other virtual computing platforms.Key Responsibilities:Manage Hadoop clusters, data storage, and server...

  • Hadoop Administrator

    7 months ago


    Metros/Anywhere in India/Multiple Locations, IN Dotflick Solutions Full time

    Designation : Hadoop AdministratorOpen for Pan India(Any Location)Job Description :- Development and deployment of data applications- Design Implementation of infrastructure tooling and work on horizontal frameworks and libraries- Creation of data ingestion pipelines between legacy data warehouses and the big data stack- Automation of application back-end...

  • Hadoop Developer

    4 weeks ago


    Anywhere in India/Multiple Locations IT Source Global Full time

    Hadoop Developer Job DescriptionJob Summary: We are seeking a highly skilled Hadoop Developer to join our team at IT Source Global. The successful candidate will be responsible for designing, developing, and maintaining large-scale data processing applications using Hadoop and related Big Data technologies.Key Responsibilities:Design and develop complex data...

  • Hadoop Administrator

    6 months ago


    Jaipur/Ahmedabad/Anywhere in India/Multiple Locations, IN ATech Full time

    Job Profile : Hadoop AdministratorWFH and WFO (Hiring Office Jaipur and Ahmedabad)Role: Big Data EngineerIndustry Type: IT Services & ConsultingJob description :- Good understanding of SDLC and agile methodologies- Installation and configuration of Hadoop clusters, including HDFS, MapReduce, Hive, Pig, HBase, and other related tools- Managing and monitoring...

  • Hadoop Developer

    1 month ago


    Anywhere in India/Multiple Locations, IN IT Source Global Full time

    Role : Hadoop DeveloperJob Description :- Develop, implement, and maintain large-scale data processing applications using Hadoop and related Big Data technologies.- Design and develop complex data pipelines for ingestion, transformation, and processing of structured and unstructured data.- Work with tools in the Hadoop ecosystem such as HDFS, MapReduce, Pig,...

  • Hadoop Administrator

    5 months ago


    Mumbai/Bangalore/Bhubaneshwar/Anywhere in India/Multiple Locations, IN Tehno Right Full time

    Job Role : Hadoop Administrator (Role open for multiple locations) - WFH and WFOJob description :What is your Role ?- You will manage Hadoop clusters, data storage, server resources, and other virtual computing platforms. - You perform a variety of functions, including data migration, virtual machine set-up and training, troubleshooting end-user problems,...

  • Hadoop Engineer

    4 weeks ago


    Any Location, India S3 vision software pvt ltd Full time

    Job Title: Hadoop DeveloperJob Summary:S3 Vision Software Pvt Ltd is seeking a highly skilled Hadoop Developer to join our team. As a Hadoop Developer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Hadoop technologies.Key Responsibilities:Design and develop data pipelines using GCP frameworks...


  • Metros/Anywhere in India/Multiple Locations Dotflick Solutions Full time

    Job SummaryWe are seeking a highly skilled Data Engineering Expert to join our team at Dotflick Solutions. The ideal candidate will have a strong background in big data infrastructure and experience with Hadoop clusters.Key ResponsibilitiesDesign and implement data ingestion pipelines between legacy data warehouses and big data stacksDevelop and deploy data...


  • Mumbai/Bangalore/Bhubaneshwar/Anywhere in India/Multiple Locations Tehno Right Full time

    Hadoop Administrator Role OverviewTehno Right is seeking a highly skilled Hadoop Administrator to manage our Big Data infrastructure. As a key member of our team, you will be responsible for designing, building, and maintaining systems in both cloud and physical environments.Key Responsibilities:Manage Hadoop clusters, data storage, server resources, and...

  • AWS EMR Engineer

    2 weeks ago


    Anywhere in India/Multiple Locations capgemini Full time

    Job SummaryJoin Capgemini as an AWS EMR Engineer and take on the challenge of managing and optimizing big data processing workflows on Amazon EMR clusters. This role requires expertise in cloud computing, big data processing, and scripting/coding skills, with a focus on delivering efficient and scalable data processing solutions.Key Responsibilities- Minimum...


  • Anywhere in India/Multiple Locations, IN Capgemini Full time

    Roles & Responsibilities - AWS+EMR- Minimum 2-6 years of experience in AWS technologies.- Setting up and managing EMR clusters for processing large-scale data using frameworks like Apache Hadoop, Apache Spark, Apache Hive, etc.- Configuring EMR clusters based on specific requirements, including choosing the appropriate instance types, storage configurations,...

  • Big Data Engineer

    3 weeks ago


    Jaipur/Ahmedabad/Anywhere in India/Multiple Locations ATech Full time

    Job Profile: Hadoop Administrator at ATechWe are seeking a skilled and experienced Hadoop Administrator to join our team at ATech. As a key member of our technical staff, you will be responsible for the installation, configuration, and maintenance of our Hadoop clusters.Skills and Qualifications:- Good understanding of SDLC and agile methodologies- Strong...

  • Big Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations IT Source Global Full time

    Job SummaryWe are seeking a skilled Hadoop Developer to join our team at IT Source Global. As a Hadoop Developer, you will be responsible for designing and developing complex data pipelines for ingestion, transformation, and processing of structured and unstructured data.Key ResponsibilitiesDevelop, implement, and maintain large-scale data processing...

  • Data Engineer

    2 months ago


    Anywhere in India/Multiple Locations, IN Innotatz IT Solutions Full time

    Job Description :We are looking for candidates who can join immediately. InnotatzIT Solutions is a global Software Development, IT Product Design and IT Consulting Company predominantly focused on Web Application Development, Digital Innovations & IT Recruitment Solutions. We also provide global digital consultancy that helps brands leverage design,...

  • Data Engineer

    2 months ago


    Anywhere in India/Multiple Locations, IN Praxis Consultants Full time

    Job SummaryWe are looking for a highly skilled and experienced Technical Lead (Sr. Data Engineer/Data Architect / Data Modeler) to join our team. will play a crucial role in designing data architecture and models based on business requirements, ensuring data integrity, security, and performance. Oversee technical aspects of data integration and management...

  • Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations Praxis Consultants Full time

    Job Summary We are looking for a highly skilled and experienced Technical Lead (Sr. Data Engineer/Data Architect / Data Modeler) to join our team. will play a crucial role in designing data architecture and models based on business requirements, ensuring data integrity, security, and performance. Oversee technical aspects of data integration and management...