Hadoop Cluster Engineer
4 weeks ago
At TechnoRight, we're seeking a highly skilled Hadoop Administrator to join our team. As a Hadoop Administrator, you will be responsible for the day-to-day operation and maintenance of our Hadoop cluster.
Key Responsibilities:- General operational expertise, including troubleshooting skills, understanding of systems capacity, bottlenecks, basics of memory, CPU, OS, storage, and networks.
- Hands-on experience in managing Hadoop cluster skills like HDFS, Spark, Hive, H-Catalog, Pig, Flume, HBase, Kafka, NiFi, YARN, Impala, Zookeeper, Oozie, SOLR, Oozie, Sentry, Encryption, etc.
- Experience in Hadoop cluster security and Data Governance, including LDAP, Kerberos, encryption at rest & in-motion, Data privacy/protection, implementing RBAC rules, and Define and setup ACL policies.
- Ability to deploy Hadoop cluster, add and remove nodes, keep track of jobs, monitor critical parts of the cluster, configure name node high availability, schedule and configure it, and take backups.
- Good understanding of SDLC and agile methodologies, Installation and configuration of Hadoop clusters, including HDFS, MapReduce, Hive, Pig, HBase, and other related tools.
- Managing and monitoring Hadoop clusters to ensure high availability and performance, Planning and implementing data backup and disaster recovery strategies for Hadoop clusters.
- Proactively monitoring and tuning Hadoop cluster performance to optimize resource utilization and prevent bottlenecks, Providing technical support to developers and end-users as needed.
- Awareness of latest technologies and trends, Logical thinking and problem-solving skills along with an ability to collaborate, Good knowledge of Linux as Hadoop runs on Linux, Administration, Shell, awk scripting.
- Experience with open-source Hadoop cluster and its configuration management, Good understanding of OS concepts, process management, and resource scheduling.
- Basics of networking, CPU, memory, and storage, Perform Tuning and Increase Operational efficiency on a continuous basis, Monitor health of the platforms and Generate Performance Reports and Monitor and provide continuous improvements.
- Perform optimization capacity planning of a large multi-tenant cluster, Allocate and manage compute, memory, storage, number of name-node objects for individual pools and user groups, Upgrading Hadoop software and its ecosystem.
We're looking for a skilled professional with a strong background in Hadoop administration, security, and data governance. If you're passionate about working with big data and want to join a dynamic team, we encourage you to apply for this exciting opportunity.
-
Hadoop Administrator
2 months ago
Anywhere in India/Multiple Locations/Any Location/Metros, IN TechnoRight Full timeWFH and WFOJob description :Role : Hadoop Administrator- General operational expertise such as good troubleshooting skills, understanding of systems capacity, bottlenecks, basics of memory, CPU, OS, storage, and networks.- Very good hands on experience in managing Hadoop cluster skills like HDFS, Spark, Hive, H-Catalog, Pig, Flume, HBase, Kafka, NiFi, YARN,...
-
Hadoop Cluster Administrator
4 weeks ago
Metros/Anywhere in India/Multiple Locations Dotflick Solutions Full timeJob DescriptionWe are seeking a highly skilled Hadoop Cluster Administrator to join our team at Dotflick Solutions. As a key member of our Big Data Infrastructure team, you will be responsible for designing, developing, and maintaining our Hadoop clusters.Key Responsibilities:Design and implement Hadoop cluster architecturesDevelop and maintain data...
-
Hadoop Cluster Specialist
4 weeks ago
Jaipur/Ahmedabad/Anywhere in India/Multiple Locations ATech Full timeJob Profile : Hadoop AdministratorATech is seeking a highly skilled Hadoop Administrator to join our team. As a key member of our Big Data Engineering team, you will be responsible for designing, implementing, and managing large-scale Hadoop clusters.Key Responsibilities:Design and implement Hadoop clusters, including HDFS, MapReduce, Hive, Pig, HBase, and...
-
Hadoop Administrator
3 weeks ago
Anywhere in India/Multiple Locations/Any Location/Metros TechnoRight Full timeHadoop Administrator Job DescriptionAt TechnoRight, we're seeking a skilled Hadoop Administrator to join our team. The ideal candidate will have a strong background in Hadoop cluster management, including HDFS, Spark, Hive, and other related tools.Key Responsibilities:• Manage and monitor Hadoop clusters to ensure high availability and performance• Plan...
-
Hadoop Cluster Manager
4 weeks ago
Mumbai/Bangalore/Bhubaneshwar/Anywhere in India/Multiple Locations Tehno Right Full timeJob Role: Hadoop AdministratorJob Description:We are seeking a highly skilled Hadoop Administrator to join our team at Tehno Right. As a Hadoop Administrator, you will be responsible for managing Hadoop clusters, data storage, server resources, and other virtual computing platforms.Key Responsibilities:Manage Hadoop clusters, data storage, and server...
-
Hadoop Administrator
7 months ago
Metros/Anywhere in India/Multiple Locations, IN Dotflick Solutions Full timeDesignation : Hadoop AdministratorOpen for Pan India(Any Location)Job Description :- Development and deployment of data applications- Design Implementation of infrastructure tooling and work on horizontal frameworks and libraries- Creation of data ingestion pipelines between legacy data warehouses and the big data stack- Automation of application back-end...
-
Hadoop Developer
4 weeks ago
Anywhere in India/Multiple Locations IT Source Global Full timeHadoop Developer Job DescriptionJob Summary: We are seeking a highly skilled Hadoop Developer to join our team at IT Source Global. The successful candidate will be responsible for designing, developing, and maintaining large-scale data processing applications using Hadoop and related Big Data technologies.Key Responsibilities:Design and develop complex data...
-
Hadoop Administrator
6 months ago
Jaipur/Ahmedabad/Anywhere in India/Multiple Locations, IN ATech Full timeJob Profile : Hadoop AdministratorWFH and WFO (Hiring Office Jaipur and Ahmedabad)Role: Big Data EngineerIndustry Type: IT Services & ConsultingJob description :- Good understanding of SDLC and agile methodologies- Installation and configuration of Hadoop clusters, including HDFS, MapReduce, Hive, Pig, HBase, and other related tools- Managing and monitoring...
-
Hadoop Developer
1 month ago
Anywhere in India/Multiple Locations, IN IT Source Global Full timeRole : Hadoop DeveloperJob Description :- Develop, implement, and maintain large-scale data processing applications using Hadoop and related Big Data technologies.- Design and develop complex data pipelines for ingestion, transformation, and processing of structured and unstructured data.- Work with tools in the Hadoop ecosystem such as HDFS, MapReduce, Pig,...
-
Hadoop Administrator
5 months ago
Mumbai/Bangalore/Bhubaneshwar/Anywhere in India/Multiple Locations, IN Tehno Right Full timeJob Role : Hadoop Administrator (Role open for multiple locations) - WFH and WFOJob description :What is your Role ?- You will manage Hadoop clusters, data storage, server resources, and other virtual computing platforms. - You perform a variety of functions, including data migration, virtual machine set-up and training, troubleshooting end-user problems,...
-
Hadoop Engineer
4 weeks ago
Any Location, India S3 vision software pvt ltd Full timeJob Title: Hadoop DeveloperJob Summary:S3 Vision Software Pvt Ltd is seeking a highly skilled Hadoop Developer to join our team. As a Hadoop Developer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Hadoop technologies.Key Responsibilities:Design and develop data pipelines using GCP frameworks...
-
Big Data Infrastructure Specialist
4 weeks ago
Metros/Anywhere in India/Multiple Locations Dotflick Solutions Full timeJob SummaryWe are seeking a highly skilled Data Engineering Expert to join our team at Dotflick Solutions. The ideal candidate will have a strong background in big data infrastructure and experience with Hadoop clusters.Key ResponsibilitiesDesign and implement data ingestion pipelines between legacy data warehouses and big data stacksDevelop and deploy data...
-
Hadoop Administrator Position
3 weeks ago
Mumbai/Bangalore/Bhubaneshwar/Anywhere in India/Multiple Locations Tehno Right Full timeHadoop Administrator Role OverviewTehno Right is seeking a highly skilled Hadoop Administrator to manage our Big Data infrastructure. As a key member of our team, you will be responsible for designing, building, and maintaining systems in both cloud and physical environments.Key Responsibilities:Manage Hadoop clusters, data storage, server resources, and...
-
AWS EMR Engineer
2 weeks ago
Anywhere in India/Multiple Locations capgemini Full timeJob SummaryJoin Capgemini as an AWS EMR Engineer and take on the challenge of managing and optimizing big data processing workflows on Amazon EMR clusters. This role requires expertise in cloud computing, big data processing, and scripting/coding skills, with a focus on delivering efficient and scalable data processing solutions.Key Responsibilities- Minimum...
-
Capgemini - AWS EMR Engineer
2 months ago
Anywhere in India/Multiple Locations, IN Capgemini Full timeRoles & Responsibilities - AWS+EMR- Minimum 2-6 years of experience in AWS technologies.- Setting up and managing EMR clusters for processing large-scale data using frameworks like Apache Hadoop, Apache Spark, Apache Hive, etc.- Configuring EMR clusters based on specific requirements, including choosing the appropriate instance types, storage configurations,...
-
Big Data Engineer
3 weeks ago
Jaipur/Ahmedabad/Anywhere in India/Multiple Locations ATech Full timeJob Profile: Hadoop Administrator at ATechWe are seeking a skilled and experienced Hadoop Administrator to join our team at ATech. As a key member of our technical staff, you will be responsible for the installation, configuration, and maintenance of our Hadoop clusters.Skills and Qualifications:- Good understanding of SDLC and agile methodologies- Strong...
-
Big Data Engineer
3 weeks ago
Anywhere in India/Multiple Locations IT Source Global Full timeJob SummaryWe are seeking a skilled Hadoop Developer to join our team at IT Source Global. As a Hadoop Developer, you will be responsible for designing and developing complex data pipelines for ingestion, transformation, and processing of structured and unstructured data.Key ResponsibilitiesDevelop, implement, and maintain large-scale data processing...
-
Data Engineer
2 months ago
Anywhere in India/Multiple Locations, IN Innotatz IT Solutions Full timeJob Description :We are looking for candidates who can join immediately. InnotatzIT Solutions is a global Software Development, IT Product Design and IT Consulting Company predominantly focused on Web Application Development, Digital Innovations & IT Recruitment Solutions. We also provide global digital consultancy that helps brands leverage design,...
-
Data Engineer
2 months ago
Anywhere in India/Multiple Locations, IN Praxis Consultants Full timeJob SummaryWe are looking for a highly skilled and experienced Technical Lead (Sr. Data Engineer/Data Architect / Data Modeler) to join our team. will play a crucial role in designing data architecture and models based on business requirements, ensuring data integrity, security, and performance. Oversee technical aspects of data integration and management...
-
Data Engineer
3 weeks ago
Anywhere in India/Multiple Locations Praxis Consultants Full timeJob Summary We are looking for a highly skilled and experienced Technical Lead (Sr. Data Engineer/Data Architect / Data Modeler) to join our team. will play a crucial role in designing data architecture and models based on business requirements, ensuring data integrity, security, and performance. Oversee technical aspects of data integration and management...