Hadoop Administrator/Manager
5 days ago
Description :Role : Hadoop Admin Manager CDP.Years of Experience : 10-15 Yrs.Location : Mumbai (Kurla).Shifts : 24-7 (Rotational Shift).Mode : Onsite.Experience : 10+ yrs of experience in IT, with At least 7+ years of experience with cloud and system administration.At least 5 years of experience with and strong understanding of big data technologies in Hadoop ecosystem Hive, HDFS, Map/Reduce, Flume, Pig, Cloudera, HBase Sqoop, Spark etc.Company : Smartavya Analytica Private limited is a niche Data and AI company.Based in Pune, we are pioneers in data-driven innovation, transforming enterprise data into strategic insights.Established in 2017, our team has experience in handling large datasets up to 20 PBs in a single implementation, delivering many successful data and AI projects across major industries, including retail, finance, telecom, manufacturing, insurance, and capital markets.We are leaders in Big Data, Cloud and Analytics projects with super specialization in very large Data Overview : Smartavya Analytica Private Limited is seeking an experienced Hadoop Administrator to manage and support our Hadoop ecosystem.The ideal candidate will have strong expertise in Hadoop cluster administration, excellent troubleshooting skills, and a proven track record of maintaining and optimizing Hadoop environments.Key Responsibilities :- Install, configure, and manage Hadoop clusters, including HDFS, YARN, Hive, HBase, and other ecosystem components.- Monitor and manage Hadoop cluster performance, capacity, and security.- Perform routine maintenance tasks such as upgrades, patching, and backups.- Implement and maintain data ingestion processes using tools like Sqoop, Flume, and Kafka.- Ensure high availability and disaster recovery of Hadoop clusters.- Collaborate with development teams to understand requirements and provide appropriate Hadoop solutions.- Troubleshoot and resolve issues related to the Hadoop ecosystem.- Maintain documentation of Hadoop environment configurations, processes, and procedures.Requirement :- Experience in Installing, configuring and tuning Hadoop distributions.- Hands on experience in Cloudera.- Understanding of Hadoop design principals and factors that affect distributed system performance, including hardware and network considerations.- Provide Infrastructure Recommendations, Capacity Planning, work load management.- Develop utilities to monitor cluster better Ganglia, Nagios etc.- Manage large clusters with huge volumes of data.- Perform Cluster maintenance tasks.- Create and removal of nodes, cluster monitoring and troubleshooting.- Manage and review Hadoop log files.- Install and implement security for Hadoop clusters.- Install Hadoop Updates, patches and version upgrades.- Automate the same through scripts.- Point of Contact for Vendor escalation.- Work with Hortonworks in resolving issues.- Should have Conceptual/working knowledge of basic data management concepts like ETL, Ref/Master data, Data quality, RDBMS.- Working knowledge of any scripting language like Shell, Python, Perl.- Should have experience in Orchestration & Deployment tools.Academic Qualification :- BE / B.Tech in Computer Science or equivalent along with hands-on experience in dealing with large data sets and distributed computing in data warehousing and business intelligence systems using Hadoop. (ref:hirist.tech)
-
Hadoop Admin Manager
1 week ago
Mumbai, Maharashtra, India Smart Analytica Full time ₹ 6,00,000 - ₹ 18,00,000 per yearRole: Hadoop Admin Manager - CDPYears of Experience: 10-15 YrsLocation: Mumbai (Kurla)Shifts: 24*7 (Rotational Shift)Mode: OnsiteExperience: 10+ yrs of experience in IT, with At least 7+ years of experience with cloud and system administration. At least 5 years of experience with and strong understanding of 'big data' technologies in Hadoop ecosystem –...
-
Hadoop Admin Manager
4 hours ago
Mumbai, India Smart Analytica Full timeRole: Hadoop Admin Manager - CDPYears of Experience: 10-15 YrsLocation: Mumbai (Kurla)Shifts: 24*7 (Rotational Shift)Mode: OnsiteExperience: 10+ yrs of experience in IT, with At least 7+ years of experience with cloud and system administration. At least 5 years of experience with and strong understanding of ‘big data’ technologies in Hadoop ecosystem –...
-
Hadoop Admin Manager
26 minutes ago
mumbai, India Smart Analytica Full timeRole: Hadoop Admin Manager - CDPYears of Experience: 10-15 YrsLocation: Mumbai (Kurla)Shifts: 24*7 (Rotational Shift)Mode: OnsiteExperience: 10+ yrs of experience in IT, with At least 7+ years of experience with cloud and system administration. At least 5 years of experience with and strong understanding of ‘big data’ technologies in Hadoop ecosystem –...
-
Hadoop Admin
1 day ago
Mumbai, Maharashtra, India Tata Consultancy Services Full timeLeverageNoSQL, Hive, Sqoop, Flume, Yarn, and other Hadoop ecosystem utilities for datamovement - Set-uphigh availability and disaster recovery for Hadoop cluster - Monitorand audit SNAP ingest process (Filemon, Kafka, X15) - Monitorand audit SNAP ingest and streaming processes (Filemon, Kafka, X15, DataTorrent, Striim, etc) - Performdata extraction from SQL...
-
Hadoop Lead/ Architect
1 week ago
Mumbai, Maharashtra, India Smartavya Analytica Full time ₹ 8,00,000 - ₹ 24,00,000 per yearJob Title: Hadoop Lead/ Solutions ArchitectExperience: 7-12 years in Analytics and Big Data with at least the last 3-4 years in CDP Hadoop Lead/ Solutions Architect roleLocation: Mumbai, IndiaDepartment: Big Data, Analytics and CloudCompany: Smart Analytica Private limited is niche Data and AI company. Based in Pune, we are pioneers in data-driven...
-
Hadoop Architect
3 weeks ago
Mumbai, India Smart Analytica Full timeJob Title : Hadoop Solution Architect. Experience : 10-18 years in Analytics and Big Data with at least the last 3-4 years in CDP Hadoop solution Architect role. Location : Mumbai, India. Department : Big Data, Analytics and Cloud. Company : Smartavya Analytica Private limited is niche Data and AI company.Experience : 12-18 years of experience in Analytics...
-
Mumbai, India Seven Consultancy Full timeJOB DETAILS 1.Good working knowledge in Big data ecosystem related technologies. 2.Hands on experience in Hadoop ecosystem components. 3.Hands on experience in Hadoop Cluster and Maintenance. 4.Cluster Monitoring Assisted in tuning the performance of Hadoop eco-system. 5.Experienced in job workflow scheduling and monitoring tools like Oozie. ...
-
Mumbai, India Seven Consultancy Full timeJOB DETAILS 1.Good working knowledge in Big data ecosystem related technologies. 2.Hands on experience in Hadoop ecosystem components. 3.Hands on experience in Hadoop Cluster and Maintenance. 4.Cluster Monitoring Assisted in tuning the performance of Hadoop eco-system. 5.Experienced in job workflow scheduling and monitoring tools like Oozie. ...
-
▷ 15h Left: Bigdata Hadoop Engineer
3 weeks ago
Mumbai, India Diverse Lynx Full timeHiring for Bigdata Hadoop Engineer Pune Job Summary We are seeking a highly skilled and motivated Big Data Hadoop Engineer to join our data engineering team The ideal candidate will be responsible for designing developing and maintaining big data solutions using the Hadoop ecosystem You will work closely with data scientists analysts and other engineers to...
-
(Urgent Search) Big Data Architect
2 weeks ago
Mumbai, India Teamware Solutions Full timeJob Description Key Responsibilities: - Design, architect, and implement end-to-end big data solutions using MapR, Apache Hadoop, and associated ecosystem tools (e.g., Hive, HBase, Spark, Kafka). - Lead data platform modernization efforts including architecture reviews, platform upgrades, and migrations. - Collaborate with data engineers, data scientists,...
