Hadoop Engineer

Looking for Immediate joinersJob Summary:The Hadoop Engineer will be responsible for setting up, configuring, monitoring, and maintaining Hadoop clusters. The role involves ensuring optimal performance, data reliability and security within distributed data environments.Key Responsibilities:Design, deploy and manage Hadoop clusters (HDFS, YARN, Hive, HBase, Spark, Zookeeper, etc.).Perform installation, configuration, patching and version upgrades for Hadoop ecosystem components.Monitor cluster health, resource usage and data node performance.Implement and manage data ingestion pipelines using Sqoop, Flume or Kafka.Troubleshoot and resolve issues related to cluster performance, data los, or node failures.Implement security, authentication and authorization.Manage HDFS storage, replication and balancing.Perform backup and recovery activities for Hadoop components.Support integration with external systems (e.g., PostgreSQL, MySQL or data lake platforms).Participate in 24×7 operations with on-call rotation for production environments.Technical Skills Required:Strong hands-on experience in Hadoop ecosystem components:HDFS, YARN, MapReduce, Hive, HBase, Spark, Zookeeper.Proficiency in Linux administration and scripting.Experience in cluster performance tuning and troubleshooting.Familiarity with Cloudera, Hortonworks, or Apache distributions.Knowledge of data ingestion and ETL tools (Kafka, Flume, NiFi, Sqoop).Understanding of data governance and security frameworks (Kerberos, Ranger).Experience with monitoring tools such as Ambari, Grafana, Prometheus or Nagios.Knowledge of cloud-based Hadoop services (AWS EMR, Azure HDInsight, GCP Dataproc) is a plus.Please share your cvs at medhyas@sutantrasystems.com