Hadoop Engineer

2 weeks ago


Alwar, India Whatjobs IN C2 Full time

Looking for Immediate joiners Job Summary: The Hadoop Engineer will be responsible for setting up, configuring, monitoring, and maintaining Hadoop clusters. The role involves ensuring optimal performance, data reliability and security within distributed data environments. Key Responsibilities: Design, deploy and manage Hadoop clusters (HDFS, YARN, Hive, HBase, Spark, Zookeeper, etc.). Perform installation, configuration, patching and version upgrades for Hadoop ecosystem components. Monitor cluster health, resource usage and data node performance. Implement and manage data ingestion pipelines using Sqoop, Flume or Kafka. Troubleshoot and resolve issues related to cluster performance, data los, or node failures. Implement security, authentication and authorization. Manage HDFS storage, replication and balancing. Perform backup and recovery activities for Hadoop components. Support integration with external systems (e.G., PostgreSQL, MySQL or data lake platforms). Participate in 24×7 operations with on-call rotation for production environments. Technical Skills Required: Strong hands-on experience in Hadoop ecosystem components: HDFS, YARN, MapReduce, Hive, HBase, Spark, Zookeeper. Proficiency in Linux administration and scripting. Experience in cluster performance tuning and troubleshooting. Familiarity with Cloudera, Hortonworks, or Apache distributions. Knowledge of data ingestion and ETL tools (Kafka, Flume, NiFi, Sqoop). Understanding of data governance and security frameworks (Kerberos, Ranger). Experience with monitoring tools such as Ambari, Grafana, Prometheus or Nagios. Knowledge of cloud-based Hadoop services (AWS EMR, Azure HDInsight, GCP Dataproc) is a plus. Please share your cvs at


  • AWS Data Engineer

    1 week ago


    alwar, India Tata Consultancy Services Full time

    TCS is Hiring AWS Data Engineer Bangalore locationExperience : 6 - 10 yearsMode of interview: VirtualLocation : BangaloreJOB DESCRIPTION:Must have:Strong hands-on experience in Python programming and PySparkExperience using AWS services (RedShift, Glue, EMR, S3 & Lambda)Experience working with Apache Spark and Hadoop ecosystem.Experience in writing and...


  • Alwar, India Polestar Analytics Full time

    Job Locations: Noida/Bangalore/KolkataYour Role and Responsibilities3+ years of experience in a Data Science, machine learning or a related field.Strong hands-on experience in Machine Learning and Statistics focusing on structured and unstructured data problems.Practical experience in several of the following areas: time series forecasting, clustering and...