Hadoop Engineer
2 weeks ago
Looking for Immediate joiners Job Summary: The Hadoop Engineer will be responsible for setting up, configuring, monitoring, and maintaining Hadoop clusters. The role involves ensuring optimal performance, data reliability and security within distributed data environments. Key Responsibilities: Design, deploy and manage Hadoop clusters (HDFS, YARN, Hive, HBase, Spark, Zookeeper, etc.). Perform installation, configuration, patching and version upgrades for Hadoop ecosystem components. Monitor cluster health, resource usage and data node performance. Implement and manage data ingestion pipelines using Sqoop, Flume or Kafka. Troubleshoot and resolve issues related to cluster performance, data los, or node failures. Implement security, authentication and authorization. Manage HDFS storage, replication and balancing. Perform backup and recovery activities for Hadoop components. Support integration with external systems (e.G., PostgreSQL, MySQL or data lake platforms). Participate in 24×7 operations with on-call rotation for production environments. Technical Skills Required: Strong hands-on experience in Hadoop ecosystem components: HDFS, YARN, MapReduce, Hive, HBase, Spark, Zookeeper. Proficiency in Linux administration and scripting. Experience in cluster performance tuning and troubleshooting. Familiarity with Cloudera, Hortonworks, or Apache distributions. Knowledge of data ingestion and ETL tools (Kafka, Flume, NiFi, Sqoop). Understanding of data governance and security frameworks (Kerberos, Ranger). Experience with monitoring tools such as Ambari, Grafana, Prometheus or Nagios. Knowledge of cloud-based Hadoop services (AWS EMR, Azure HDInsight, GCP Dataproc) is a plus. Please share your cvs at
-
AWS Data Engineer
1 week ago
alwar, India Tata Consultancy Services Full timeTCS is Hiring AWS Data Engineer Bangalore locationExperience : 6 - 10 yearsMode of interview: VirtualLocation : BangaloreJOB DESCRIPTION:Must have:Strong hands-on experience in Python programming and PySparkExperience using AWS services (RedShift, Glue, EMR, S3 & Lambda)Experience working with Apache Spark and Hadoop ecosystem.Experience in writing and...
-
Data Science Specialist
2 weeks ago
Alwar, India Polestar Analytics Full timeJob Locations: Noida/Bangalore/KolkataYour Role and Responsibilities3+ years of experience in a Data Science, machine learning or a related field.Strong hands-on experience in Machine Learning and Statistics focusing on structured and unstructured data problems.Practical experience in several of the following areas: time series forecasting, clustering and...