Big Data Engineer
2 weeks ago
Job Description :
Required Technical Skill Set : MS Azure Cloud Platform, Big Data with Hadoop, Python, Hive, Azure data and admin analysis
Must-Have Skills & Experience :
Hadoop Cluster Management :
- Hands-on experience in installation, configuration, support, and management of Hadoop clusters using Hortonworks Distribution.
- Expertise in cluster migration to Azure Cloud.
- Experience in cluster upgrades, along with configuring Kerberos and Ranger for security.
Cluster Operations :
- Knowledge of node commissioning and decommissioning in clusters, including data rebalancing.
- Experience in setting up High Availability (HA) for Hadoop clusters.
- Familiarity with DistCp configuration for data transfer between clusters.
Hadoop Ecosystem :
- Hands-on experience with core Hadoop components like HDFS, Yarn, MapReduce, HBase, Oozie, Hive, Sqoop, Pig, Kafka, and Ranger.
- Experience in configuring and managing Kafka services.
- Experience with backup and recovery of NameNode failure and recovery of Journal Nodes.
Administration & Troubleshooting :
- Proficient in log analysis for Hadoop and ecosystem services to identify and resolve issues.
- Experience in Standby Ambari Server installation and configuration of Hive View
-
Big Data Engineer
2 weeks ago
navi mumbai, India Pert Telecom Solutions Full timeJob Description : We are seeking a skilled Big Data Engineer with deep expertise in PySpark, Python, MySQL, Hadoop and Linux. The ideal candidate should have extensive experience deploying and managing these tools within on-premises environments (no public cloud). Proficiency in cluster management, performance optimization, and monitoring is essential for...
-
Data Warehouse Engineer
11 hours ago
Mumbai, India Data Warehouse Engineer Full timeExperience : 2- 5 YearsPrimary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills.Good to have skills: Power BI, Databricks, Python.
-
Big Data Engineer
2 weeks ago
Navi Mumbai, India Pert Telecom Solutions Full timeJob Description: We are seeking a skilled Big Data Engineer with deep expertise in PySpark, Python, MySQL, Hadoop and Linux. The ideal candidate should have extensive experience deploying and managing these tools within on-premises environments (no public cloud). Proficiency in cluster management, performance optimization, and monitoring is essential for...
-
Big Data Engineer
1 month ago
Mumbai, Maharashtra, India Snaphunt Full timeThe OpportunityWe are seeking an experienced Big Data Developer to join our team at Snaphunt. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining scalable data processing pipelines using Kafka, PySpark, Python/Scala, and Spark.The RoleDesign and implement robust data processing solutions using...
-
Senior Big Data Engineer
1 month ago
Mumbai, Maharashtra, India AEXONIC TECHNOLOGIES PRIVATE LIMITED Full timeJob Title: Senior Big Data EngineerAbout the Role:We are seeking a highly skilled Senior Big Data Engineer to join our team at AEXONIC TECHNOLOGIES PRIVATE LIMITED. The successful candidate will be responsible for designing, building, and maintaining robust data pipelines that support large-scale data processing and analytics.Key Responsibilities:- Design,...
-
Big Data Engineer
1 month ago
Chennai/Noida/Gurgaon/Gurugram/Mumbai, India ANRI Solutions HR Services Full timeJob Title: Big Data EngineerWe are seeking an experienced Big Data Engineer to join our team at ANRI Solutions HR Services.Key Responsibilities:Design and develop end-to-end data pipelines using Spark and Scala.Develop expertise in ETL and data warehousing concepts, including cloud integration.Work with minimal guidance and lead the team...
-
Big Data Engineer
1 month ago
Goa/Mumbai/Jammu & Kashmir/Jammu/Srinagar/Pondicherry/Jaipur/Lucknow/Varanasi/Banaras/Patna/Ranchi, India ATech Full timeJob Title: Big Data EngineerJob Summary:We are seeking a highly skilled Big Data Engineer to join our team at ATech. The successful candidate will be responsible for designing, building, and optimizing data models and ETL processes to support our clients' business requirements.Key Responsibilities:Design and develop scalable Big Data applications and...
-
Big Data Developer
3 weeks ago
Mumbai, Maharashtra, India Pegasus InfoCorp Full timeAbout the Role:Pegasus InfoCorp is seeking a highly skilled Big Data Developer to join our team.As a Big Data Developer, you will be responsible for building solutions for customers using Big Data technologies. You will work on designing, developing, and implementing Big Data solutions that meet our customers' needs. You will also be responsible for...
-
Big Data Engineer
4 weeks ago
Mumbai, Maharashtra, India Nibodhah Full timeJob SummaryNibodhah is seeking an experienced Big Data Engineer to develop and implement data pipelines that extract, transform, and load data into an information product that informs the organization in reaching strategic goals.Key ResponsibilitiesDevelop and maintain data pipelines implementing ETL processesBuild, operate, monitor, and troubleshoot Hadoop...
-
Big Data Engineer
4 weeks ago
Mumbai, Maharashtra, India Smartavya Analytica Private Limited Full timeKey Responsibilities:As a Data Processing Expert at Smartavya Analytica Private Limited, you will be responsible for developing, testing, and implementing Big Data projects using Hadoop, Spark, and Hive. Your expertise in setting up Hadoop services, implementing ETL/ELT pipelines, and working with Terabytes of data ingestion and processing from varied...
-
Big Data Expert
2 days ago
Mumbai, Maharashtra, India Smartavya Analytica Private Limited Full timeAbout UsSmartavya Analytica Private Limited is a leading company in the field of data analytics.Job SummaryWe are seeking an experienced Big Data Expert - Data Engineering to join our team. As a key member of our engineering team, you will be responsible for designing, implementing and maintaining large-scale data processing systems using Hadoop and...
-
Data Engineer for Big Data Infrastructure
2 days ago
Mumbai, Maharashtra, India Robosoft Technologies Full timeWe are seeking a highly skilled Data Engineer to join our team at Robosoft Technologies. This role will involve designing, developing, and maintaining large-scale data processing systems using Spark and Scala.Key ResponsibilitiesThe successful candidate will be responsible for:Designing and implementing scalable data processing pipelines using Spark and...
-
Senior Data Engineer
3 weeks ago
Mumbai, Maharashtra, India Nielsen Full timeAbout the RoleWe are seeking a highly skilled Senior Data Engineer to join our DevOps team at Nielsen. As a Senior Data Engineer, you will be responsible for analyzing, developing, testing, and supporting Big Data applications. Your primary objective will be to ensure project goals are achieved and are aligned with business objectives.ResponsibilitiesDesign,...
-
Senior Big Data Engineer
1 month ago
Mumbai/Pune/Kolkata/Delhi/Nagpur/Ahmedabad, India AEXONIC TECHNOLOGIES PRIVATE LIMITED Full timeJob Title: Senior Big Data EngineerAbout the Role:We are seeking a highly skilled Senior Big Data Engineer to join our team at AEXONIC TECHNOLOGIES PRIVATE LIMITED. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining robust data pipelines that support large-scale data processing and analytics using...
-
Big Data Engineer
4 weeks ago
Mumbai, Maharashtra, India Synechron Technologies Pvt. Ltd. Full timeAbout SynechronSynechron is a global consulting firm that specializes in digital transformation and innovation. Our team of experts combines creativity and technology to deliver industry-leading digital solutions.Job RoleThe Hadoop Developer will work on designing and developing big data solutions using Hive, Java, and Spark. The ideal candidate should have...
-
Big Data QA
4 weeks ago
Mumbai, India Brainhunter Recruiting Pvt Ltd Full timeJob Title: Big Data QA Engineer We are seeking a highly skilled and motivated Big Data QA Engineer with expertise in automation testing using Java or Python programming languages. The ideal candidate should possess a strong background in data validation, data verification, PySpark, pipeline monitoring, software...
-
Big Data Systems Engineer
3 weeks ago
Mumbai, Maharashtra, India CPP Investments Full timeTransforming Data into Business ValueCPP Investments is a global investment organization seeking a highly skilled Lead, Data Engineer to join our team. As a key member of our Data Engineering team, you will play a critical role in designing, building, and deploying large-scale data processing systems on AWS cloud.Key Responsibilities:Design solutions aligned...
-
Data Engineer
4 weeks ago
Mumbai, Maharashtra, India Nexthire Full timeJob Title: Data Engineer - Informatica and Big Data Management ExpertAbout the Role:We are seeking a skilled Data Engineer with experience in Informatica and Big Data Management. The ideal candidate will have a strong background in data extraction, transformation, and loading (ETL) processes, with a focus on optimizing data integration solutions for complex...
-
Big Data Engineer
1 month ago
Chennai/Hyderabad/Bangalore/Coimbatore/Mumbai/Delhi/Pune, India GAIUS HYPERLOCAL PRIVATE LIMITED Full timeJob Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at GAIUS HYPERLOCAL PRIVATE LIMITED. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining scalable and efficient big data solutions.Key Responsibilities:Design and develop scalable big data architectures and pipelines.Develop...
-
Data Engineer
6 days ago
Mumbai, Maharashtra, India Brainhunter Recruiting Pvt Ltd Full timeAt Brainhunter Recruiting Pvt Ltd, we are seeking a skilled Data Engineer to join our team in testing and validating large datasets.We offer a competitive salary of $120,000 per annum for this role. About the Role:The ideal candidate will possess expertise in automation testing using Java or Python programming languages and have a strong background in data...