Big Data Engineer

2 weeks ago


Mumbai, India SPG CONSULTING AND SOLUTIONS SERVICES PVT LTD Full time

Job Description :


Required Technical Skill Set : MS Azure Cloud Platform, Big Data with Hadoop, Python, Hive, Azure data and admin analysis

Must-Have Skills & Experience :

Hadoop Cluster Management :

- Hands-on experience in installation, configuration, support, and management of Hadoop clusters using Hortonworks Distribution.

- Expertise in cluster migration to Azure Cloud.

- Experience in cluster upgrades, along with configuring Kerberos and Ranger for security.

Cluster Operations :


- Knowledge of node commissioning and decommissioning in clusters, including data rebalancing.


- Experience in setting up High Availability (HA) for Hadoop clusters.

- Familiarity with DistCp configuration for data transfer between clusters.

Hadoop Ecosystem :


- Hands-on experience with core Hadoop components like HDFS, Yarn, MapReduce, HBase, Oozie, Hive, Sqoop, Pig, Kafka, and Ranger.

- Experience in configuring and managing Kafka services.

- Experience with backup and recovery of NameNode failure and recovery of Journal Nodes.

Administration & Troubleshooting :


- Proficient in log analysis for Hadoop and ecosystem services to identify and resolve issues.

- Experience in Standby Ambari Server installation and configuration of Hive View

(ref:hirist.tech)
  • Big Data Engineer

    2 weeks ago


    navi mumbai, India Pert Telecom Solutions Full time

    Job Description : We are seeking a skilled Big Data Engineer with deep expertise in PySpark, Python, MySQL, Hadoop and Linux. The ideal candidate should have extensive experience deploying and managing these tools within on-premises environments (no public cloud). Proficiency in cluster management, performance optimization, and monitoring is essential for...


  • Mumbai, India Data Warehouse Engineer Full time

    Experience : 2- 5 YearsPrimary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills.Good to have skills: Power BI, Databricks, Python.

  • Big Data Engineer

    2 weeks ago


    Navi Mumbai, India Pert Telecom Solutions Full time

    Job Description: We are seeking a skilled Big Data Engineer with deep expertise in PySpark, Python, MySQL, Hadoop and Linux. The ideal candidate should have extensive experience deploying and managing these tools within on-premises environments (no public cloud). Proficiency in cluster management, performance optimization, and monitoring is essential for...

  • Big Data Engineer

    1 month ago


    Mumbai, Maharashtra, India Snaphunt Full time

    The OpportunityWe are seeking an experienced Big Data Developer to join our team at Snaphunt. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining scalable data processing pipelines using Kafka, PySpark, Python/Scala, and Spark.The RoleDesign and implement robust data processing solutions using...


  • Mumbai, Maharashtra, India AEXONIC TECHNOLOGIES PRIVATE LIMITED Full time

    Job Title: Senior Big Data EngineerAbout the Role:We are seeking a highly skilled Senior Big Data Engineer to join our team at AEXONIC TECHNOLOGIES PRIVATE LIMITED. The successful candidate will be responsible for designing, building, and maintaining robust data pipelines that support large-scale data processing and analytics.Key Responsibilities:- Design,...

  • Big Data Engineer

    1 month ago


    Chennai/Noida/Gurgaon/Gurugram/Mumbai, India ANRI Solutions HR Services Full time

    Job Title: Big Data EngineerWe are seeking an experienced Big Data Engineer to join our team at ANRI Solutions HR Services.Key Responsibilities:Design and develop end-to-end data pipelines using Spark and Scala.Develop expertise in ETL and data warehousing concepts, including cloud integration.Work with minimal guidance and lead the team...

  • Big Data Engineer

    1 month ago


    Goa/Mumbai/Jammu & Kashmir/Jammu/Srinagar/Pondicherry/Jaipur/Lucknow/Varanasi/Banaras/Patna/Ranchi, India ATech Full time

    Job Title: Big Data EngineerJob Summary:We are seeking a highly skilled Big Data Engineer to join our team at ATech. The successful candidate will be responsible for designing, building, and optimizing data models and ETL processes to support our clients' business requirements.Key Responsibilities:Design and develop scalable Big Data applications and...

  • Big Data Developer

    3 weeks ago


    Mumbai, Maharashtra, India Pegasus InfoCorp Full time

    About the Role:Pegasus InfoCorp is seeking a highly skilled Big Data Developer to join our team.As a Big Data Developer, you will be responsible for building solutions for customers using Big Data technologies. You will work on designing, developing, and implementing Big Data solutions that meet our customers' needs. You will also be responsible for...

  • Big Data Engineer

    4 weeks ago


    Mumbai, Maharashtra, India Nibodhah Full time

    Job SummaryNibodhah is seeking an experienced Big Data Engineer to develop and implement data pipelines that extract, transform, and load data into an information product that informs the organization in reaching strategic goals.Key ResponsibilitiesDevelop and maintain data pipelines implementing ETL processesBuild, operate, monitor, and troubleshoot Hadoop...

  • Big Data Engineer

    4 weeks ago


    Mumbai, Maharashtra, India Smartavya Analytica Private Limited Full time

    Key Responsibilities:As a Data Processing Expert at Smartavya Analytica Private Limited, you will be responsible for developing, testing, and implementing Big Data projects using Hadoop, Spark, and Hive. Your expertise in setting up Hadoop services, implementing ETL/ELT pipelines, and working with Terabytes of data ingestion and processing from varied...

  • Big Data Expert

    2 days ago


    Mumbai, Maharashtra, India Smartavya Analytica Private Limited Full time

    About UsSmartavya Analytica Private Limited is a leading company in the field of data analytics.Job SummaryWe are seeking an experienced Big Data Expert - Data Engineering to join our team. As a key member of our engineering team, you will be responsible for designing, implementing and maintaining large-scale data processing systems using Hadoop and...


  • Mumbai, Maharashtra, India Robosoft Technologies Full time

    We are seeking a highly skilled Data Engineer to join our team at Robosoft Technologies. This role will involve designing, developing, and maintaining large-scale data processing systems using Spark and Scala.Key ResponsibilitiesThe successful candidate will be responsible for:Designing and implementing scalable data processing pipelines using Spark and...

  • Senior Data Engineer

    3 weeks ago


    Mumbai, Maharashtra, India Nielsen Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our DevOps team at Nielsen. As a Senior Data Engineer, you will be responsible for analyzing, developing, testing, and supporting Big Data applications. Your primary objective will be to ensure project goals are achieved and are aligned with business objectives.ResponsibilitiesDesign,...


  • Mumbai/Pune/Kolkata/Delhi/Nagpur/Ahmedabad, India AEXONIC TECHNOLOGIES PRIVATE LIMITED Full time

    Job Title: Senior Big Data EngineerAbout the Role:We are seeking a highly skilled Senior Big Data Engineer to join our team at AEXONIC TECHNOLOGIES PRIVATE LIMITED. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining robust data pipelines that support large-scale data processing and analytics using...

  • Big Data Engineer

    4 weeks ago


    Mumbai, Maharashtra, India Synechron Technologies Pvt. Ltd. Full time

    About SynechronSynechron is a global consulting firm that specializes in digital transformation and innovation. Our team of experts combines creativity and technology to deliver industry-leading digital solutions.Job RoleThe Hadoop Developer will work on designing and developing big data solutions using Hive, Java, and Spark. The ideal candidate should have...

  • Big Data QA

    4 weeks ago


    Mumbai, India Brainhunter Recruiting Pvt Ltd Full time

    Job Title: Big Data QA Engineer We are seeking a highly skilled and motivated Big Data QA Engineer with expertise in automation testing using Java or Python programming languages. The ideal candidate should possess a strong background in data validation, data verification, PySpark, pipeline monitoring, software...


  • Mumbai, Maharashtra, India CPP Investments Full time

    Transforming Data into Business ValueCPP Investments is a global investment organization seeking a highly skilled Lead, Data Engineer to join our team. As a key member of our Data Engineering team, you will play a critical role in designing, building, and deploying large-scale data processing systems on AWS cloud.Key Responsibilities:Design solutions aligned...

  • Data Engineer

    4 weeks ago


    Mumbai, Maharashtra, India Nexthire Full time

    Job Title: Data Engineer - Informatica and Big Data Management ExpertAbout the Role:We are seeking a skilled Data Engineer with experience in Informatica and Big Data Management. The ideal candidate will have a strong background in data extraction, transformation, and loading (ETL) processes, with a focus on optimizing data integration solutions for complex...

  • Big Data Engineer

    1 month ago


    Chennai/Hyderabad/Bangalore/Coimbatore/Mumbai/Delhi/Pune, India GAIUS HYPERLOCAL PRIVATE LIMITED Full time

    Job Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at GAIUS HYPERLOCAL PRIVATE LIMITED. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining scalable and efficient big data solutions.Key Responsibilities:Design and develop scalable big data architectures and pipelines.Develop...

  • Data Engineer

    6 days ago


    Mumbai, Maharashtra, India Brainhunter Recruiting Pvt Ltd Full time

    At Brainhunter Recruiting Pvt Ltd, we are seeking a skilled Data Engineer to join our team in testing and validating large datasets.We offer a competitive salary of $120,000 per annum for this role. About the Role:The ideal candidate will possess expertise in automation testing using Java or Python programming languages and have a strong background in data...