Senior Hadoop Engineer

4 weeks ago


Pune, Maharashtra, India HuQuo Consulting Pvt. Ltd. Full time

Job Description :


- 5-8 years of total experience of solid data engineering experience, especially in Open Source, data-intensive, distributed environments with minimum 5 years of experience in big data related technologies like Spark, Hive, HBase, Hadoop, etc.

Programming background :

- Mandatory- Scala, Spark and Java / Python

- Experience in following technologies - MapReduce, HDFS, YARN, Spark Streaming.

- Experience in creating e2e pipelines in Hadoop.

- Experience in SQL, Hive and NoSQL databases

- Experience in Linux / Unix platform

- Experience of cloud design patterns

- Experience in Jenkins, GitHub, Debugging the code, and error handling.

- Experience in Building end to end ETL Pipelines

- Self-starter & resourceful personality with the ability to manage pressure situations.

- Experience working with geographically distributed teams.

- Work on high- level business and technical problems, contribute to architectural decisions.

- Create the core framework/templates that gives a starting point for the team members to get started with implementation/ execution.

Role & Responsibilities:

- Build Data and ETL pipelines in Hadoop.

- Support migration of data to the cloud using Big Data Technologies like Spark, Hive, Hadoop, Scala, Python

- Interact with customers daily to ensure smooth engagement.

- Exposure to GCP

- Responsible for timely and quality deliveries.

- Exposure to Scrum and Agile Development best practices

(ref:hirist.tech)

  • Pune, Maharashtra, India HuQuo Consulting Pvt. Ltd. Full time

    Job Description : 5-8 years of total experience of solid data engineering experience, especially in Open Source, data-intensive, distributed environments with minimum 5 years of experience in big data related technologies like Spark, Hive, HBase, Hadoop, etc.Programming background : Mandatory Scala, Spark and Java / Python Experience in following...


  • Pune, Maharashtra, India QAAgility Technologies Full time

    Job Title : Senior Data and Analytics EngineerWork Experience : 3-5 yearsJob Location : PunePosition Overview : We are looking for an experienced Senior Data and Analytics Engineer who will be responsible for designing, developing, and maintaining our data infrastructure and analytics solutions. The ideal candidate will have strong expertise in Hadoop,...


  • Pune, Maharashtra, India QAAgility Technologies Full time

    Job Title : Senior Data and Analytics EngineerWork Experience : 3-5 yearsJob Location : PunePosition Overview : We are looking for an experienced Senior Data and Analytics Engineer who will be responsible for designing, developing, and maintaining our data infrastructure and analytics solutions. The ideal candidate will have strong expertise in Hadoop,...

  • Hadoop Developer

    2 weeks ago


    Pune, Maharashtra, India EXL Full time

    We are seeking a skilled Hadoop Developer - Data Engineer to contribute to the design, development, and maintenance of our extensive data infrastructure.The ideal candidate should possess a solid background in the Hadoop ecosystem, be well-versed in diverse data integration and processing tools, and have hands-on experience with Java Spring Boot...

  • Senior Hadoop Engineer

    2 months ago


    Pune, Maharashtra, India HuQuo Consulting Pvt. Ltd. Full time

    Job Description :- 5-8 years of total experience of solid data engineering experience, especially in Open Source, data-intensive, distributed environments with minimum 5 years of experience in big data related technologies like Spark, Hive, HBase, Hadoop, etc. Programming background : - Mandatory- Scala, Spark and Java / Python - Experience in following...

  • Hadoop Developer

    2 weeks ago


    Pune, Maharashtra, India EXL Full time

    Position: Hadoop DeveloperLocation: Pune/Hyderabad/Gurgaon/Bangalore (Hybrid)Experience: 5+ yearsWe are in search of a skilled Hadoop Developer - Data Engineer to architect, build, and manage our large data environment. The perfect candidate should have a solid foundation in the Hadoop ecosystem, be adept in different data integration and processing tools,...

  • Hadoop Developer

    2 weeks ago


    Pune, Maharashtra, India Nityo Infotech Full time

    Should have Hands on Experience of Development on Cloudera Platform. Developing Unix Shell scripts Good understating of Hadoop Technologies such as Pig, Hive, HBase, HDFS, Spark,be able to analyze the issues on Hadoop Systems. Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMRManaging...

  • Hadoop Administrator

    2 weeks ago


    Pune, Maharashtra, India FIS Global Full time

    Position Type:Full timeType Of Hire:Experienced (relevant combo of work and education)Education Desired:Bachelor's DegreeTravel Percentage:0%Hadoop Administrator - Bangalore/ Pune/Chennai/Gurgaon- 6-12YearsAre you curious, motivated, and forward-thinking? At FIS you'll have the opportunity to work on some of the most challenging and relevant issues in...

  • Hadoop Developer

    2 weeks ago


    Pune, Maharashtra, India Synechron Full time

    Have a Good-day... We have immediate opportunity for Hadoop Data Engineer – 4 to 8 years Job Role: Hadoop Data Engineer Job Location: Pune Experience- 4 – 8 years Notice Period : 0 – 15 days About Company: At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and...

  • Hadoop Developer

    2 weeks ago


    Pune, Maharashtra, India Synechron Full time

    Have a Good-day...We have immediate opportunity forHadoop Data Engineer– 4 to 8 yearsJob Role:Hadoop Data EngineerJob Location: PuneExperience-4 – 8 yearsNotice Period : 0 – 15 daysAbout Company:At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative...

  • Hadoop Administrator

    2 weeks ago


    Pune, Maharashtra, India FIS Global Full time

    Position Type:Full timeType Of Hire:Experienced (relevant combo of work and education)Education Desired:Bachelor's DegreeTravel Percentage:0%Hadoop Administrator - Bangalore/ Pune/Chennai/Gurgaon- 6-12YearsAre you curious, motivated, and forward-thinking? At FIS you'll have the opportunity to work on some of the most challenging and relevant issues in...

  • Hadoop Administrator

    2 weeks ago


    Pune, Maharashtra, India Jobs for Humanity Full time

    Company DescriptionJobs for Humanity is collaborating with FIS Global to build an inclusive and just employment ecosystem. We support individuals coming from all walks of life.Company Name: FIS GlobalJob Description Position Type**:Full timeType Of Hire:Experienced (relevant combo of work and education)Education Desired:Bachelor's DegreeTravel...


  • Pune, Maharashtra, India F337 Deutsche India Private Limited, Pune Branch Full time

    Description Engineer is responsible for managing or performing work across multiple areas of the bank's overall IT Platform/Infrastructure including analysis, development, and administration. It may also involve taking functional oversight of engineering delivery for specific departments.Work includes: Planning and developing entire engineering...


  • Pune, Maharashtra, India Dassault Systèmes Full time

    Imagine new horizons...Dassault Systèmes SE (French pronunciation:[daso sistem]) (abbreviated 3DS) is a French software corporation. It is among Fortune 50 list of the largest software companies that develops software for 3D product design, simulation, manufacturing and more. A Dassault Group subsidiary spun off from Dassault Aviation in 1981, it is...


  • Pune, Maharashtra, India QAAgility Technologies Full time

    Job Title : Senior Data and Analytics EngineerWork Experience : 3-5 yearsJob Location : PunePosition Overview :We are looking for an experienced Senior Data and Analytics Engineer who will be responsible for designing, developing, and maintaining our data infrastructure and analytics solutions. The ideal candidate will have strong expertise in Hadoop, Scala,...

  • GCP Hadoop Developer

    2 weeks ago


    Pune, Maharashtra, India Atos Full time

    Eviden, part of the Atos Group, with an annual revenue of circa € 5 billion is a global leader in data-driven, trusted and sustainable digital transformation. As a next generation digital business with worldwide leading positions in digital, cloud, data, advanced computing and security, it brings deep expertise for all industries in more than 47 countries....

  • Senior Data Engineer

    2 weeks ago


    Pune, Maharashtra, India Nilasu consulting Full time

    Summary : We are seeking a highly skilled and experienced Senior Data Engineer to join our team. You will play a key role in designing, developing, and maintaining largescale data processing pipelines using Python and Spark/PySpark. Your expertise in distributed computing frameworks and DevOps tools will be instrumental in building efficient and scalable...


  • Pune, Maharashtra, India TeacherOn Full time

    I want to learn about basics of data engineering workflow including ,Kafka, Hadoop, pyspark , from non technical background but need it as I have switched to Business Intelligence role.Level: BeginnerGender Preference: NoneMeeting options:Available online - via skype etc.

  • Senior Data Engineer

    2 weeks ago


    Pune, Maharashtra, India Cyber Sphere LLC Full time

    Join Our Team as a Senior Data Engineer!We are currently offering a Full-Time Employment opportunity for a Senior Data Engineer to join us in Pun, India (Onsite 100%).Job Description:Design and develop data-ingestion frameworks, real-time processing solutions, and data processing and transformation frameworks.Deploy and provide support for application codes...

  • Senior Data Engineer

    2 weeks ago


    Pune, Maharashtra, India PURVIEW Full time

    Role: Senior Data EngineerLocation: Pune/Hyderabad (Onsite)Job Type: Long Term Contract (Permanent with Purview Services)Experience: 5+ years Jon Description: Must have:Scala development and design using Scala 2.10+ or PythonHadoop, Spark/Pyspark, Hive, YARNData Modelling: A good data engineer should be able to design, implement and maintain data models that...