Senior Hadoop Engineer

4 months ago


Pune, India HuQuo Consulting Pvt. Ltd. Full time

Job Description :


- 5-8 years of total experience of solid data engineering experience, especially in Open Source, data-intensive, distributed environments with minimum 5 years of experience in big data related technologies like Spark, Hive, HBase, Hadoop, etc.

Programming background :

- Mandatory- Scala, Spark and Java / Python

- Experience in following technologies - MapReduce, HDFS, YARN, Spark Streaming.

- Experience in creating e2e pipelines in Hadoop.

- Experience in SQL, Hive and NoSQL databases

- Experience in Linux / Unix platform

- Experience of cloud design patterns

- Experience in Jenkins, GitHub, Debugging the code, and error handling.

- Experience in Building end to end ETL Pipelines

- Self-starter & resourceful personality with the ability to manage pressure situations.

- Experience working with geographically distributed teams.

- Work on high- level business and technical problems, contribute to architectural decisions.

- Create the core framework/templates that gives a starting point for the team members to get started with implementation/ execution.

Role & Responsibilities:

- Build Data and ETL pipelines in Hadoop.

- Support migration of data to the cloud using Big Data Technologies like Spark, Hive, Hadoop, Scala, Python

- Interact with customers daily to ensure smooth engagement.

- Exposure to GCP

- Responsible for timely and quality deliveries.

- Exposure to Scrum and Agile Development best practices

(ref:hirist.tech)
  • Senior Hadoop Admin

    3 weeks ago


    Pune, India Circana Full time

    Senior Hadoop Admin Let’s be unstoppable together! Circana (formerly IRI and NPD) is the leading advisor on the complexity of consumer behavior. Through unparalleled technology, advanced analytics, cross-industry data, and deep expertise, we provide clarity that helps almost 7,000 of the world’s leading brands and retailers take action and unlock...

  • Data Engineer

    4 weeks ago


    Pune, India TETRAHED INC Full time

    Role : Data EngineerJob Description :We are looking for a highly skilled and experienced Senior Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering, with specific expertise in Oracle to BigQuery data warehouse migration and modernization. This role requires proficiency in various data engineering...


  • pune, India Bounteous India Full time

    Job Title : Hadoop Data AdministratorExperience : 5 to 10 YearsWork Location : Pune (Work from office all 5 days)NoteThis job needs resources to work for all 5 days from office in Pune. Please apply only if you are local to Pune and ready to work from Pune Hinjewadi office all 5 days. Need only immediate joiners.Key Responsibilities:Provide L2/L3 support for...


  • Pune, India Bounteous India Full time

    Job Title : Hadoop Data AdministratorExperience : 5 to 10 Years Work Location : Pune (Work from office all 5 days) NoteThis job needs resources to work for all 5 days from office in Pune. Please apply only if you are local to Pune and ready to work from Pune Hinjewadi office all 5 days. Need only immediate joiners. Key Responsibilities:Provide L2/L3 support...


  • Pune, India Bounteous India Full time

    Job Title : Hadoop Data Administrator Experience : 5 to 10 Years Work Location : Pune (Work from office all 5 days) Note This job needs resources to work for all 5 days from office in Pune. Please apply only if you are local to Pune and ready to work from Pune Hinjewadi office all 5 days. Need only immediate joiners. Key Responsibilities: Provide...


  • Pune H.O, India Bounteous India Full time

    Job Title : Hadoop Data AdministratorExperience : 5 to 10 Years Work Location : Pune (Work from office all 5 days) NoteThis job needs resources to work for all 5 days from office in Pune. Please apply only if you are local to Pune and ready to work from Pune Hinjewadi office all 5 days. Need only immediate joiners. Key Responsibilities:Provide L2/L3 support...


  • Pune, India ClearTrail Technologies Full time

    Job Title: Lead -Hadoop Technical SupportRole Big Data Infrastructure Implementation and SupportExperience: 8 to 12 years of experience in Big Data, Apache Hadoop System Implementation, and administration.Education: BE (IT/Computers), B.Tech, M.Tech, MCAWork Location: Riyadh, Saudi ArabiaCertifications: Apache Hadoop administration [Big Data Hadoop...

  • Big Data Engineer

    2 weeks ago


    Pune, India Mig Staffing Full time

    We are looking to hire a talented big data engineer to develop and manage our company's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate with development teams, build cloud platforms, and maintain the production system.To ensure success as a big data...

  • Hadoop Administrator

    4 months ago


    Pune, Maharashtra, India FIS Global Full time

    **Position Type**: Full time **Type Of Hire**: Experienced (relevant combo of work and education) **Education Desired**: Bachelor's Degree **Travel Percentage**: 0% **Hadoop Administrator -** **Bangalore/** **Pune/Chennai/Gurgaon-** 6**-1**2**Years** Are you curious, motivated, and forward-thinking? At FIS you’ll have the opportunity to work on some of...

  • Hadoop Administrator

    3 months ago


    Pune, Maharashtra, India Jobs for Humanity Full time

    **Company Description** Jobs for Humanity is collaborating with FIS Global to build an inclusive and just employment ecosystem. We support individuals coming from all walks of life. Company Name: FIS Global **Job Description** Position Type**: Full time **Type Of Hire**: Experienced (relevant combo of work and education) **Education Desired**: Bachelor's...

  • Hadoop Administrator

    4 months ago


    Pune, Maharashtra, India FIS Global Full time

    **Position Type**: Full time **Type Of Hire**: Experienced (relevant combo of work and education) **Education Desired**: Bachelor's Degree **Travel Percentage**: 0% **Hadoop Administrator -** **Bangalore/** **Pune/Chennai/Gurgaon-** 6**-1**2**Years** Are you curious, motivated, and forward-thinking? At FIS you’ll have the opportunity to work on some of...


  • Pune, India F337 Deutsche India Private Limited, Pune Branch Full time

    Description Engineer is responsible for managing or performing work across multiple areas of the bank's overall IT Platform/Infrastructure including analysis, development, and administration. It may also involve taking functional oversight of engineering delivery for specific departments. Work includes: Planning and developing entire engineering...

  • Big Data Engineer

    2 weeks ago


    Pune, India Mig Staffing Full time

    Job Description : We are looking to hire a talented big data engineer to develop and manage our company's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate with development teams, build cloud platforms, and maintain the production :- Meeting with managers...


  • Pune, India InCommon Full time

    Principle responsibilities : - Big Data Solutions : Design and implement scalable Big Data solutions using technologies such as Hadoop and Spark.- Data Pipeline Development : Develop and maintain robust data pipelines using Python and Java to process large volumes of data.- Data Integration : Integrate diverse data sources into Big Data platforms, ensuring...

  • Data Engineer

    4 months ago


    Pune, India F337 Deutsche India Private Limited, Pune Branch Full time

    Description – Senior Engineer is responsible for developing and delivering elements of engineering solutions to accomplish business goals. Awareness is expected of the important engineering principles of the Bank. Root cause analysis skills, developed through addressing enhancements and fixes to products. Build reliability and resiliency into...


  • pune, India Esya Full time

    Role Overview: The Senior Data Engineer will have deep hands-on experience in data engineering concepts and will work extensively with AWS and GCP. Years of Experience: 6+ Years Key Responsibilities: Design, develop, and maintain scalable data pipelines and ETL processes. Collaborate with data scientists and analysts to understand data...


  • pune, India Esya Full time

    Role Overview: The Senior Data Engineer will have deep hands-on experience in data engineering concepts and will work extensively with AWS and GCP.Years of Experience: 6+ YearsKey Responsibilities:Design, develop, and maintain scalable data pipelines and ETL processes.Collaborate with data scientists and analysts to understand data requirements.Optimize...


  • pune, India PubMatic Full time

    Title : Senior/Software Development Engineer in Test – Bigdata: Requirements: Should have 1-3 years of experience working as SDET and doing meaningful automation. Good programming skills. Python preferred. Hands on experience in automating backend applications (e.g., database, REST API's) Hands on experience with automating any backend applications (e.g.,...

  • Senior Data Engineer

    1 month ago


    Pune, India Redbox HR Consulting Full time

    Roles & Responsibilities :- Create and maintain optimal data pipeline architecture- Build data pipelines that transform raw, unstructured data into formats that data analyst can use to for analysis- Assemble large, complex data sets that meet functional / non-functional business requirements- Identify, design, and implement internal process improvements:...


  • pune, India PubMatic Full time

    Title : Senior/Software Development Engineer in Test – Bigdata:Requirements:Should have 1-3 years of experience working as SDET and doing meaningful automation.Good programming skills. Python preferred.Hands on experience in automating backend applications (e.g., database, REST API's)Hands on experience with automating any backend applications (e.g.,...