Senior Hadoop Engineer

1 month ago


Pune, India HuQuo Consulting Pvt. Ltd. Full time

Job Description :


- 5-8 years of total experience of solid data engineering experience, especially in Open Source, data-intensive, distributed environments with minimum 5 years of experience in big data related technologies like Spark, Hive, HBase, Hadoop, etc.

Programming background :

- Mandatory- Scala, Spark and Java / Python

- Experience in following technologies - MapReduce, HDFS, YARN, Spark Streaming.

- Experience in creating e2e pipelines in Hadoop.

- Experience in SQL, Hive and NoSQL databases

- Experience in Linux / Unix platform

- Experience of cloud design patterns

- Experience in Jenkins, GitHub, Debugging the code, and error handling.

- Experience in Building end to end ETL Pipelines

- Self-starter & resourceful personality with the ability to manage pressure situations.

- Experience working with geographically distributed teams.

- Work on high- level business and technical problems, contribute to architectural decisions.

- Create the core framework/templates that gives a starting point for the team members to get started with implementation/ execution.

Role & Responsibilities:

- Build Data and ETL pipelines in Hadoop.

- Support migration of data to the cloud using Big Data Technologies like Spark, Hive, Hadoop, Scala, Python

- Interact with customers daily to ensure smooth engagement.

- Exposure to GCP

- Responsible for timely and quality deliveries.

- Exposure to Scrum and Agile Development best practices

(ref:hirist.tech)

  • Pune, India QAAgility Technologies Full time

    Job Title : Senior Data and Analytics EngineerWork Experience : 3-5 yearsJob Location : PunePosition Overview : We are looking for an experienced Senior Data and Analytics Engineer who will be responsible for designing, developing, and maintaining our data infrastructure and analytics solutions. The ideal candidate will have strong expertise in Hadoop,...


  • pune, India QAAgility Technologies Full time

    Job Title : Senior Data and Analytics EngineerWork Experience : 3-5 yearsJob Location : PunePosition Overview : We are looking for an experienced Senior Data and Analytics Engineer who will be responsible for designing, developing, and maintaining our data infrastructure and analytics solutions. The ideal candidate will have strong expertise in Hadoop,...


  • Pune, India QAAgility Technologies Full time

    Job Title : Senior Data and Analytics EngineerWork Experience : 3-5 yearsJob Location : PunePosition Overview : We are looking for an experienced Senior Data and Analytics Engineer who will be responsible for designing, developing, and maintaining our data infrastructure and analytics solutions. The ideal candidate will have strong expertise in Hadoop,...


  • Pune, Maharashtra, India QAAgility Technologies Full time

    Job Title : Senior Data and Analytics EngineerWork Experience : 3-5 yearsJob Location : PunePosition Overview : We are looking for an experienced Senior Data and Analytics Engineer who will be responsible for designing, developing, and maintaining our data infrastructure and analytics solutions. The ideal candidate will have strong expertise in Hadoop,...


  • pune, India HuQuo Consulting Pvt. Ltd. Full time

    Responsibilities :- Meeting with the development team to assess the company's big data infrastructure.- Designing and coding hadoop applications to analyze data collections.- Creating data processing frameworks.- Extracting data and isolating data clusters.- Testing scripts and analyzing results.- Troubleshooting application bugs.- Maintaining the security...


  • Pune, India HuQuo Consulting Pvt. Ltd. Full time

    Job Description :- 5-8 years of total experience of solid data engineering experience, especially in Open Source, data-intensive, distributed environments with minimum 5 years of experience in big data related technologies like Spark, Hive, HBase, Hadoop, etc. Programming background : - Mandatory- Scala, Spark and Java / Python - Experience in following...


  • Pune, Maharashtra, India HuQuo Consulting Pvt. Ltd. Full time

    Job Description :- 5-8 years of total experience of solid data engineering experience, especially in Open Source, data-intensive, distributed environments with minimum 5 years of experience in big data related technologies like Spark, Hive, HBase, Hadoop, etc. Programming background : - Mandatory- Scala, Spark and Java / Python - Experience in following...


  • Gurgaon/Gurugram/Pune, India HuQuo Consulting Pvt. Ltd. Full time

    Responsibilities :- Meeting with the development team to assess the company's big data infrastructure.- Designing and coding hadoop applications to analyze data collections.- Creating data processing frameworks.- Extracting data and isolating data clusters.- Testing scripts and analyzing results.- Troubleshooting application bugs.- Maintaining the...

  • Hadoop Developer

    3 weeks ago


    Pune, India Nityo Infotech Full time

    Should have Hands on Experience of Development on Cloudera Platform.• Developing Unix Shell scripts• Good understating of Hadoop Technologies such as Pig, Hive, HBase, HDFS, Spark,be able to analyze the issues on Hadoop Systems.• Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS...

  • Hadoop Developer

    1 month ago


    Pune, India Nityo Infotech Full time

    Should have Hands on Experience of Development on Cloudera Platform.• Developing Unix Shell scripts• Good understating of Hadoop Technologies such as Pig, Hive, HBase, HDFS, Spark, be able to analyze the issues on Hadoop Systems.• Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS...

  • Hadoop Developer

    1 month ago


    pune, India Nityo Infotech Full time

    Should have Hands on Experience of Development on Cloudera Platform.• Developing Unix Shell scripts• Good understating of Hadoop Technologies such as Pig, Hive, HBase, HDFS, Spark, be able to analyze the issues on Hadoop Systems.• Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS...


  • Pune, India F337 Deutsche India Private Limited, Pune Branch Full time

    DescriptionEngineer is responsible for managing or performing work across multiple areas of the bank's overall IT Platform/Infrastructure including analysis, development, and administration. It may also involve taking functional oversight of engineering delivery for specific departments.Work includes:Planning and developing entire engineering solutions to...

  • Scala Developer

    1 month ago


    pune, India IFLOWTECH SOLUTIONS PRIVATE LIMITED Full time

    Job Description : As part of your duties, you will be responsible for : - Design and implement scalable and robust data pipelines using Scala within the Hadoop ecosystem. - Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs. - Perform performance tuning in Hadoop with a focus on...


  • pune, India F337 Deutsche India Private Limited, Pune Branch Full time

    Description Engineer is responsible for managing or performing work across multiple areas of the bank's overall IT Platform/Infrastructure including analysis, development, and administration. It may also involve taking functional oversight of engineering delivery for specific departments.Work includes: Planning and developing entire engineering...


  • Pune, India F337 Deutsche India Private Limited, Pune Branch Full time

    Description Engineer is responsible for managing or performing work across multiple areas of the bank's overall IT Platform/Infrastructure including analysis, development, and administration. It may also involve taking functional oversight of engineering delivery for specific departments. Work includes: Planning and developing entire engineering...

  • Hadoop Administrator

    4 weeks ago


    Pune, Maharashtra, India FIS Global Full time

    **Position Type**: Full time **Type Of Hire**: Experienced (relevant combo of work and education) **Education Desired**: Bachelor's Degree **Travel Percentage**: 0% **Hadoop Administrator -** **Bangalore/** **Pune/Chennai/Gurgaon-** 6**-1**2**Years** Are you curious, motivated, and forward-thinking? At FIS you’ll have the opportunity to work on some of...

  • Scala Developer

    2 weeks ago


    Pune/Gurgaon/Gurugram, India IFLOWTECH SOLUTIONS PRIVATE LIMITED Full time

    Job Description : As part of your duties, you will be responsible for : - Design and implement scalable and robust data pipelines using Scala within the Hadoop ecosystem. - Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs. - Perform performance tuning in Hadoop with a focus on...

  • Scala Developer

    4 weeks ago


    Pune/Gurgaon/Gurugram, IN IFLOWTECH SOLUTIONS PRIVATE LIMITED Full time

    Job Description :As part of your duties, you will be responsible for :- Design and implement scalable and robust data pipelines using Scala within the Hadoop ecosystem.- Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs.- Perform performance tuning in Hadoop with a focus on optimizing...

  • Data Engineer

    1 month ago


    Pune, India TD NEWTON Full time

    Job Description : Must have Requirements : To be successful in this role, you should meet the following requirements : - Scala development and design using Scala 2.10+ or Java development and design using Java 1.8+. - Experience with most of the following technologies : Apache Hadoop, Scala, Apache Spark, Spark streaming, YARN, Kafka, Hive, Python, ETL...

  • Data Engineer

    1 month ago


    Pune, India TD Newton Full time

    - As a key member of the technical team alongside Engineers, Data Scientists and Data Users, you will be expected to define and contribute at a high-level to many aspects of our collaborative Agile development process :- Software design, Scala & Spark development, automated testing of new and existing components in an Agile, DevOps and dynamic environment-...