Senior Hadoop Engineer

4 weeks ago


Pune, Maharashtra, India HuQuo Consulting Pvt. Ltd. Full time

Job Description :


- 5-8 years of total experience of solid data engineering experience, especially in Open Source, data-intensive, distributed environments with minimum 5 years of experience in big data related technologies like Spark, Hive, HBase, Hadoop, etc.

Programming background :

- Mandatory- Scala, Spark and Java / Python

- Experience in following technologies - MapReduce, HDFS, YARN, Spark Streaming.

- Experience in creating e2e pipelines in Hadoop.

- Experience in SQL, Hive and NoSQL databases

- Experience in Linux / Unix platform

- Experience of cloud design patterns

- Experience in Jenkins, GitHub, Debugging the code, and error handling.

- Experience in Building end to end ETL Pipelines

- Self-starter & resourceful personality with the ability to manage pressure situations.

- Experience working with geographically distributed teams.

- Work on high- level business and technical problems, contribute to architectural decisions.

- Create the core framework/templates that gives a starting point for the team members to get started with implementation/ execution.

Role & Responsibilities:

- Build Data and ETL pipelines in Hadoop.

- Support migration of data to the cloud using Big Data Technologies like Spark, Hive, Hadoop, Scala, Python

- Interact with customers daily to ensure smooth engagement.

- Exposure to GCP

- Responsible for timely and quality deliveries.

- Exposure to Scrum and Agile Development best practices

(ref:hirist.tech)

  • Pune, Maharashtra, India QAAgility Technologies Full time

    Job Title : Senior Data and Analytics EngineerWork Experience : 3-5 yearsJob Location : PunePosition Overview : We are looking for an experienced Senior Data and Analytics Engineer who will be responsible for designing, developing, and maintaining our data infrastructure and analytics solutions. The ideal candidate will have strong expertise in Hadoop,...


  • Pune, Maharashtra, India TeacherOn Full time

    I want to learn about basics of data engineering workflow including ,Kafka, Hadoop, pyspark , from non technical background but need it as I have switched to Business Intelligence role.Level: BeginnerGender Preference: NoneMeeting options:Available online - via skype etc.


  • Pune, Maharashtra, India Coders Brain Technology & Private Limited Full time

    To be successful in this role, you should possess :- Collaborate closely with Product Management and Engineering leadership to devise and build the right solution.- Participate in Design discussions and brainstorming sessions to select, integrate, and maintain Big Data tools and frameworks required to solve Big Data problems at scale.- Design and implement...

  • Big Data Engineer

    4 weeks ago


    Pune, Maharashtra, India Www.Huquo.com Full time

    Big Data Engineer( Lead assistant manager-Manager) Job Description : Must Have : Tech savvy engineer - willing and able to learn new skills, track industry trend.- 5 - 7 years of total experience of solid data engineering experience, especially in Open Source, data-intensive, distributed environments with minimum 5 years of experience in big data related...

  • Senior Engineer

    22 minutes ago


    Pune, Maharashtra, India cnh industrial india pvt ltd Full time

    Apply for Senior Engineer S&M Tractor Chassis, Career Progress Consultants in Pune ,Gurgaon for Year of Experience on

  • Senior Data Engineer

    2 weeks ago


    Pune, Maharashtra, India Cyber Sphere LLC Full time

    Senior Data EngineerFTE OpportunityLocation : Pun, India - Onsite100%Job Description : - Design and develop data-ingestion frameworks, real-time processing solutions, and data processing and transformation frameworks.- Deploy and provide support for application codes and analytical models.- Create and enhance data solutions that enable seamless integration...

  • Data Engineer

    4 weeks ago


    Pune, Maharashtra, India ADVANSOFT Full time

    Position: Data EngineerNotice Period: Immediately -20 Days (Early Joiners / Candidates Serving Notice Period will be Preferred)Location: PuneExperience: 5+ yearsMust Skills : Python, Hive, SQL, Airflow, Pyspark, Hadoop, Data Structure, GitHub, Backend Technologies Duration: Full TimeJob Description :Technical & Other Skills :- 5+ years of working experience...


  • Pune, Maharashtra, India ICERTIS Full time

    Apply for Senior Software Engineer Security Engineer, Career Progress Consultants in Pune for 4 - 8 Year of Experience on


  • Pune, Maharashtra, India Huquo Full time

    Job Description :Must Have :Tech savvy engineer - willing and able to learn new skills, track industry trend.- 5 - 7 years of total experience of solid data engineering experience, especially in Open Source, data-intensive, distributed environments with minimum 5 years of experience in big data related technologies like Spark, Hive, HBase, Hadoop, etc.-...

  • Senior Software Engineer

    22 minutes ago


    Pune, Maharashtra, India LTIMindtree Full time

    Apply for Senior Software Engineer, LTIMindtree Ltd. in Pune for 3 - 7 Year of Experience on

  • Senior Software Engineer

    20 minutes ago


    Pune, Maharashtra, India LTIMindtree Full time

    Apply for Senior Software Engineer, LTIMindtree Ltd. in Pune for 3 - 6 Year of Experience on


  • Pune, Maharashtra, India ICERTIS Full time

    Apply for Senior Software Engineer Customer Support .Net, Career Progress Consultants in Pune for 5 - 8 Year of Experience on


  • Pune/Ahmedabad, Maharashtra, India Infocusp innovations Full time

    Company ProfileInfocusp Innovations is an IT firm working in the broad fields of Machine Learning, Artificial Intelligence (AI), Computer Science, Software Engineering, Mobile and Web App Development, QA, and Signal Processing. Global presence in India and The United States of America with offices in Ahmedabad, Pune and California, we make businesses smart...


  • Pune, Maharashtra, India timesjobs Full time

    Senior Software EngineerPosition: Senior Software EngineerExperience: 4 yearsJob Location: PuneSkills Required:Design sophisticated software components, services, and applications.Lead the delivery of your projects to production.Integrate your software with other distributed systems and shared APIs.Hire and develop others by mentoring junior software...

  • Senior Data Engineer

    2 weeks ago


    Pune, Maharashtra, India timesjobs Full time

    Senior Data EngineerPosition: Senior Data EngineerExperience: 8 yearsJob Location: PuneSkills Required:Developing, maintaining, and documenting reliable and scalable data infrastructure and data products in complex environmentsDevelopment experience in one or more object-oriented programming languages (e.g., Py-spark, Python, Java, C )Experience of working...


  • Pune, Maharashtra, India ICERTIS Full time

    Apply for Senior Engineering Manager .Net, Career Progress Consultants in Pune for Year of Experience on

  • Senior Engineer

    3 weeks ago


    Pune, Maharashtra, India MAHLE Full time

    Senior Engineer – PMO Experience 3-5 years Onwards Understand & utilize Project Management end to end-process knowledge.Support in development through testing & functionality for PMO process. Participate in various sprints. Executing PMO activities assigned by requestor / TL / Manager and to fulfill the timelines set per guidelines / standard...

  • Senior IT System Engineer

    28 minutes ago


    Pune, Maharashtra, India Luxoft Full time

    Project descriptionSecurity is a global organization within Group Technology Infrastructure and Security Engineering. Our services focus on identity management for users, access management for applications and infrastructure, directories, detecting/preventing measures for cyber threats, and exchanging/storing data securely. We provide consolidated and...

  • Data Engineer

    16 hours ago


    Pune, Maharashtra, India EDGESOFT Full time

    Job Description :- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.- 5 to 10 years of proven experience as a Data Engineer with a strong emphasis on DataBricks.- Proficiency in PySpark and extensive hands on experience in building and optimizing data pipelines using DataBricks.- Solid understanding of different...

  • Senior R&D Engineer

    3 weeks ago


    Pune, Maharashtra, India Ansys Full time

    Summary / Role Purpose The Senior R&D Engineer joins the Release Management Unit and is responsible for the development of Ansys Licensing as a Service (LaaS), a high-availability RESTful service hosted on Azure. In this role, the Senior R&D Engineer will use advanced technical and problem-solving skills to help the team tackle complex issues, satisfy...