Hadoop Developer

1 month ago


pune, India Nityo Infotech Full time
Should have Hands on Experience of Development on Cloudera Platform.• Developing Unix Shell scripts• Good understating of Hadoop Technologies such as Pig, Hive, HBase, HDFS, Spark, be able to analyze the issues on Hadoop Systems.• Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMRManaging scheduling with TWS scheduler.• Providing Support for Upgrade of Hadoop Versions, Patching of Clusters.Maintain High Performance of Cluster.• Create partnership with project stakeholders to provide technical assistance regarding important decisions• Design and implement data engineering, ingestion, and curation functions on AWS cloud using AWS native or custom programming.• Design and build production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala.• Perform detailed assessments of current state data platforms and create an appropriate transition path to AWS cloud.

Experience Required

2 - 4 Years

Industry Type

IT

Employment Type

Contract

Location

India


  • Hadoop Developer

    3 weeks ago


    Pune, India Nityo Infotech Full time

    Should have Hands on Experience of Development on Cloudera Platform.• Developing Unix Shell scripts• Good understating of Hadoop Technologies such as Pig, Hive, HBase, HDFS, Spark,be able to analyze the issues on Hadoop Systems.• Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS...

  • Hadoop Developer

    1 month ago


    Pune, India Nityo Infotech Full time

    Should have Hands on Experience of Development on Cloudera Platform.• Developing Unix Shell scripts• Good understating of Hadoop Technologies such as Pig, Hive, HBase, HDFS, Spark, be able to analyze the issues on Hadoop Systems.• Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS...

  • Hadoop Support

    3 weeks ago


    Pune, India Virtusa Full time

    Hadoop Support - CREQ184930 DescriptionJD : AWS SupportExperience : 6 to 12 yearsExpertise in data processing, data transformation, data Ingestion, data loading, Batch Processing and Stream Processing Should have experience in leading a team to complete development of new features. Experienced in SDLC concepts with extensive knowledge in development,...

  • Hadoop Support

    1 month ago


    pune, India Virtusa Full time

    Hadoop Support - CREQ184930 Description JD : AWS Support Experience : 6 to 12 years Expertise in data processing, data transformation, data Ingestion, data loading, Batch Processing and Stream Processing Should have experience in leading a team to complete development of new features. Experienced in SDLC concepts with extensive knowledge in...

  • Hadoop Support

    1 month ago


    Pune, India Virtusa Full time

    Hadoop Support - CREQ184930 Description JD : AWS Support Experience : 6 to 12 years Expertise in data processing, data transformation, data Ingestion, data loading, Batch Processing and Stream Processing Should have experience in leading a team to complete development of new features. Experienced in SDLC concepts with extensive knowledge in...

  • Scala Developer

    1 month ago


    pune, India IFLOWTECH SOLUTIONS PRIVATE LIMITED Full time

    Job Description : As part of your duties, you will be responsible for : - Design and implement scalable and robust data pipelines using Scala within the Hadoop ecosystem. - Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs. - Perform performance tuning in Hadoop with a focus on...

  • Hadoop Administrator

    4 weeks ago


    Pune, Maharashtra, India FIS Global Full time

    **Position Type**: Full time **Type Of Hire**: Experienced (relevant combo of work and education) **Education Desired**: Bachelor's Degree **Travel Percentage**: 0% **Hadoop Administrator -** **Bangalore/** **Pune/Chennai/Gurgaon-** 6**-1**2**Years** Are you curious, motivated, and forward-thinking? At FIS you’ll have the opportunity to work on some of...


  • pune, India HuQuo Consulting Pvt. Ltd. Full time

    Responsibilities :- Meeting with the development team to assess the company's big data infrastructure.- Designing and coding hadoop applications to analyze data collections.- Creating data processing frameworks.- Extracting data and isolating data clusters.- Testing scripts and analyzing results.- Troubleshooting application bugs.- Maintaining the security...

  • Hadoop Administrator

    3 weeks ago


    Pune, India Consulting Pandits Full time

    Mandatory Skills:- 4+ years of hands-on experience - Hadoop, System administration with sound knowledge in Unix based Operating System internals.- Working experience on Cloudera CDP and CDH and Hortonworks HDP Distribution.- Linux experience (RedHat, CentOS, Ubuntu).- Experience in setting up and supporting Hadoop environment (Cloud and On-premises).-...

  • Hadoop Administrator

    2 weeks ago


    Pune, India Consulting Pandits Full time

    Mandatory Skills:- 4+ years of hands-on experience - Hadoop, System administration with sound knowledge in Unix based Operating System internals.- Working experience on Cloudera CDP and CDH and Hortonworks HDP Distribution.- Linux experience (RedHat, CentOS, Ubuntu).- Experience in setting up and supporting Hadoop environment (Cloud and On-premises).-...

  • Hadoop Administrator

    3 weeks ago


    Pune, Maharashtra, India Consulting Pandits Full time

    Mandatory Skills:- 4+ years of hands-on experience - Hadoop, System administration with sound knowledge in Unix based Operating System internals.- Working experience on Cloudera CDP and CDH and Hortonworks HDP Distribution.- Linux experience (RedHat, CentOS, Ubuntu).- Experience in setting up and supporting Hadoop environment (Cloud and On-premises).-...

  • Scala Developer

    2 weeks ago


    Pune/Gurgaon/Gurugram, India IFLOWTECH SOLUTIONS PRIVATE LIMITED Full time

    Job Description : As part of your duties, you will be responsible for : - Design and implement scalable and robust data pipelines using Scala within the Hadoop ecosystem. - Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs. - Perform performance tuning in Hadoop with a focus on...

  • Scala Developer

    4 weeks ago


    Pune/Gurgaon/Gurugram, IN IFLOWTECH SOLUTIONS PRIVATE LIMITED Full time

    Job Description :As part of your duties, you will be responsible for :- Design and implement scalable and robust data pipelines using Scala within the Hadoop ecosystem.- Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs.- Perform performance tuning in Hadoop with a focus on optimizing...

  • Data Specialist

    2 weeks ago


    Pune, India Nilasu consulting Full time

    Job Summary:We are seeking a motivated and detail-oriented Data Specialist to join our team and play a key role in managing, analyzing, and optimizing our data infrastructure. You will leverage your expertise in the Hadoop ecosystem (SPARK, Impala, Hive) alongside .NET and C# to extract valuable insights from large datasets, collaborate effectively with...

  • Data Engineer

    1 month ago


    Pune, India TD NEWTON Full time

    Job Description : Must have Requirements : To be successful in this role, you should meet the following requirements : - Scala development and design using Scala 2.10+ or Java development and design using Java 1.8+. - Experience with most of the following technologies : Apache Hadoop, Scala, Apache Spark, Spark streaming, YARN, Kafka, Hive, Python, ETL...


  • Gurgaon/Gurugram/Pune, India HuQuo Consulting Pvt. Ltd. Full time

    Responsibilities :- Meeting with the development team to assess the company's big data infrastructure.- Designing and coding hadoop applications to analyze data collections.- Creating data processing frameworks.- Extracting data and isolating data clusters.- Testing scripts and analyzing results.- Troubleshooting application bugs.- Maintaining the...


  • Pune, India HuQuo Consulting Pvt. Ltd. Full time

    Job Description :- 5-8 years of total experience of solid data engineering experience, especially in Open Source, data-intensive, distributed environments with minimum 5 years of experience in big data related technologies like Spark, Hive, HBase, Hadoop, etc. Programming background : - Mandatory- Scala, Spark and Java / Python - Experience in following...


  • Pune, Maharashtra, India HuQuo Consulting Pvt. Ltd. Full time

    Job Description :- 5-8 years of total experience of solid data engineering experience, especially in Open Source, data-intensive, distributed environments with minimum 5 years of experience in big data related technologies like Spark, Hive, HBase, Hadoop, etc. Programming background : - Mandatory- Scala, Spark and Java / Python - Experience in following...


  • Pune, India HuQuo Consulting Pvt. Ltd. Full time

    Job Description : - 5-8 years of total experience of solid data engineering experience, especially in Open Source, data-intensive, distributed environments with minimum 5 years of experience in big data related technologies like Spark, Hive, HBase, Hadoop, etc. Programming background : - Mandatory- Scala, Spark and Java / Python - Experience in following...


  • Pune, India F337 Deutsche India Private Limited, Pune Branch Full time

    DescriptionEngineer is responsible for managing or performing work across multiple areas of the bank's overall IT Platform/Infrastructure including analysis, development, and administration. It may also involve taking functional oversight of engineering delivery for specific departments.Work includes:Planning and developing entire engineering solutions to...