Current jobs related to Hadoop Cluster Engineer - Pune, Maharashtra - Emergys labs

  • Hadoop Administrator

    1 week ago

    Pune, Maharashtra, India IOWeb3 Technologies Full time

    Job Summary : We are seeking a skilled and experienced Hadoop Administrator with 3-5 years of experience to join our growing team. You will be responsible for the installation, configuration, maintenance, and performance tuning of our Hadoop clusters. This role requires a strong understanding of Hadoop architecture, ecosystem components, and best practices...

  • Hadoop Administrator

    4 weeks ago

    Pune, Maharashtra, India IOWeb3 Technologies Full time

    Job Summary : We are seeking a skilled and experienced Hadoop Administrator with 3-5 years of experience to join our growing team. You will be responsible for the installation, configuration, maintenance, and performance tuning of our Hadoop clusters. This role requires a strong understanding of Hadoop architecture, ecosystem components, and best practices...

  • Hadoop Administrator

    3 weeks ago

    Pune, Maharashtra, India IOWeb3 Technologies Full time

    Job Summary : We are seeking a skilled and experienced Hadoop Administrator with 3-5 years of experience to join our growing team. You will be responsible for the installation, configuration, maintenance, and performance tuning of our Hadoop clusters. This role requires a strong understanding of Hadoop architecture, ecosystem components, and best practices...

  • Hadoop Developer

    2 weeks ago

    Pune, Maharashtra, India Nityo Infotech Services Pte. Ltd Full time

    Job DescriptionJob DescriptionWhat will your job look like Should have Hands on Experience of Development on Cloudera Platform. Developing Unix Shell scripts Good understating of Hadoop Technologies such as Pig, Hive, HBase, HDFS, Spark, Kafka.Should be able to analyze the issues on Hadoop Systems. Design, development, and implementation of performant ETL...

  • Hadoop Specialist

    2 days ago

    Pune, Maharashtra, India NTT DATA Full time

    Job Overview">We are seeking a highly skilled Hadoop Consultant/Hadoop Admin to join our team in Pune, India. The ideal candidate will have 6 years of experience in Hadoop Engineering with working experience on Python, Ansible, DevOps methodologies.About NTT DATAWe are a trusted global innovator of business and technology services, serving 75% of the Fortune...

  • Emergys - Hadoop Administrator - On-Premises

    1 week ago

    Pune, Maharashtra, India Emergys labs Full time

    About the Role : We are seeking a highly skilled and experienced Hadoop Administrator to join our team. In this role, you will be responsible for the setup, configuration, maintenance, and security of our Hadoop clusters, both on-premises and in the cloud. You will leverage your deep understanding of Hadoop distributions and Unix-based operating systems to...

  • Hadoop Solutions Architect

    6 days ago

    Pune, Maharashtra, India NTT DATA Full time

    As a Hadoop Consultant/Hadoop Admin at NTT DATA, you will be responsible for designing, implementing, and managing large-scale Hadoop clusters. You will work closely with cross-functional teams to deliver high-quality solutions that meet our clients' needs.You will have the opportunity to work on cutting-edge technologies and contribute to the growth and...

  • Hadoop Consultant/hadoop Admin

    6 days ago

    Pune, Maharashtra, India NTT DATA Full time

    Req ID 308919NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Hadoop Consultant Hadoop Admin to join our team in Pune Mahxc4x81rxc4x81shtra IN-MH India IN -6 Years Experience...

  • Emergys - Hadoop Administrator - On-Premises

    2 weeks ago

    Pune, Maharashtra, India Emergys labs Full time

    About the Role : We are seeking a highly skilled and experienced Hadoop Administrator to join our team. In this role, you will be responsible for the setup, configuration, maintenance, and security of our Hadoop clusters, both on-premises and in the cloud. You will leverage your deep understanding of Hadoop distributions and Unix-based operating systems to...

  • PySpark Hadoop Engineer

    2 weeks ago

    Pune, Maharashtra, India Tata Consultancy Services Full time

    Job Title:PySpark Hadoop EngineerLocation - Pan IndiaExperience -5 to 10 YrsKey Skills/Knowledge:Good Data background. Hadoop is the primary skill and PySpark is secondary experience. Total 4 years exp, PySpark Min 2 years. With data transformation exp. (Hadoop platform optional)Experience required:Good Data background. Hadoop is the primary skill and...

  • Cloudera Admin Hadoop

    3 weeks ago

    Pune, Maharashtra, India People Prime Worldwide Private Limited Full time

    Job DescriptionAbout Company:Our Company is a global technology consulting and digital solutions company that enables enterprises to reimagine business models and accelerate innovation through digital technologies. Powered by more than 84,000 entrepreneurial professionals across more than 30 countries, caters to over 700 clients. Our extensive domain and...

  • Senior Hadoop Developer

    2 weeks ago

    Pune, Maharashtra, India Bright Vision Technologies Full time

    Bright Vision Technologies has an immediate Full-time opportunity for  Hadoop Developer to join our team in United States .Job Role:  Hadoop Developer Bright Vision Technologies Your Path to a Successful Career in the U.S.Starts Here Now Accepting Applications for the H1B 2025 QuotaAt Bright Vision Technologies, we specialize in turning aspirations into...

  • Big Data Engineer

    6 days ago

    Pune, Maharashtra, India NTT DATA Full time

    NTT DATA is a trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize, and transform for long-term success.About the RoleWe are currently seeking a Hadoop Consultant/Hadoop Admin to join our team in India. The ideal candidate will have at least 6 years of...

  • Big Data Engineer

    2 days ago

    Pune, Maharashtra, India NTT DATA Full time

    Job Description">N TT DATA strives to hire exceptional and innovative individuals who want to grow with us. We are currently seeking a Hadoop Consultant/Hadoop Admin to join our team.About UsWe are a trusted global innovator of business and technology services, serving 75% of the Fortune Global 100. Our services include business and technology consulting,...

  • Hadoop Developer

    3 days ago

    Pune, Maharashtra, India Tata Consultancy Services Full time

    We are looking for a highly skilled Software Engineer to join our team at Tata Consultancy Services.The role involves designing and developing solutions for Big Data using Hadoop ecosystem technologies such as HDFS, Spark, Hive Parquet File format, YARN, MapReduce, Sqoop.The candidate should have minimum 5+ years of experience in development of Spark Scala,...

  • Data Integration Specialist

    6 days ago

    Pune, Maharashtra, India NTT DATA Full time

    NTT DATA is a global leader in business and technology services, serving 75% of the Fortune Global 100. We are committed to helping clients innovate, optimize, and transform for long-term success.About the JobThis is an exciting opportunity to join our team as a Hadoop Consultant/Hadoop Admin in India. The ideal candidate will have at least 6 years of...

  • Data Architecture Expert

    7 days ago

    Pune, Maharashtra, India Emergys Solutions Private Limited (Formerly Ellicium Solutions Private Limited) Full time

    Company OverviewEmergys Solutions Private Limited is a leading provider of innovative IT solutions.Job Summary:We are seeking an experienced Hadoop Developer to join our team.Key Responsibilities:Design, develop, and deploy Hadoop applications using various big data tools and technologies.Collaborate with cross-functional teams to ensure seamless data...

  • Cloud Technologist

    1 day ago

    Pune, Maharashtra, India NTT DATA Full time

    About the Role">We are seeking a talented Hadoop Consultant/Hadoop Admin to join our team in Pune, India. The successful candidate will have a strong background in Hadoop Engineering, with experience working with Python, Ansible, DevOps methodologies.About NTT DATAWe are a global leader in business and technology services, serving 75% of the Fortune Global...

  • Big Data Engineer

    4 weeks ago

    Pune, Maharashtra, India Pixeldust Technologies Full time

    Job Descriptions: We are seeking an experienced and highly skilled Data Engineer to join our dynamic team. The ideal candidate will be proficient in designing, building, and operationalizing large-scale data processing systems. This role requires expertise in a wide range of technologies and methodologies, with a strong emphasis on delivering scalable and...

  • Big Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Pixeldust Technologies Full time

    Job Descriptions: We are seeking an experienced and highly skilled Data Engineer to join our dynamic team. The ideal candidate will be proficient in designing, building, and operationalizing large-scale data processing systems. This role requires expertise in a wide range of technologies and methodologies, with a strong emphasis on delivering scalable and...

Hadoop Cluster Engineer

1 week ago

Pune, Maharashtra, India Emergys labs Full time

About Emergys Labs

We are seeking a highly skilled and experienced Hadoop administrator to join our team at Emergys Labs. In this role, you will be responsible for the setup, configuration, maintenance, and security of our Hadoop clusters, both on-premises and in the cloud.

Key Responsibilities:

  • Setup, configure, and manage Hadoop environments (Cloud and On-premises) using Cloudera CDP/CDH and Hortonworks HDP distributions.
  • Install, configure, and maintain Hadoop services like YARN, HDFS, Zookeeper, Hive, Spark, HBase, etc.
  • Perform capacity planning and performance tuning of Hadoop clusters.
  • Monitor and troubleshoot Hadoop cluster performance and stability.
  • Implement and manage data replication peers and policies.

Operating System and System Administration:

  • Extensive hands-on experience with Hadoop and system administration.
  • Solid knowledge of Unix-based Operating System internals.
  • Proficiency in Linux administration (RedHat, CentOS, Ubuntu).
  • Experience with Hadoop command-line interface.

Security Implementation:

  • Setup and configure Kerberos for Hadoop cluster security.
  • Implement data-at-rest encryption (required) and data-in-transit encryption (optional).
  • Knowledge of Ranger, SSL, and Atlas for Hadoop security and governance.
  • Knowledge of Hadoop data related Auditing methods.

Automation and Scripting:

  • Strong scripting background (shell/bash, Python) for automation and configuration management.
  • Automate routine Hadoop administration tasks.

Cloud Services:

  • Setting up the Hadoop platform using AWS cloud native services.

Support and Operations:

  • Provide 24x7 support for Hadoop clusters, including rotating shifts, weekends, and public holidays.
  • Work closely with infrastructure, networking, and development teams.
  • Troubleshoot and resolve Hadoop-related issues.

Communication and Collaboration:

  • Excellent communication and interpersonal skills.
  • Ability to work effectively in a team environment.

Required Technical Skills:

  • Hadoop Distributions: Cloudera CDP/CDH, Hortonworks HDP.
  • Hadoop Services: YARN, HDFS, Zookeeper, Hive, Spark, HBase.
  • Operating Systems: Linux (RedHat, CentOS, Ubuntu), Unix based Operating systems.
  • Security: Kerberos, Ranger, SSL, Atlas.
  • Scripting: Shell/Bash, Python.
  • Cloud Services: AWS cloud native services.

Required Experience:

  • 4 years of hands-on experience in Hadoop administration.
  • Proven experience in setting up and supporting Hadoop environments (Cloud and On-premises).

Soft Skills:

  • Excellent communication and interpersonal skills.
  • Strong problem-solving and troubleshooting skills.
  • Ability to work in a fast-paced environment.
  • Ability to work in 24x7 rotating shifts.
  • Ability to work closely with other teams.