Hadoop Administrator

3 weeks ago

Pune, Maharashtra, India IOWeb3 Technologies Full time

Job Summary :

We are seeking a skilled and experienced Hadoop Administrator with 3-5 years of experience to join our growing team. You will be responsible for the installation, configuration, maintenance, and performance tuning of our Hadoop clusters.

This role requires a strong understanding of Hadoop architecture, ecosystem components, and best practices for cluster management.

You will work closely with data engineers, analysts, and other stakeholders to ensure the availability and reliability of our big data platform.

Key Responsibilities :

- Cluster Management : Install, configure, and maintain Hadoop clusters, including HDFS, YARN, MapReduce, and other ecosystem components.

- Performance Tuning : Monitor cluster performance, identify bottlenecks, and implement optimizations to improve efficiency and scalability.

- Capacity Planning : Forecast cluster resource needs and plan for capacity expansion.

- Security Management : Implement and maintain security measures to protect data and the Hadoop environment. Manage user access and permissions.

- Software Upgrades : Plan and execute software upgrades and patches for Hadoop and related components.

- Troubleshooting : Diagnose and resolve issues related to Hadoop clusters, including hardware failures, software bugs, and performance problems.

- Monitoring & Alerting : Set up and maintain monitoring and alerting systems to proactively identify and address potential issues.

- Backup & Recovery : Implement backup and recovery strategies to ensure data availability and disaster recovery.

- Automation : Automate routine tasks using scripting languages like Bash or Python.

- Documentation : Maintain accurate documentation of Hadoop cluster configurations, procedures, and troubleshooting steps.

- Collaboration : Work closely with data engineers, analysts, and other stakeholders to understand their requirements and provide support.

Required Technical Skills :

- Hadoop Ecosystem : Deep understanding of the Hadoop ecosystem, including HDFS, YARN, MapReduce, Hive, Pig, Spark, and other related components.

- Linux : Strong Linux system administration skills, including command-line proficiency, shell scripting, and package management.

- Networking : Basic understanding of networking concepts, including TCP/IP, DNS, and firewalls.

- Scripting : Proficiency in scripting languages like Bash or Python for automation and system administration tasks.

- Monitoring Tools : Experience with monitoring tools like Ganglia, Nagios, or Cloudera Manager.

- Troubleshooting : Strong troubleshooting skills and the ability to diagnose and resolve complex technical issues.

Preferred Skills :

- Cloud Platforms : Experience with cloud-based Hadoop distributions (e.g. , AWS EMR, Azure HDInsight, Google Cloud Dataproc).

- Big Data Technologies : Familiarity with other big data technologies like NoSQL databases (e.g. , HBase, Cassandra) or data streaming platforms (e.g. , Kafka).

- Security : Knowledge of Hadoop security best practices, including Kerberos authentication and authorization.

- Configuration Management : Experience with configuration management tools like Ansible, Chef, or Puppet.

- Database Administration : Basic understanding of database administration concepts.

Required Experience & Qualifications :

- Experience : 3-5 years of experience as a Hadoop Administrator.

- Education : Bachelor's degree in Computer Science, Information Technology, or a related field preferred.

Personal Attributes :

- Strong problem-solving and analytical skills.

- Excellent communication and interpersonal skills.

- Ability to work effectively in a team environment.

- Proactive, self-motivated, and results-oriented.

- Attention to detail and a commitment to quality

(ref:hirist.tech)

  • Emergys - Hadoop Administrator - On-Premises

    6 days ago

    Pune, Maharashtra, India Emergys labs Full time

    About the Role : We are seeking a highly skilled and experienced Hadoop Administrator to join our team. In this role, you will be responsible for the setup, configuration, maintenance, and security of our Hadoop clusters, both on-premises and in the cloud. You will leverage your deep understanding of Hadoop distributions and Unix-based operating systems to...

  • Emergys - Hadoop Administrator - On-Premises

    1 week ago

    Pune, Maharashtra, India Emergys labs Full time

    About the Role : We are seeking a highly skilled and experienced Hadoop Administrator to join our team. In this role, you will be responsible for the setup, configuration, maintenance, and security of our Hadoop clusters, both on-premises and in the cloud. You will leverage your deep understanding of Hadoop distributions and Unix-based operating systems to...

  • Cloud Native Hadoop Administrator

    5 days ago

    Pune, Maharashtra, India Emergys labs Full time

    About Emergys LabsWe're looking for a seasoned Hadoop administrator to join our team at Emergys Labs. As a key member of our infrastructure team, you'll play a vital role in maintaining the integrity and performance of our big data infrastructure.Responsibilities:Manage and maintain Hadoop environments (Cloud and On-premises) using Cloudera CDP/CDH and...

  • Hadoop Cluster Engineer

    6 days ago

    Pune, Maharashtra, India Emergys labs Full time

    About Emergys LabsWe are seeking a highly skilled and experienced Hadoop administrator to join our team at Emergys Labs. In this role, you will be responsible for the setup, configuration, maintenance, and security of our Hadoop clusters, both on-premises and in the cloud.Key Responsibilities:Setup, configure, and manage Hadoop environments (Cloud and...

  • Senior Hadoop Admin

    4 weeks ago

    Pune, Maharashtra, India Circana Full time

    Senior Hadoop Admin Let's be unstoppable together Circana (formerly IRI and NPD) is the leading advisor on the complexity of consumer behavior. Through unparalleled technology, advanced analytics, cross-industry data, and deep expertise, we provide clarity that helps almost 7,000 of the world's leading brands and retailers take action and unlock...

  • Hadoop Infrastructure Expert

    6 days ago

    Pune, Maharashtra, India IOWeb3 Technologies Full time

    Job Summary: We are seeking a highly skilled and experienced Hadoop Administrator to join our team at IOWeb3 Technologies. The ideal candidate will have 3-5 years of experience in managing Hadoop clusters, including installation, configuration, maintenance, and performance tuning. This role requires a strong understanding of Hadoop architecture, ecosystem...

  • Hadoop Admin/senior Consultant Specialist

    4 days ago

    Pune, Maharashtra, India HSBC Full time

    Job descriptionSome careers shine brighter than others If youxe2x80x99re looking for a career that will help you stand out join HSBC and fulfil your potential Whether you want a career that could take you to the top or simply take you in an exciting new direction HSBC offers opportunities support and rewards that will take you further HSBC is one of the...

  • Hadoop Platform Engineering Specialist/ Consultant Specialist

    3 weeks ago

    Pune, Maharashtra, India HSBC Full time

    Job DescriptionJob descriptionSome careers shine brighter than others.If you're looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.HSBC is one...

  • Greenplum Database Administrator

    6 days ago

    Pune, Maharashtra, India HNM Solutions Full time

    Role : Greenplum Administrator Location : Pune Experience : 5 years NOTE : Immediate joiner Mandatory skills : Experience : 5 years in database administration Key Skills : Greenplum Database, PostgreSQL, performance tuning, backup & recovery, cluster management, SQL : Maintain and optimize Greenplum clusters, manage database security and performance,...

  • Greenplum Database Administrator

    2 weeks ago

    Pune, Maharashtra, India HNM Solutions Full time

    Role : Greenplum Administrator Location : PuneExperience : 5+ yearsNOTE : Immediate joinerMandatory skills : Experience : 5+ years in database administrationKey Skills : Greenplum Database, PostgreSQL, performance tuning, backup & recovery, cluster management, SQL : Maintain and optimize Greenplum clusters, manage database security and performance,...

  • Data Engineering Lead

    5 days ago

    Pune, Maharashtra, India IOWeb3 Technologies Full time

    About the Role: We are looking for a highly skilled and experienced Hadoop Administrator to join our team at IOWeb3 Technologies. The successful candidate will have a deep understanding of Hadoop architecture, ecosystem components, and best practices for cluster management. They will be responsible for designing, implementing, and maintaining large-scale...

  • Big Data Infrastructure Specialist

    5 days ago

    Pune, Maharashtra, India Emergys labs Full time

    About Emergys LabsWe are seeking a highly skilled and experienced Hadoop administrator to join our team at Emergys Labs. As a key member of our team, you will play a critical role in ensuring the reliability and performance of our big data infrastructure.Key Responsibilities:Configure and manage Hadoop environments (Cloud and On-premises) using Cloudera...

  • Data Architecture Expert

    3 days ago

    Pune, Maharashtra, India Emergys Solutions Private Limited (Formerly Ellicium Solutions Private Limited) Full time

    Company OverviewEmergys Solutions Private Limited is a leading provider of innovative IT solutions.Job Summary:We are seeking an experienced Hadoop Developer to join our team.Key Responsibilities:Design, develop, and deploy Hadoop applications using various big data tools and technologies.Collaborate with cross-functional teams to ensure seamless data...

  • Big Data Solutions Specialist

    4 days ago

    Pune, Maharashtra, India HSBC Full time

    Job DescriptionWe are seeking an experienced professional to join our team as a Senior Consultant Specialist. In this role, you will be responsible for big data ecosystem and Hadoop administration knowledge, as well as working knowledge of Python, Ansible, and CI/CD tools.Coordinating with vendors and business teams during environment outagesExperience in...

  • Big Data Engineer

    3 days ago

    Pune, Maharashtra, India Emergys Solutions Private Limited (Formerly Ellicium Solutions Private Limited) Full time

    Job DescriptionWe are seeking a highly skilled Hadoop Developer to join our team at Emergys Solutions Private Limited.Key Responsibilities:Design and implement scalable Hadoop clusters using Cloudera CDP, CDH, and Hortonworks HDP Distribution.Configure and manage Linux environments (RedHat, CentOS, Ubuntu) for Hadoop deployment.Set up and support Hadoop...

  • Database Architect

    6 days ago

    Pune, Maharashtra, India Avanciers Full time

    Job Summary : Avanciers is seeking a highly skilled and experienced Oracle Database Architect to join our team. This critical role will focus on modernizing our client's database infrastructure, driving improvements in performance, observability, resilience, and architecture. The ideal candidate will possess deep expertise in Oracle database administration,...

  • Senior Data Architect

    4 weeks ago

    Pune, Maharashtra, India Crazy Solutions Full time

    Senior Data Architect / EngineerRole :Senior Data Engineer/Architect Location: Chennai / Pune Company: Sunware Technologies Private Limited Position Overview: We are hiring an experienced Senior Data Engineer/Architect with 7-10 years of expertise in data modeling, big data tools, database management, and cryptography. The role involves designing scalable...

  • Greenplum Database Architect

    6 days ago

    Pune, Maharashtra, India HNM Solutions Full time

    Job Description:The role of the Greenplum Database Administrator is to administer and maintain Greenplum clusters, ensuring high data quality and availability. This involves collaborating with application teams to apply updates, patches, and version upgrades as required. Additionally, the administrator will be responsible for implementation and ongoing...

  • Database Architect

    4 weeks ago

    Pune, Maharashtra, India Avanciers Full time

    Job Summary : Avanciers is seeking a highly skilled and experienced Oracle Database Architect to join our team. This critical role will focus on modernizing our client's database infrastructure, driving improvements in performance, observability, resilience, and architecture. The ideal candidate will possess deep expertise in Oracle database administration,...

  • Database Architect

    4 weeks ago

    Pune, Maharashtra, India Avanciers Full time

    Job Summary : Avanciers is seeking a highly skilled and experienced Oracle Database Architect to join our team. This critical role will focus on modernizing our client's database infrastructure, driving improvements in performance, observability, resilience, and architecture. The ideal candidate will possess deep expertise in Oracle database administration,...