AWS Hadoop Administrator

3 weeks ago

Bengaluru, India Valiance Solutions Full time

About Us:

Valiance is a global AI & Data analytics firm helping clients build cutting-edge technology solutions for digital transformation. We work with some of the marquee brands across India, US and APAC to build transformative solutions for Credit Risk, Fraud, Predictive Maintenance, Quality Inspection, Data lake, IOT analytics etc. Our team comprises 120+ professionals across Machine Learning, Data Engineering & Cloud expertise.


Job Description:

We are seeking a skilled AWS Hadoop Administrator to join our team and manage our Hadoop infrastructure on the AWS platform. In this role, you will be responsible for deploying, configuring, monitoring, and maintaining our Hadoop clusters to ensure optimal performance, scalability, and reliability. As an integral member of our IT operations team, you will collaborate closely with data engineers, developers, and other stakeholders to support our big data initiatives and ensure smooth operation of our data processing workflows


Responsibilities:

  • Deploy and configure Hadoop clusters on the AWS cloud platform including MWAA,MLflow and Apache-Nifi, ensuring proper integration with related AWS services such as EC2, S3, EMR, and IAM.
  • Monitor Hadoop cluster performance, health, and resource utilization using monitoring tools and AWS CloudWatch, and proactively address any issues to maintain optimal performance.
  • Manage Hadoop cluster capacity, scaling resources up or down as needed to accommodate changing workload demands.
  • Implement and enforce security best practices for Hadoop clusters on AWS, including access control, encryption, and compliance with regulatory requirements.
  • Perform regular backups and disaster recovery procedures to ensure data integrity and minimize downtime.
  • Collaborate with data engineers and developers to optimize Hadoop jobs and data processing workflows for performance and efficiency.
  • Troubleshoot and resolve issues related to Hadoop cluster operation, performance, and data processing.
  • Stay current with advancements in Hadoop technology and AWS services and evaluate and recommend new tools and techniques to enhance our big data infrastructure.
  • Document system configurations, procedures, and best practices, and provide training and support to other team members as needed.
  • Participate in on-call rotation and respond to incidents outside of regular business hours as necessary.


Qualifications:

  • Bachelor’s degree in computer science, engineering, or a related field, or equivalent work experience.
  • Proven experience as a Hadoop administrator, preferably in an AWS environment.
  • Strong understanding of Hadoop architecture, components, and ecosystem technologies such as HDFS, YARN, MapReduce, Hive, Spark, and Kafka.
  • Experience deploying and managing Hadoop clusters on AWS using services such as EMR, EC2, S3, and IAM.
  • Solid understanding of cloud computing principles and best practices, particularly in AWS.
  • Proficiency in Linux operating systems and shell scripting.
  • Strong analytical and problem-solving skills, with the ability to troubleshoot complex issues and drive them to resolution.
  • Excellent communication and collaboration skills, with the ability to work effectively in a team environment.
  • AWS certification(s) such as AWS Certified Solutions Architect or AWS Certified Sy sops Administrator is a plus.
  • Experience with containerization technologies such as Docker and orchestration tools like Kubernetes is desirable.

  • AWS Hadoop Administrator

    3 weeks ago

    Bengaluru, India Valiance Solutions Full time

    About Us:Valiance is a global AI & Data analytics firm helping clients build cutting-edge technology solutions for digital transformation. We work with some of the marquee brands across India, US and APAC to build transformative solutions for Credit Risk, Fraud, Predictive Maintenance, Quality Inspection, Data lake, IOT analytics etc. Our team comprises 120+...

  • AWS Hadoop Administrator

    3 weeks ago

    Bengaluru, India Valiance Solutions Full time

    About Us: Valiance is a global AI & Data analytics firm helping clients build cutting-edge technology solutions for digital transformation. We work with some of the marquee brands across India, US and APAC to build transformative solutions for Credit Risk, Fraud, Predictive Maintenance, Quality Inspection, Data lake, IOT analytics etc. Our team comprises...

  • AWS Hadoop Administrator

    3 weeks ago

    Bengaluru, India Valiance Solutions Full time

    About Us:Valiance is a global AI & Data analytics firm helping clients build cutting-edge technology solutions for digital transformation. We work with some of the marquee brands across India, US and APAC to build transformative solutions for Credit Risk, Fraud, Predictive Maintenance, Quality Inspection, Data lake, IOT analytics etc. Our team comprises 120+...

  • Hadoop Administrator

    3 weeks ago

    Bengaluru, India Alp Consulting Limited Full time

    Hadoop AdministratorDuties & ResponsibilitiesTo write an effective hadoop administrator job description, begin by listing detailed duties, responsibilities and expectations. We have included hadoop administrator job description templates that you can modify and use.Sample responsibilities for this position include:Leverage NoSQL, Hive, Sqoop, Flume, Yarn,...

  • Hadoop Administrator

    3 weeks ago

    Bengaluru, India Alp Consulting Limited Full time

    Hadoop AdministratorDuties & ResponsibilitiesTo write an effective hadoop administrator job description, begin by listing detailed duties, responsibilities and expectations. We have included hadoop administrator job description templates that you can modify and use.Sample responsibilities for this position include:Leverage NoSQL, Hive, Sqoop, Flume, Yarn,...

  • Hadoop Administrator

    4 days ago

    Bengaluru, Karnataka, India Alp Consulting Limited Full time

    Hadoop AdministratorDuties & ResponsibilitiesTo write an effective hadoop administrator job description, begin by listing detailed duties, responsibilities and expectations. We have included hadoop administrator job description templates that you can modify and use.Sample responsibilities for this position include:Leverage NoSQL, Hive, Sqoop, Flume, Yarn,...

  • Hadoop Administrator

    4 days ago

    Bengaluru, Karnataka, India Alp Consulting Limited Full time

    Hadoop Administrator Duties & Responsibilities To write an effective hadoop administrator job description, begin by listing detailed duties, responsibilities and expectations. We have included hadoop administrator job description templates that you can modify and use. Sample responsibilities for this position include: Leverage NoSQL, Hive, Sqoop, Flume,...

  • Hadoop Administrator

    4 days ago

    Bengaluru, Karnataka, India Triumph Ladders Full time

    Job Description:Role : Hadoop Administrator - Map RExp : 5 + YearsMapR/Hadoop Administrator.Primary Responsibilities: Experience in architecting, designing, installation, configuration and management of Apache Hadoop, MapR Distribution, Cloudera Distribution Platform(CDP) Administration, Installation, Configuration, Maintenance of different hadoop component...

  • Hadoop Administrator

    4 days ago

    Bengaluru, Karnataka, India Triumph Ladders Pvt. Ltd. Full time

    Job Description:Role: Hadoop AdministratorExperience: 5+ YearsNotice: 30 DaysLocation: BangalorePrimary Skills:- MapR + Exposure to Elastic Search Solid Understanding of Hadoop framework and its Ecosystem tools. Proficiency in installing Hadoop cluster and its related components. Proficiency in managing Hadoop cluster patching and upgrades. Capability to...

  • Hadoop Administrator

    4 days ago

    Bengaluru, Karnataka, India Triumph Ladders Pvt. Ltd. Full time

    Job Description : Role : Hadoop Admin Experience : 5+ Years Notice : 30 Days Location : Bangalore JD:Primary Skills MapR + Elastic Search exposure will work. Solid Knowledge on Hadoop framework and its Ecosystem tools. Expertise in installing Hadoop cluster and its related components. Expertise in managing Hadoop cluster patching and upgrades. Ability to...

  • Hadoop Administrator

    4 weeks ago

    Bengaluru, Karnataka, India Triumph Ladders Pvt. Ltd. Full time

    Job Description : Role : Hadoop Admin Experience : 5+ Years Notice : 30 Days Location : Bangalore JD: - Primary Skills - MapR + Elastic Search exposure will work. Solid Knowledge on Hadoop framework and its Eco-system tools. Expertise in installing Hadoop cluster and its related components. Expertise in managing Hadoop cluster patching and upgrades. Ability...

  • Hadoop Administrator

    3 hours ago

    Bengaluru, Karnataka, India Triumph Ladders Pvt. Ltd. Full time

    Job Description : Role : Hadoop Admin Experience : 5+ Years Notice : 30 Days Location : Bangalore JD: - Primary Skills - MapR + Elastic Search exposure will work. Solid Knowledge on Hadoop framework and its Eco-system tools. Expertise in installing Hadoop cluster and its related components. Expertise in managing Hadoop cluster patching and upgrades. Ability...

  • Hadoop Administrator

    3 weeks ago

    Bengaluru, India Triumph Ladders Full time

    **Job Description**: Role : Hadoop Administrator - Map R Exp : 5 + Years **MapR/Hadoop Administrator.** **Primary Responsibilities**: - Experience in architecting, designing, installation, configuration and management of Apache Hadoop, MapR Distribution, Cloudera Distribution Platform(CDP) - Administration, Installation, Configuration, Maintenance of...

  • Hadoop Cloudera Consultant

    4 days ago

    Bengaluru, Karnataka, India Anicalls (Pty) Ltd Full time

    Candidate should be able to:Monitor, troubleshoot, and escalate cluster issues using a variety of open source and proprietary toolsets.Design, deploy, automate, maintain and manage cloud-based or on-prem production systems, to ensure the availability, performance, scalability, and security of production systems.Work as part of an operational team and...

  • Big Data Hadoop Administrator

    2 months ago

    Bengaluru, India Bosch Group Full time

    Company Description **Bosch Global Software Technologies Private Limited** is a 100% owned subsidiary of Robert Bosch GmbH, one of the world's leading global supplier of technology and services, offering end-to-end Engineering, IT and Business Solutions. With over 22,700 associates, it’s the largest software development center of Bosch, outside Germany,...

  • Cloud Support Eng. I

    2 months ago

    Bengaluru, Karnataka, India AWS India - Karnataka Full time

    Bachelor’s degree OR equivalent experience in a technical position - Requires minimum of 2+ yrs experience on Hadoop/ML/Large Dataset handling with DB/DW experience - Advanced experience in Apache Hadoop, Apache Spark, Apache Hive, and Presto or ETL skills with working experience on Databases Oracle/SQL Server/ PostgreSQL/TerraData - Experience with...

  • Cloud Support Eng. I

    3 hours ago

    Bengaluru, Karnataka, India AWS India - Karnataka Full time

    Bachelor’s degree OR equivalent experience in a technical position - Requires minimum of 2+ yrs experience on Hadoop/ML/Large Dataset handling with DB/DW experience - Advanced experience in Apache Hadoop, Apache Spark, Apache Hive, and Presto or ETL skills with working experience on Databases Oracle/SQL Server/ PostgreSQL/TerraData - Experience with...

  • Hadoop Administrator

    3 weeks ago

    Bengaluru, India Triumph Ladders Pvt. Ltd. Full time

    Job Description :Role : Hadoop AdminExperience : 5+ YearsNotice : 30 DaysLocation : BangaloreJob Description :Primary Skills : - MapR + Elastic Search exposure will work.- Solid Knowledge on Hadoop framework and its Eco-system tools.- Expertise in installing Hadoop cluster and its related components.- Expertise in managing Hadoop cluster patching and...

  • Hadoop Administrator

    4 weeks ago

    Bengaluru, India Triumph Ladders Pvt. Ltd. Full time

    Job Description :Role : Hadoop AdminExperience : 5+ YearsNotice : 30 DaysLocation : BangaloreJob Description :Primary Skills : - MapR + Elastic Search exposure will work.- Solid Knowledge on Hadoop framework and its Eco-system tools.- Expertise in installing Hadoop cluster and its related components.- Expertise in managing Hadoop cluster patching and...

  • Hadoop Admin

    1 week ago

    Bengaluru, India NetConnect Global Full time

    Job description **Location**: Bangalore/Pune **Experience**: 8 - 12 Years **Type**: Work from Office **Salary**: 10- 25 LPA **Notice Period**: Immediate to 30 Days We are looking to hire a talented Hadoop Administrator to join our dynamic team at NetConnect Global. As a Hadoop Administrator, you will be responsible for installing, configuring, and...