Aws Hadoop Administrator

5 months ago

Uttar Pradesh, India Valiance Analytics Full time

We are seeking a skilled AWS Hadoop Administrator to join our team and manage our Hadoop infrastructure on the AWS platform. In this role, you will be responsible for deploying, configuring, monitoring, and maintaining our Hadoop clusters to ensure optimal performance, scalability, and reliability. As an integral member of our IT operations team, you will collaborate closely with data engineers, developers, and other stakeholders to support our big data initiatives and ensure smooth operation of our data processing workflows.skills required: Hands-on experience on installation of Hadoop ecosystem on AWS such as EMR,S3,EC2,IAM policy, MWAA/Airflow,Hadoop,yarn,spark, Mlflow. Experience on Linux enviroment and bash scriptingResponsibilities: 1. Deploy and configure Hadoop clusters on the AWS cloud platform including MWAA,MLflow and Apache-Nifi, ensuring proper integration with related AWS services such as EC2, S3, EMR, and IAM.
2. Monitor Hadoop cluster performance, health, and resource utilization using monitoring tools and AWS CloudWatch, and proactively address any issues to maintain optimal performance.
3. Manage Hadoop cluster capacity, scaling resources up or down as needed to accommodate changing workload demands.
4. Implement and enforce security best practices for Hadoop clusters on AWS, including access control, encryption, and compliance with regulatory requirements.
5. Perform regular backups and disaster recovery procedures to ensure data integrity and minimize downtime.
6. Collaborate with data engineers and developers to optimize Hadoop jobs and data processing workflows for performance and efficiency.
7. Troubleshoot and resolve issues related to Hadoop cluster operation, performance, and data processing.
8. Stay current with advancements in Hadoop technology and AWS services, and evaluate and recommend new tools and techniques to enhance our big data infrastructure.
9. Document system configurations, procedures, and best practices, and provide training and support to other team members as needed.
10. Participate in on-call rotation and respond to incidents outside of regular business hours as necessary.Qualifications: 1. Bachelor's degree in computer science, engineering, or a related field, or equivalent work experience.
2. Proven experience as a Hadoop administrator, preferably in an AWS environment.
3. Strong understanding of Hadoop architecture, components, and ecosystem technologies such as HDFS, YARN, MapReduce, Hive, Spark, and Kafka.
4. Experience deploying and managing Hadoop clusters on AWS using services such as EMR, EC2, S3, and IAM.
5. Solid understanding of cloud computing principles and best practices, particularly in AWS.
6. Proficiency in Linux operating systems and shell scripting.
7. Strong analytical and problem-solving skills, with the ability to troubleshoot complex issues and drive them to resolution.
8. Excellent communication and collaboration skills, with the ability to work effectively in a team environment.
9. AWS certification(s) such as AWS Certified Solutions Architect or AWS Certified SysOps Administrator is a plus.
10. Experience with containerization technologies such as Docker and orchestration tools like Kubernetes is desirable.

  • Lead Hadoop Administrator

    2 days ago

    uttar pradesh, India ClearTrail Technologies Full time

    Job Title: Lead -Hadoop Technical SupportRole Big Data Infrastructure Implementation and SupportExperience: 8 to 12 years of experience in Big Data, Apache Hadoop System Implementation, and administration.Education: BE (IT/Computers), B.Tech, M.Tech, MCAWork Location: Riyadh, Saudi ArabiaCertifications: Apache Hadoop administration (Big Data Hadoop...

  • Lead Hadoop Administrator

    20 hours ago

    uttar pradesh, India ClearTrail Technologies Full time

    Job Title: Lead -Hadoop Technical Support Role Big Data Infrastructure Implementation and Support Experience: 8 to 12 years of experience in Big Data, Apache Hadoop System Implementation, and administration. Education: BE (IT/Computers), B.Tech, M.Tech, MCA Work Location: Riyadh, Saudi Arabia Certifications: Apache Hadoop administration [Big Data Hadoop...

  • Lead Hadoop Administrator

    16 hours ago

    uttar pradesh, India ClearTrail Technologies Full time

    Job Title: Lead -Hadoop Technical SupportRole Big Data Infrastructure Implementation and SupportExperience: 8 to 12 years of experience in Big Data, Apache Hadoop System Implementation, and administration.Education: BE (IT/Computers), B.Tech, M.Tech, MCAWork Location : Riyadh, Saudi ArabiaCertifications: Apache Hadoop administration (Big Data Hadoop...

  • Hadoop Administrator

    2 months ago

    Sector-128 Noida, Noida, Uttar Pradesh, India Intellioz Full time

    Job Description: Hadoop Administrator **Key Responsibilities**: - **Data Analysis**: - Analyse large datasets stored in Hadoop to extract meaningful insights and support decision-making. - Collaborate with stakeholders to understand data requirements and deliver actionable recommendations. - **Cluster Monitoring**: - Monitor the health, connectivity, and...

  • Hadoop Admin

    5 months ago

    Andhra Pradesh, India Virtusa Full time

    Hadoop Administrator 4+ years of administrator experience on Big Data Hadoop Ecosystem and related technologies (Sqoop, Hive, Pig, Flume) Prior experience with performance tuning, capacity planning, and workload mapping a plus Coding and developing in Hadoop 3+ years of strong Linux and Hadoop administration background in a production support setting is...

  • Aws Administrator

    4 weeks ago

    Maharishi Nagar, Noida, Uttar Pradesh, India Vgics Global Full time

    **AWS Administrator-** **Job Overview**: As AWS Administrator, you will be responsible for overseeing and managing the AWS infrastructure of our organization. You will play a crucial role in designing, implementing, and maintaining scalable, secure, and highly available cloud solutions. You will work closely with cross-functional teams to ensure that our...

  • AWS Engineer with Snowflake

    2 days ago

    madhya pradesh, India Innova ESI Full time

    Request you to help us with profiles for the following –•Experience Level: 5 to 7 years exp•Skill Area: Data engineering -•Main Technology: AWS Services, Snowflake, DBT•Mandatory Skills: (Must Have Skills) : Below•Optional Skills: (Good to Have Skills) : Below•Roles & Responsibilities:Mandatory Skills:•3 - 5 years of experience in AWS, Big...

  • Subject Matter Expert

    5 months ago

    Noida, Uttar Pradesh, India ThinkResource Infosolutions Full time

    Acts as the Subject Matter Expert (SME) for AWS cloud infrastructure within the Cloud Team. Experience in key AWS services EC2, Simple storage service(S3), Virtual private cloud (VPC), Auto-scaling, Security groups, Public/Private subnets, Route53, CloudFront, Snapshot, Direct Connect, NACL, Elastic Block Storage (EBS), Elastic Load Balancer (ELB) Internet...

  • Wintel + Aws Support

    5 months ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    **Req ID**: 269106 We are currently seeking a Wintel + AWS Support -T2 to join our team in Noida, Uttar Pradesh (IN-UP), India (IN). - Solid understanding of cloud computing, networking, and storage principles with focus on AWS Cloud Platform. Multi-cloud experience in Azure and/or GCP is preferred. - Expert Cloud administration, maintenance, and...

  • Cloud Administrator

    5 months ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    **Req ID**: 269113 We are currently seeking a Cloud Administrator - T2 to join our team in Noida, Uttar Pradesh (IN-UP), India (IN). - Possess proficient knowledge and hands-on experience in Cloud administration, encompassing maintenance and troubleshooting. - Demonstrate good familiarity with OS patching and proficiency in resolving server-related...

  • IT Administrator

    5 months ago

    Noida, Uttar Pradesh, India Fictivebox Media Full time

    **Skills and Qualifications**: **1. Technical Skills**: ○ Proficiency in server administration, including installation, configuration, and maintenance of server operating systems (e.g., Windows Server, Linux). ○ Knowledge of networking concepts, including TCP/IP, DNS, DHCP, VPN, and routing protocols. ○ Familiarity with virtualization technologies like...

  • Database Administrator

    2 months ago

    Lucknow, Uttar Pradesh, India Vexil Infotech private Limited Full time

    **Database Administrator (DBA)** **About Company** **Position**:Database Administrator (DBA) **Experience**: 2+ years **Location**: Lucknow **Job Type**: Full-time The DBA is responsible for the performance, integrity, and security of databases. This role involves the design, implementation, maintenance, and repair of database systems, ensuring that data...

  • IT Support

    5 months ago

    Noida, Uttar Pradesh, India Trusted Solutions Full time

    **Position: IT Support and Cloud Administrator** **Location: Sector - 63 Noida(Onsite)** **Position Overview**: We are seeking an experienced and knowledgeable IT Support and Cloud Administrator to join our team in Sector **Responsibilities**: **MS Cloud-Based Enterprise Application Administration**:(70% utilization) **Office 365**: - Manage Teams...

  • Wintel + Aws Support

    5 months ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    **Req ID**: 269108 We are currently seeking a Wintel + AWS Support -T2 to join our team in Noida, Uttar Pradesh (IN-UP), India (IN). - Solid understanding of cloud computing, networking, and storage principles with focus on AWS Cloud Platform. Multi-cloud experience in Azure and/or GCP is preferred. - Expert Cloud administration, maintenance, and...

  • Cloud Administrator

    5 months ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    We are currently seeking a Professional with AWS cloud expertise to join our team in Bangalore/Noida - Possess proficient knowledge and hands-on experience in Cloud administration, encompassing maintenance and troubleshooting. - Demonstrate good familiarity with OS patching and proficiency in resolving server-related issues. - Capable of participating in...

  • Java Aws Architect

    7 days ago

    Andhra Pradesh, India Virtusa Full time

    15 years of Architecting & Developing Experience working in Big Data Technologies using Apache, Hadoop, Spark & SQL etc. 5 years of strong Development/ Coding experience using Spark with Python Minimum 3 Years experience working on Databricks on AWS based Cloud Services 5 years of strong experience in Big Data design, modelling & Development such as star...

  • Aws/devops

    2 months ago

    Visakhapatnam, Andhra Pradesh, India TeksAcademy Full time

    Job Title: AWS Trainer Location: Vishakapatnam/Hyderabad Job Summary: Key Responsibilities: - Design and deliver comprehensive training programs on AWS topics - Develop training materials, including presentations, labs, and exercises - Stay up-to-date with AWS services and features - Evaluate training effectiveness and make improvements as needed - Work...

  • Aws DevOps

    5 months ago

    Andhra Pradesh, India Virtusa Full time

    P1-C2-TSTS Design cloud infrastructure/platform/services that is secure, scalable, and highly available on AWS. Build and maintain operational tools for CI/CD, monitoring, and analysis of AWS infrastructure and systems. Proficient in containerization technology and assist in administration and operation of container platform or container services such as...

  • IT Support and Cloud Administrator

    1 month ago

    Noida, Uttar Pradesh, India eTelligent Group Full time

    **Position: IT Support and Cloud Administrator** **Position Overview**: **Responsibilities**: **MS Cloud-Based Enterprise Application Administration**:(70% utilization) **Office 365**: - Manage Teams subscriptions and ensure appropriate license requirements, optimizing costs. - Administer O365 app licenses. - Conduct regular trainings to introduce new...

  • IT Support and Cloud Administrator

    5 months ago

    Noida, Uttar Pradesh, India eTelligent Group Full time

    **Position: IT Support and Cloud Administrator** **Position Overview**: **Responsibilities**: **MS Cloud-Based Enterprise Application Administration**:(70% utilization) **Office 365**: - Manage Teams subscriptions and ensure appropriate license requirements, optimizing costs. - Administer O365 app licenses. - Conduct regular trainings to introduce new...