Aws Hadoop Administrator

2 days ago

Uttar Pradesh, India Valiance Analytics Full time

We are seeking a skilled AWS Hadoop Administrator to join our team and manage our Hadoop infrastructure on the AWS platform. In this role, you will be responsible for deploying, configuring, monitoring, and maintaining our Hadoop clusters to ensure optimal performance, scalability, and reliability. As an integral member of our IT operations team, you will collaborate closely with data engineers, developers, and other stakeholders to support our big data initiatives and ensure smooth operation of our data processing workflows.skills required: Hands-on experience on installation of Hadoop ecosystem on AWS such as EMR,S3,EC2,IAM policy, MWAA/Airflow,Hadoop,yarn,spark, Mlflow. Experience on Linux enviroment and bash scriptingResponsibilities: 1. Deploy and configure Hadoop clusters on the AWS cloud platform including MWAA,MLflow and Apache-Nifi, ensuring proper integration with related AWS services such as EC2, S3, EMR, and IAM.
2. Monitor Hadoop cluster performance, health, and resource utilization using monitoring tools and AWS CloudWatch, and proactively address any issues to maintain optimal performance.
3. Manage Hadoop cluster capacity, scaling resources up or down as needed to accommodate changing workload demands.
4. Implement and enforce security best practices for Hadoop clusters on AWS, including access control, encryption, and compliance with regulatory requirements.
5. Perform regular backups and disaster recovery procedures to ensure data integrity and minimize downtime.
6. Collaborate with data engineers and developers to optimize Hadoop jobs and data processing workflows for performance and efficiency.
7. Troubleshoot and resolve issues related to Hadoop cluster operation, performance, and data processing.
8. Stay current with advancements in Hadoop technology and AWS services, and evaluate and recommend new tools and techniques to enhance our big data infrastructure.
9. Document system configurations, procedures, and best practices, and provide training and support to other team members as needed.
10. Participate in on-call rotation and respond to incidents outside of regular business hours as necessary.Qualifications: 1. Bachelor's degree in computer science, engineering, or a related field, or equivalent work experience.
2. Proven experience as a Hadoop administrator, preferably in an AWS environment.
3. Strong understanding of Hadoop architecture, components, and ecosystem technologies such as HDFS, YARN, MapReduce, Hive, Spark, and Kafka.
4. Experience deploying and managing Hadoop clusters on AWS using services such as EMR, EC2, S3, and IAM.
5. Solid understanding of cloud computing principles and best practices, particularly in AWS.
6. Proficiency in Linux operating systems and shell scripting.
7. Strong analytical and problem-solving skills, with the ability to troubleshoot complex issues and drive them to resolution.
8. Excellent communication and collaboration skills, with the ability to work effectively in a team environment.
9. AWS certification(s) such as AWS Certified Solutions Architect or AWS Certified SysOps Administrator is a plus.
10. Experience with containerization technologies such as Docker and orchestration tools like Kubernetes is desirable.

  • Aws Redshift Database Administrator

    9 hours ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    **Req ID**: 305843 We are currently seeking a AWS Redshift Database Administrator to join our team in NOIDA, Uttar Pradesh (IN-UP), India (IN). **Job Title: AWS Redshift Database Administrator** **Job Overview**: This position may require on-call availability and might require working during non-business hours and on weekends in case of emergencies or...

  • AWS Data Engineer

    2 weeks ago

    uttar pradesh, India Coforge Full time

    Role - AWS Data EngineerSkills - AWS & PySparkJob Locations - Pune, Greater Noida & HyderabadExperience - 6+ years We at Coforge are hiring AWS Data Engineers with the following skill-set:Design, develop, and maintain robust ETL/ELT pipelines using tools like Apache Spark, Airflow, or similar.Build and optimize data architectures (data lakes, data...

  • AWS Tester

    2 days ago

    Andhra Pradesh, India Virtusa Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role : AWS TesterWe are looking for a highly skilled Automation QA Engineer with hands-on experience in AWS and Big Data ecosystems to join our Quality Engineering team. The ideal candidate will be responsible for developing automated test frameworks and validating large-scale data processing pipelines in cloud-based environments. This role requires strong...

  • Aws Hiring

    2 weeks ago

    Noida, Uttar Pradesh, India Cognizant Full time

    **Job Summary** **Responsibilities** Strong knowledge in AWS Linux Administration Windows server Operations hands on experience in Python RStudio Linux commands. Experience in GitHub CICD AWS Deploy and validate bug fixes hot fixes patches Identify and implement process an system improvements Have knowledge and understanding of experiments sections and...

  • IT Administrator

    9 hours ago

    Noida, Uttar Pradesh, India HikeQA Full time

    We're Hiring: IT Administrator (Full-time) Location: Noida 63 We’re looking for a proactive and detail-oriented IT Administrator to manage and support our organization's IT infrastructure and ensure smooth technical operations. **Required Skills & Qualifications**: 1. 2+ years of experience in IT support and system administration. 2. Strong knowledge...

  • Wintel + Aws Support

    9 hours ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    **Req ID**: 269106 We are currently seeking a Wintel + AWS Support -T2 to join our team in Noida, Uttar Pradesh (IN-UP), India (IN). - Solid understanding of cloud computing, networking, and storage principles with focus on AWS Cloud Platform. Multi-cloud experience in Azure and/or GCP is preferred. - Expert Cloud administration, maintenance, and...

  • Cloud Administrator

    9 hours ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    **Req ID**: 269113 We are currently seeking a Cloud Administrator - T2 to join our team in Noida, Uttar Pradesh (IN-UP), India (IN). - Possess proficient knowledge and hands-on experience in Cloud administration, encompassing maintenance and troubleshooting. - Demonstrate good familiarity with OS patching and proficiency in resolving server-related...

  • Gitlab Administrator

    2 days ago

    Noida, Uttar Pradesh, India Sopra Steria Full time

    Company Description **About Sopra Steria** Sopra Steria, major Tech player in Europe recognised for its consulting, digital services and software development, helps its clients drive their digital transformation and obtain tangible and sustainable benefits. It provides end-to-end solutions to make large companies and organisations more competitive by...

  • Aws Devsecops Engineer Github

    2 weeks ago

    Noida, Uttar Pradesh, India Arrow Electronics Full time

    Position AWS DevSecOps Engineer Github Responsibilities Work on end-to-end migration of large-scale repositories from AWS CodeCommit and Gitlab to GitHub Enterprise ensuring history preservation access control mapping and zero data loss Establish and enforce enterprise Git standards including branching strategies commit policies rebasing...

  • Database Administrator

    24 hours ago

    uttar pradesh, India BIG Language Solutions Full time

    Job descriptionJob Title: Database Administrator (DBA)Experience Required: 5-8 yearsLocation: Noida(Work From Office)Employment Type: Full-TimeShift: US Shift(6PM-3AM IST)About the RoleWe are seeking a skilled and proactive Database Administrator (DBA) with 5-8 years of hands-on experience to join our growing technology team. In this role, you will be...