Aws Hadoop Administrator

7 months ago

Uttar Pradesh, India Valiance Analytics Full time

We are seeking a skilled AWS Hadoop Administrator to join our team and manage our Hadoop infrastructure on the AWS platform. In this role, you will be responsible for deploying, configuring, monitoring, and maintaining our Hadoop clusters to ensure optimal performance, scalability, and reliability. As an integral member of our IT operations team, you will collaborate closely with data engineers, developers, and other stakeholders to support our big data initiatives and ensure smooth operation of our data processing workflows.skills required: Hands-on experience on installation of Hadoop ecosystem on AWS such as EMR,S3,EC2,IAM policy, MWAA/Airflow,Hadoop,yarn,spark, Mlflow. Experience on Linux enviroment and bash scriptingResponsibilities: 1. Deploy and configure Hadoop clusters on the AWS cloud platform including MWAA,MLflow and Apache-Nifi, ensuring proper integration with related AWS services such as EC2, S3, EMR, and IAM.
2. Monitor Hadoop cluster performance, health, and resource utilization using monitoring tools and AWS CloudWatch, and proactively address any issues to maintain optimal performance.
3. Manage Hadoop cluster capacity, scaling resources up or down as needed to accommodate changing workload demands.
4. Implement and enforce security best practices for Hadoop clusters on AWS, including access control, encryption, and compliance with regulatory requirements.
5. Perform regular backups and disaster recovery procedures to ensure data integrity and minimize downtime.
6. Collaborate with data engineers and developers to optimize Hadoop jobs and data processing workflows for performance and efficiency.
7. Troubleshoot and resolve issues related to Hadoop cluster operation, performance, and data processing.
8. Stay current with advancements in Hadoop technology and AWS services, and evaluate and recommend new tools and techniques to enhance our big data infrastructure.
9. Document system configurations, procedures, and best practices, and provide training and support to other team members as needed.
10. Participate in on-call rotation and respond to incidents outside of regular business hours as necessary.Qualifications: 1. Bachelor's degree in computer science, engineering, or a related field, or equivalent work experience.
2. Proven experience as a Hadoop administrator, preferably in an AWS environment.
3. Strong understanding of Hadoop architecture, components, and ecosystem technologies such as HDFS, YARN, MapReduce, Hive, Spark, and Kafka.
4. Experience deploying and managing Hadoop clusters on AWS using services such as EMR, EC2, S3, and IAM.
5. Solid understanding of cloud computing principles and best practices, particularly in AWS.
6. Proficiency in Linux operating systems and shell scripting.
7. Strong analytical and problem-solving skills, with the ability to troubleshoot complex issues and drive them to resolution.
8. Excellent communication and collaboration skills, with the ability to work effectively in a team environment.
9. AWS certification(s) such as AWS Certified Solutions Architect or AWS Certified SysOps Administrator is a plus.
10. Experience with containerization technologies such as Docker and orchestration tools like Kubernetes is desirable.

  • Hadoop Administrator

    4 months ago

    Sector-128 Noida, Noida, Uttar Pradesh, India Intellioz Full time

    Job Description: Hadoop Administrator **Key Responsibilities**: - **Data Analysis**: - Analyse large datasets stored in Hadoop to extract meaningful insights and support decision-making. - Collaborate with stakeholders to understand data requirements and deliver actionable recommendations. - **Cluster Monitoring**: - Monitor the health, connectivity, and...

  • Aws Redshift Database Administrator

    2 months ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    **Req ID**: 305843 We are currently seeking a AWS Redshift Database Administrator to join our team in NOIDA, Uttar Pradesh (IN-UP), India (IN). **Job Title: AWS Redshift Database Administrator** **Job Overview**: This position may require on-call availability and might require working during non-business hours and on weekends in case of emergencies or...

  • Subject Matter Expert

    7 months ago

    Noida, Uttar Pradesh, India ThinkResource Infosolutions Full time

    Acts as the Subject Matter Expert (SME) for AWS cloud infrastructure within the Cloud Team. Experience in key AWS services EC2, Simple storage service(S3), Virtual private cloud (VPC), Auto-scaling, Security groups, Public/Private subnets, Route53, CloudFront, Snapshot, Direct Connect, NACL, Elastic Block Storage (EBS), Elastic Load Balancer (ELB) Internet...

  • Wintel + Aws Support

    7 months ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    **Req ID**: 269106 We are currently seeking a Wintel + AWS Support -T2 to join our team in Noida, Uttar Pradesh (IN-UP), India (IN). - Solid understanding of cloud computing, networking, and storage principles with focus on AWS Cloud Platform. Multi-cloud experience in Azure and/or GCP is preferred. - Expert Cloud administration, maintenance, and...

  • Cloud Administrator

    7 months ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    **Req ID**: 269113 We are currently seeking a Cloud Administrator - T2 to join our team in Noida, Uttar Pradesh (IN-UP), India (IN). - Possess proficient knowledge and hands-on experience in Cloud administration, encompassing maintenance and troubleshooting. - Demonstrate good familiarity with OS patching and proficiency in resolving server-related...

  • Aws/devops

    4 months ago

    Visakhapatnam, Andhra Pradesh, India TeksAcademy Full time

    Job Title: AWS Trainer Location: Vishakapatnam/Hyderabad Job Summary: Key Responsibilities: - Design and deliver comprehensive training programs on AWS topics - Develop training materials, including presentations, labs, and exercises - Stay up-to-date with AWS services and features - Evaluate training effectiveness and make improvements as needed - Work...

  • Wintel + Aws Support

    7 months ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    **Req ID**: 269108 We are currently seeking a Wintel + AWS Support -T2 to join our team in Noida, Uttar Pradesh (IN-UP), India (IN). - Solid understanding of cloud computing, networking, and storage principles with focus on AWS Cloud Platform. Multi-cloud experience in Azure and/or GCP is preferred. - Expert Cloud administration, maintenance, and...

  • Java Aws Architect

    3 months ago

    Andhra Pradesh, India Virtusa Full time

    15 years of Architecting & Developing Experience working in Big Data Technologies using Apache, Hadoop, Spark & SQL etc. 5 years of strong Development/ Coding experience using Spark with Python Minimum 3 Years experience working on Databricks on AWS based Cloud Services 5 years of strong experience in Big Data design, modelling & Development such as star...

  • IT Support

    7 months ago

    Noida, Uttar Pradesh, India Trusted Solutions Full time

    **Position: IT Support and Cloud Administrator** **Location: Sector - 63 Noida(Onsite)** **Position Overview**: We are seeking an experienced and knowledgeable IT Support and Cloud Administrator to join our team in Sector **Responsibilities**: **MS Cloud-Based Enterprise Application Administration**:(70% utilization) **Office 365**: - Manage Teams...

  • Aws DevOps

    7 months ago

    Andhra Pradesh, India Virtusa Full time

    P1-C2-TSTS Design cloud infrastructure/platform/services that is secure, scalable, and highly available on AWS. Build and maintain operational tools for CI/CD, monitoring, and analysis of AWS infrastructure and systems. Proficient in containerization technology and assist in administration and operation of container platform or container services such as...

  • Cloud Administrator

    7 months ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    We are currently seeking a Professional with AWS cloud expertise to join our team in Bangalore/Noida - Possess proficient knowledge and hands-on experience in Cloud administration, encompassing maintenance and troubleshooting. - Demonstrate good familiarity with OS patching and proficiency in resolving server-related issues. - Capable of participating in...

  • PureSoftware Ltd | Database Administrator

    2 weeks ago

    uttar pradesh, India PureSoftware Ltd Full time

    PureSoftware is one of the fastest growing software products and services companies that delivers a differentiated customer experience, accelerates cycle times and helps customers achieve business outcomes through the adoption of new-age digital technologies and integrating them with their existing systems.Job Description:Experience- 4+ YearsPostgreSQL...

  • IT Support and Cloud Administrator

    4 months ago

    Noida, Uttar Pradesh, India eTelligent Group Full time

    **Position: IT Support and Cloud Administrator** **Position Overview**: **Responsibilities**: **MS Cloud-Based Enterprise Application Administration**:(70% utilization) **Office 365**: - Manage Teams subscriptions and ensure appropriate license requirements, optimizing costs. - Administer O365 app licenses. - Conduct regular trainings to introduce new...

  • Software Engineer

    2 months ago

    uttar pradesh, India Intellicus Technologies Full time

    IntellicusIntellicus is a Big Data BI & Analytics Product company. We simplify the exploration, analysis and visualization of big data for world's largest companies. We are the first company to innovate OLAP on Big Data.Intellicus is a provider of BI and Analytics products to Fortune 500 companies for more than a decade. It has created a footprint of over...

  • Gamemano | Linux System Administrator | uttar pradesh

    1 month ago

    uttar pradesh, India Gamemano Full time

    Job Description: Linux System AdministratorPosition Overview:We are looking for a skilled Linux System Administrator with a strong background in maintaining production servers. The ideal candidate will manage servers running Node.js and NGINX, ensuring high availability, performance, and security. Familiarity with Bash scripting for automation tasks is...

  • Intellicus Technologies | Data Engineer

    7 days ago

    uttar pradesh, India Intellicus Technologies Full time

    Experience: 3-7 yearsJob Location: Noida/Indore/BangaloreQualification:- Experience in writing and troubleshooting SQL or MDX queries.- Proficient in database design techniques and data modeling.- Proven hands-on experience in designing, developing, and supporting Database projects for analysis.- Good written and verbal communication skills.- Knowledge...

  • Intellicus Technologies | Data Engineer

    2 weeks ago

    uttar pradesh, India Intellicus Technologies Full time

    Experience: 3-7 yearsJob Location: Noida/Indore/BangaloreQualification:Experience in writing and troubleshooting SQL or MDX queries.Proficient in database design techniques and data modeling.Proven hands-on experience in designing, developing, and supporting Database projects for analysis.Good written and verbal communication skills.Knowledge and/or...

  • Database Administrator Iv

    7 months ago

    Noida, Uttar Pradesh, India Transaction Network Services Full time

    An extraordinarily talented group of individuals work together every day to drive TNS' success, from both professional and personal perspectives. Come join the excellence! Overview The DBA is responsible for support, maintenance, and development of the TNS’s databases which support wide verity of TNS products. This DBA should have the experience in...

  • Systems Administrator

    6 days ago

    Uttar Pradesh, India Kyndryl Full time

    Who We Are Kyndryl is a market leader that thinks and acts like a start-up. We design, build, manage, and modernize the mission-critical technology systems that the world depends on every day. So why work at Kyndryl? We are always moving forward - always pushing ourselves to go further in our efforts to build a more equitable, inclusive world for our...

  • Vistec Partners | Data Engineer | uttar pradesh

    2 months ago

    uttar pradesh, India Vistec Partners Full time

    We are looking for candidates who can start immediately. Candidates who can commence work immediately will be given priority.Pay range and annual compensation - (Between 11 Lakhs to 12 Lakhs) (Non - Negotiable)Key Responsibilities:Design and Build Data Pipelines: Develop and maintain scalable data pipelines for extracting, transforming, and loading (ETL)...