See more Collapse

Aws Hadoop Administrator

1 month ago

Uttar Pradesh, India Valiance Analytics Full time

We are seeking a skilled AWS Hadoop Administrator to join our team and manage our Hadoop infrastructure on the AWS platform. In this role, you will be responsible for deploying, configuring, monitoring, and maintaining our Hadoop clusters to ensure optimal performance, scalability, and reliability. As an integral member of our IT operations team, you will collaborate closely with data engineers, developers, and other stakeholders to support our big data initiatives and ensure smooth operation of our data processing workflows.skills required: Hands-on experience on installation of Hadoop ecosystem on AWS such as EMR,S3,EC2,IAM policy, MWAA/Airflow,Hadoop,yarn,spark, Mlflow. Experience on Linux enviroment and bash scriptingResponsibilities: 1. Deploy and configure Hadoop clusters on the AWS cloud platform including MWAA,MLflow and Apache-Nifi, ensuring proper integration with related AWS services such as EC2, S3, EMR, and IAM.
2. Monitor Hadoop cluster performance, health, and resource utilization using monitoring tools and AWS CloudWatch, and proactively address any issues to maintain optimal performance.
3. Manage Hadoop cluster capacity, scaling resources up or down as needed to accommodate changing workload demands.
4. Implement and enforce security best practices for Hadoop clusters on AWS, including access control, encryption, and compliance with regulatory requirements.
5. Perform regular backups and disaster recovery procedures to ensure data integrity and minimize downtime.
6. Collaborate with data engineers and developers to optimize Hadoop jobs and data processing workflows for performance and efficiency.
7. Troubleshoot and resolve issues related to Hadoop cluster operation, performance, and data processing.
8. Stay current with advancements in Hadoop technology and AWS services, and evaluate and recommend new tools and techniques to enhance our big data infrastructure.
9. Document system configurations, procedures, and best practices, and provide training and support to other team members as needed.
10. Participate in on-call rotation and respond to incidents outside of regular business hours as necessary.Qualifications: 1. Bachelor's degree in computer science, engineering, or a related field, or equivalent work experience.
2. Proven experience as a Hadoop administrator, preferably in an AWS environment.
3. Strong understanding of Hadoop architecture, components, and ecosystem technologies such as HDFS, YARN, MapReduce, Hive, Spark, and Kafka.
4. Experience deploying and managing Hadoop clusters on AWS using services such as EMR, EC2, S3, and IAM.
5. Solid understanding of cloud computing principles and best practices, particularly in AWS.
6. Proficiency in Linux operating systems and shell scripting.
7. Strong analytical and problem-solving skills, with the ability to troubleshoot complex issues and drive them to resolution.
8. Excellent communication and collaboration skills, with the ability to work effectively in a team environment.
9. AWS certification(s) such as AWS Certified Solutions Architect or AWS Certified SysOps Administrator is a plus.
10. Experience with containerization technologies such as Docker and orchestration tools like Kubernetes is desirable.

We have other current jobs related to this field that you can find below

  • Hadoop Admin

    3 weeks ago

    Andhra Pradesh, India Virtusa Full time

    Hadoop Administrator 4+ years of administrator experience on Big Data Hadoop Ecosystem and related technologies (Sqoop, Hive, Pig, Flume) Prior experience with performance tuning, capacity planning, and workload mapping a plus Coding and developing in Hadoop 3+ years of strong Linux and Hadoop administration background in a production support setting is...

  • Hadoop Admin

    4 days ago

    Andhra Pradesh, India Virtusa Full time

    Hadoop Administrator4+ years of administrator experience on Big Data Hadoop Ecosystem and related technologies (Sqoop, Hive, Pig, Flume)Prior experience with performance tuning, capacity planning, and workload mapping a plusCoding and developing in Hadoop3+ years of strong Linux and Hadoop administration background in a production support setting is...

  • MarkLogic Administrator

    3 weeks ago

    uttar pradesh, India HCLTech Full time

    MarkLogic AdministratorNoidaExp: 5+ YearsTo succeed in this role, the candidate should have a broad set of MarkLogic NoSQL technology skills to be able to design, build, and support robust NoSQL solutions and learn quickly as the industry growsStrong knowledge of NoSQL technologies interacts and complementDeep understanding of internals of NoSQL...

  • MarkLogic Administrator

    1 month ago

    uttar pradesh, India HCLTech Full time

    MarkLogic AdministratorNoidaExp: 5+ YearsTo succeed in this role, the candidate should have a broad set of MarkLogic NoSQL technology skills to be able to design, build, and support robust NoSQL solutions and learn quickly as the industry growsStrong knowledge of NoSQL technologies interacts and complementDeep understanding of internals of NoSQL...

  • Big Data Infrastructure Implementation and Support

    5 days ago

    uttar pradesh, India Impetus Full time

    Job Title: Lead - Professional ServicesRole Big Data Infrastructure Implementation and SupportExperience: 8 to 12 years of experience in Big Data, Apache Hadoop System Implementation, and administration.Education: BE (IT/Computers), B.Tech, M.Tech, MCAWork Location: Riyadh, Saudi ArabiaCertifications: Apache Hadoop administration (Big Data Hadoop...

  • AWS Cloud Engineer

    4 weeks ago

    uttar pradesh, India Intellect Design Arena Ltd Full time

    We are looking to hire a seasoned AWS Cloud Engineer for Noida and Mumbai location; Ideal candidate will have minimum 4+ years of experience.POSITION: AWS Cloud EngineerEXPERIENCE (IN YEARS):4-10YrsROLE TYPE: Full timeLOCATION: NoidaWHAT YOU WILL DO:Job Description:We are seeking an experienced AWS Engineer to join our dynamic team. The ideal candidate will...

  • AWS Cloud Engineer

    3 weeks ago

    uttar pradesh, India Intellect Design Arena Ltd Full time

    We are looking to hire a seasoned AWS Cloud Engineer for Noida and Mumbai location; Ideal candidate will have minimum 4+ years of experience.POSITION: AWS Cloud EngineerEXPERIENCE (IN YEARS):4-10YrsROLE TYPE: Full timeLOCATION: NoidaWHAT YOU WILL DO:Job Description:We are seeking an experienced AWS Engineer to join our dynamic team. The ideal candidate will...

  • Python Developer + Data Engineer Role

    4 weeks ago

    uttar pradesh, India Capgemini Engineering Full time

    URGENT OPENING- Python cum Data engineer role - CAPGEMINI- FULL TIME- PAN INDIAInterested candidates reach me out through below email idKindly share below mandatory details.NameCurrent EmployerNotice Period : Mention the LWD if you are serving notice period or else Official Notice PeriodExperienceRelevant ExperienceCTCECTCCurrent LocationPls attach Updated...

  • Python Developer + Data Engineer Role

    3 weeks ago

    uttar pradesh, India Capgemini Engineering Full time

    URGENT OPENING- Python cum Data engineer role - CAPGEMINI- FULL TIME- PAN INDIAInterested candidates reach me out through below email idKindly share below mandatory details.NameCurrent EmployerNotice Period : Mention the LWD if you are serving notice period or else Official Notice PeriodExperienceRelevant ExperienceCTCECTCCurrent LocationPls attach Updated...

  • Subject Matter Expert

    2 months ago

    Noida, Uttar Pradesh, India ThinkResource Infosolutions Full time

    Acts as the Subject Matter Expert (SME) for AWS cloud infrastructure within the Cloud Team. Experience in key AWS services EC2, Simple storage service(S3), Virtual private cloud (VPC), Auto-scaling, Security groups, Public/Private subnets, Route53, CloudFront, Snapshot, Direct Connect, NACL, Elastic Block Storage (EBS), Elastic Load Balancer (ELB) Internet...

  • Subject Matter Expert

    4 hours ago

    Noida, Uttar Pradesh, India ThinkResource Infosolutions Full time

    Acts as the Subject Matter Expert (SME) for AWS cloud infrastructure within the Cloud Team. Experience in key AWS services EC2, Simple storage service(S3), Virtual private cloud (VPC), Auto-scaling, Security groups, Public/Private subnets, Route53, CloudFront, Snapshot, Direct Connect, NACL, Elastic Block Storage (EBS), Elastic Load Balancer (ELB) Internet...

  • Cloud Administrator

    5 days ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    **Req ID**: 269113 We are currently seeking a Cloud Administrator - T2 to join our team in Noida, Uttar Pradesh (IN-UP), India (IN). - Possess proficient knowledge and hands-on experience in Cloud administration, encompassing maintenance and troubleshooting. - Demonstrate good familiarity with OS patching and proficiency in resolving server-related...

  • Wintel + Aws Support

    5 days ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    **Req ID**: 269106 We are currently seeking a Wintel + AWS Support -T2 to join our team in Noida, Uttar Pradesh (IN-UP), India (IN). - Solid understanding of cloud computing, networking, and storage principles with focus on AWS Cloud Platform. Multi-cloud experience in Azure and/or GCP is preferred. - Expert Cloud administration, maintenance, and...

  • IT Administrator

    5 days ago

    Noida, Uttar Pradesh, India Fictivebox Media Full time

    **Skills and Qualifications**: **1. Technical Skills**: ○ Proficiency in server administration, including installation, configuration, and maintenance of server operating systems (e.g., Windows Server, Linux). ○ Knowledge of networking concepts, including TCP/IP, DNS, DHCP, VPN, and routing protocols. ○ Familiarity with virtualization technologies like...

  • IT Support

    2 weeks ago

    Noida, Uttar Pradesh, India Trusted Solutions Full time

    **Position: IT Support and Cloud Administrator** **Location: Sector - 63 Noida(Onsite)** **Position Overview**: We are seeking an experienced and knowledgeable IT Support and Cloud Administrator to join our team in Sector **Responsibilities**: **MS Cloud-Based Enterprise Application Administration**:(70% utilization) **Office 365**: - Manage Teams...

  • Wintel + Aws Support

    7 days ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    **Req ID**: 269108 We are currently seeking a Wintel + AWS Support -T2 to join our team in Noida, Uttar Pradesh (IN-UP), India (IN). - Solid understanding of cloud computing, networking, and storage principles with focus on AWS Cloud Platform. Multi-cloud experience in Azure and/or GCP is preferred. - Expert Cloud administration, maintenance, and...

  • Cloud Administrator

    4 days ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    We are currently seeking a Professional with AWS cloud expertise to join our team in Bangalore/Noida - Possess proficient knowledge and hands-on experience in Cloud administration, encompassing maintenance and troubleshooting. - Demonstrate good familiarity with OS patching and proficiency in resolving server-related issues. - Capable of participating in...

  • Database Administrator

    3 weeks ago

    uttar pradesh, India Daxko Full time

    Company DescriptionDaxko powers health & wellness throughout the world. Every day our team members focus their passion and expertise in helping health & wellness facilities operate efficiently and engage their members.Whether a neighborhood yoga studio, a national franchise with locations in every city, a YMCA or JCC--and every type of organization in...

  • Database Administrator

    3 weeks ago

    uttar pradesh, India Daxko Full time

    Company DescriptionDaxko powers health & wellness throughout the world. Every day our team members focus their passion and expertise in helping health & wellness facilities operate efficiently and engage their members.Whether a neighborhood yoga studio, a national franchise with locations in every city, a YMCA or JCC--and every type of organization in...

  • ETL Developer

    3 weeks ago

    uttar pradesh, India Parallel Team Full time

    Job DescriptionsWork experience in SQLWorking experience on ETL tools with experience on Pentaho Data Integration, Informatica, Talend, Alteryx(anyone)Good to have experience in Data modelling, data mapping, and data conversion/migration Added AdvantageUnderstanding of Big Data/No SQL databases like Hadoop, MongoDB, Snowflake, PostGreShould have experience...