Big Data Administrator

2 days ago

Gurgaon, India A2Z Finders Full time

**Need Spark Developer Certification (HDPCD) and HDP Certified Administrator (HDPCA) certified Hadoop Administrator (MANDATORY).**

**JOB RESPONSIBILITIES**
- **Installing Hadoop in Linux environment.**
- **Deployment in a Hadoop cluster and its maintenance.**
- Health check of a Hadoop cluster monitoring whether it is up and running all the time.
- **Analyse the storage data volume and allocating the space in HDFS.**
- Resource management in a cluster environment. This involves new node creation and removal of unused ones.
- Configuring Name Node to ensure its high availability
- Implementing and administering Hadoop infrastructure on an ongoing basis.
- Required hardware and software deployment in Hadoop environment, furthermore to expanding of existing environments.
- Software installation and its configuration.
- **Backup and recovery operation of Database.**
- Checking database connectivity and its security measurements.
- Performance monitoring and fine tuning on actual basis.
- Managing and optimizing disk space for handling data
- Installing patches and upgrading software as and when needed.
- Automate manual tasks for faster performance.
- A Hadoop administrator loads a large volume of data

SOME OTHER RESPONSIBILITIES INCLUDE
- User creation in Linux for Hadoop and its components in the ecosystem. Moreover, setting up Kerberos principals is a part of Hadoop administration.
- Performance tuning and running jobs in Hadoop clusters.
- Capacity planning
- Monitoring connectivity and security of Hadoop cluster
- Managing and reviewing log files in Hadoop.
- **Management of HDFS file system and monitoring them.**
- **Maintaining HDFS and providing necessary supports.**
- **Backup and recovery tasks.**
- Working as a key person for Vendor escalation

Additional Information

Required Qualification

Bachelor of Computer Science (B.Sc. (Computer Science))

  • Big Data Administrator

    2 weeks ago

    Gurgaon, India Green Arrow Career Services Full time

    **Location**: Gurugram **Experience**: 8 to 10 yrs **Notice Period: 0 to 15 days** **Mandatory Certifications**: - Spark Developer Certification (HDPCD) - HDP Certified Administrator (HDPCA) - Certified Hadoop Administrator **Responsibilities**: - Installing Hadoop in Linux environment. - Deployment in a Hadoop cluster and its maintenance. - Health...

  • Big Data Architect

    1 week ago

    Gurgaon, India Techfrolic Software Solutions Pvt. Ltd Full time

    **Job description** We are seeking a highly skilled and experienced Big Data Architect to join our team. As a Big Data Architect, you will be responsible for designing and implementing robust, scalable, and high-performance big data solutions that meet our client's diverse and complex requirements. Your expertise in big data technologies, data modeling, and...

  • Big Data Architect

    2 weeks ago

    Gurgaon, India Number Theory Software Pvt.Ltd Full time

    **Responsibilities**: - Evaluate and recommend Big Data technology stack best suited for NT AI at scale Platform and other products - Lead the team for defining proper Big Data Architecture Design. - Design and implement features on NT AI at scale platform using Spark and other Hadoop Stack components. - Drive significant technology initiatives end to end...

  • Big Data Tester

    2 weeks ago

    Gurgaon, Haryana, India Kezan Inc Full time ₹ 11,00,000 per year

    Big Data Tester (AWS + SQL) (Immediate joiner)Location:Gurugram / Bangalore (Hybrid)Experience:4–7 YearsBudget:Up to ₹11 LPAAbout the Role:We are looking for a skilled and detail-orientedBig Data Testerwith expertise inAWSandSQLto join our growing team. This role requires hands-on experience in data validation, test automation for big data pipelines, and...

  • Big Data Developer

    2 weeks ago

    Gurgaon, Haryana, India Intraedge Technologies Ltd. Full time

    Job Title : Big Data Developer (Java/Python)Location : Chennai, Bangalore, GurugramExperience Required : 5+ years (5 to 15 yrs)Joining : Immediate or Early Joiners PreferredEmployment Type : Full-timeJob Summary : We are looking for a passionate and experienced Big Data Developer with expertise in either Java or Python to join our dynamic team. The...

  • Big Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India Infogain Full time

    Posted on August 17 2024ROLES RESPONSIBILITIESBig Data Engineer Senior As a Big Data Engineer Senior you will be responsible for designing and implementing complex big data solutions You will work closely with clients and team members to understand their requirements and develop architectures that meet their needs You will also be responsible for...

  • Data Scientist/Big Data Engineer

    1 week ago

    Gurgaon, Haryana, India Techmora Full time

    Job Description : Data Science / Big Data EngineerLocation : Gurgaon / PuneEmployment Type : Full-timeNotice Period : 30 DaysExperience : 4-6 YearsAbout the Role :We are seeking a skilled Data Science / Big Data Engineer with strong expertise in data wrangling, large-scale data processing, and advanced analytics. The ideal candidate will have hands-on...

  • Big Data Architect

    2 weeks ago

    Gurgaon, India NMS Consultant Full time

    Required Skills (must have): - Strong Knowledges/hands-on experience about offers and features of Big data technologies (especially Hadoop, Hortonworks) - Strong experience of development using Spark Scala, Java, JavaScript, Nifi, Kafka, Hive, Hbase - Strong knowledge of API development - Strong knowledge of the java frameworks (Spring MVC, Spring...

  • Big Data Developer

    2 weeks ago

    Gurgaon, Haryana, India Kezan Inc Full time ₹ 16,90,000 per year

    Position: Big Data EngineerExperience: 5+ YearsLocation: ( Gurugram / Bangalore )Joining: Immediate JoinerBudget=16.5 LPAJob Summary:We're seeking an experienced Senior Big Data Engineer with 5+ years of experience in designing, developing, and implementing large-scale data systems using Redshift, AWS, Spark, and Scala. The ideal candidate will have...

  • Big Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India Idyllic Services Pvt Ltd Full time

    Job Title : Big Data Engineer - ScalaExperience : 7 to 10Years (Minimum 3+ years in Scala)Notice Period : Immediate to 30 DaysRole Overview : We are looking for a highly skilled Big Data Engineer (Scala) with strong expertise in Scala, Spark, Python, NiFi, and Apache Kafka to join our data engineering team. The ideal candidate will have a proven track...