Big Data Administrator

2 weeks ago

Gurgaon, India Green Arrow Career Services Full time

**Location**: Gurugram

**Experience**: 8 to 10 yrs

**Notice Period: 0 to 15 days**

**Mandatory Certifications**:

- Spark Developer Certification (HDPCD)
- HDP Certified Administrator (HDPCA)
- Certified Hadoop Administrator

**Responsibilities**:

- Installing Hadoop in Linux environment.
- Deployment in a Hadoop cluster and its maintenance.
- Health check of a Hadoop cluster monitoring whether it is up and running all the time.
- Analyse the storage data volume and allocating the space in HDFS.
- Resource management in a cluster environment. This involves new node creation and removal of unused ones.
- Configuring Name Node to ensure its high availability
- Implementing and administering Hadoop infrastructure on an ongoing basis.
- Required hardware and software deployment in Hadoop environment, furthermore to expanding of existing environments.
- Software installation and its configuration.
- Backup and recovery operation of Database.
- Checking database connectivity and its security measurements.
- Performance monitoring and fine tuning on actual basis.
- Managing and optimizing disk space for handling data
- Installing patches and upgrading software as and when needed.
- Automate manual tasks for faster performance.
- A Hadoop administrator loads a large volume of data

SOME OTHER RESPONSIBILITIES INCLUDE
- User creation in Linux for Hadoop and its components in the ecosystem. Moreover, setting up Kerberos principals is a part of Hadoop administration.
- Performance tuning and running jobs in Hadoop clusters.
- Capacity planning
- Monitoring connectivity and security of Hadoop cluster
- Managing and reviewing log files in Hadoop.
- Management of HDFS file system and monitoring them.
- Maintaining HDFS and providing necessary supports.
- Backup and recovery tasks.
- Working as a key person for Vendor escalation

**Job Types**: Full-time, Regular / Permanent

**Salary**: ₹2,400,000.00 - ₹3,000,000.00 per year

**Experience**:

- Big Data Administrator: 7 years (required)
- Big data: 8 years (required)

License/Certification:

- Spark Developer Certification (HDPCD) (required)
- HDP Certified Administrator (HDPCA) (required)

Work Location: One location

  • Big Data Administrator

    2 days ago

    Gurgaon, India A2Z Finders Full time

    **Need Spark Developer Certification (HDPCD) and HDP Certified Administrator (HDPCA) certified Hadoop Administrator (MANDATORY).** **JOB RESPONSIBILITIES** - **Installing Hadoop in Linux environment.** - **Deployment in a Hadoop cluster and its maintenance.** - Health check of a Hadoop cluster monitoring whether it is up and running all the time. -...

  • Big Data Architect

    2 weeks ago

    Gurgaon, India NMS Consultant Full time

    From 9 to 14 year(s) of experience ₹ Not Disclosed by Recruiter - Gurgaon/ Gurugram,Haryana Requires Skill: - Expertise on structured and unstructured data Architecture of big data technology like Hadoop, HDFS, HIVE and other open source tools which are part of Hadoop ecosystem Big Data use case analysis Knowledge of big data analytics RDBMS expertise -...

  • Big Data Architect

    7 days ago

    Gurgaon, India Techfrolic Software Solutions Pvt. Ltd Full time

    **Job description** We are seeking a highly skilled and experienced Big Data Architect to join our team. As a Big Data Architect, you will be responsible for designing and implementing robust, scalable, and high-performance big data solutions that meet our client's diverse and complex requirements. Your expertise in big data technologies, data modeling, and...

  • Big Data Architect

    2 weeks ago

    Gurgaon, India Number Theory Software Pvt.Ltd Full time

    **Responsibilities**: - Evaluate and recommend Big Data technology stack best suited for NT AI at scale Platform and other products - Lead the team for defining proper Big Data Architecture Design. - Design and implement features on NT AI at scale platform using Spark and other Hadoop Stack components. - Drive significant technology initiatives end to end...

  • GCP Big Data Engineer

    5 days ago

    Gurgaon, Haryana, India Acme Services Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    We are looking for GCP Big Data Engineer who has skill set with Big Query and Airflow

  • Big Data + Pharmacovigilance

    2 weeks ago

    Gurgaon, India Spectral Consultants Full time

    Bring PV & Safety domain knowledge to help identify top use cases that remain unsolved for clients - Identify opportunities in PV & safety to build assets that are common solutions for common business problems across clients (assets = frameworks or accelerators or products) - Ownership to ensure the proposed design/ architecture, deliverables meet the client...

  • Engineer - Big Data

    2 weeks ago

    Gurgaon, Haryana, India American Express Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    At American Express, our culture is built on a 175-year history of innovation, shared values and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. As part of Team Amex, you'll experience this powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new...

  • Engineer - Big Data

    2 weeks ago

    Gurgaon, Haryana, India American Express Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    At American Express, our culture is built on a 175-year history of innovation, shared values and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. As part of Team Amex, you'll experience this powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new...

  • Database Administrator

    2 weeks ago

    Gurgaon, Haryana, India MobiKwik Full time ₹ 40,00,000 - ₹ 1,20,00,000 per year

    Company DescriptionMobiKwik is India's leading FinTech platform, offering a wide range of financial products for consumers and merchants, including payments, digital credit, and investments. Leveraging big data analytics and deep data science, MobiKwik aims to build a world-class payments and credit product. Founded in 2009, the platform is trusted by over...

  • Senior Big Data Engineer

    5 days ago

    Gurgaon, Haryana, India dunnhumby Full time ₹ 8,00,000 - ₹ 13,00,000 per year

    dunnhumby is the global leader in Customer Data Science, empowering businesses everywhere to compete and thrive in the modern data-driven economy. We always put the Customer First.Our mission: to enable businesses to grow and reimagine themselves by becoming advocates and champions for their Customers. With deep heritage and expertise in retail – one of...