Big Data Administrator

2 days ago

Gurgaon, India A2Z Finders Full time

**Need Spark Developer Certification (HDPCD) and HDP Certified Administrator (HDPCA) certified Hadoop Administrator (MANDATORY).**

**JOB RESPONSIBILITIES**
- **Installing Hadoop in Linux environment.**
- **Deployment in a Hadoop cluster and its maintenance.**
- Health check of a Hadoop cluster monitoring whether it is up and running all the time.
- **Analyse the storage data volume and allocating the space in HDFS.**
- Resource management in a cluster environment. This involves new node creation and removal of unused ones.
- Configuring Name Node to ensure its high availability
- Implementing and administering Hadoop infrastructure on an ongoing basis.
- Required hardware and software deployment in Hadoop environment, furthermore to expanding of existing environments.
- Software installation and its configuration.
- **Backup and recovery operation of Database.**
- Checking database connectivity and its security measurements.
- Performance monitoring and fine tuning on actual basis.
- Managing and optimizing disk space for handling data
- Installing patches and upgrading software as and when needed.
- Automate manual tasks for faster performance.
- A Hadoop administrator loads a large volume of data

SOME OTHER RESPONSIBILITIES INCLUDE
- User creation in Linux for Hadoop and its components in the ecosystem. Moreover, setting up Kerberos principals is a part of Hadoop administration.
- Performance tuning and running jobs in Hadoop clusters.
- Capacity planning
- Monitoring connectivity and security of Hadoop cluster
- Managing and reviewing log files in Hadoop.
- **Management of HDFS file system and monitoring them.**
- **Maintaining HDFS and providing necessary supports.**
- **Backup and recovery tasks.**
- Working as a key person for Vendor escalation

Additional Information

Required Qualification

Bachelor of Computer Science (B.Sc. (Computer Science))

  • Big Data Administrator

    2 weeks ago

    Gurgaon, India Green Arrow Career Services Full time

    **Location**: Gurugram **Experience**: 8 to 10 yrs **Notice Period: 0 to 15 days** **Mandatory Certifications**: - Spark Developer Certification (HDPCD) - HDP Certified Administrator (HDPCA) - Certified Hadoop Administrator **Responsibilities**: - Installing Hadoop in Linux environment. - Deployment in a Hadoop cluster and its maintenance. - Health...

  • Big Data Architect

    1 week ago

    Gurgaon, India Techfrolic Software Solutions Pvt. Ltd Full time

    **Job description** We are seeking a highly skilled and experienced Big Data Architect to join our team. As a Big Data Architect, you will be responsible for designing and implementing robust, scalable, and high-performance big data solutions that meet our client's diverse and complex requirements. Your expertise in big data technologies, data modeling, and...

  • Big Data Architect

    2 weeks ago

    Gurgaon, India Number Theory Software Pvt.Ltd Full time

    **Responsibilities**: - Evaluate and recommend Big Data technology stack best suited for NT AI at scale Platform and other products - Lead the team for defining proper Big Data Architecture Design. - Design and implement features on NT AI at scale platform using Spark and other Hadoop Stack components. - Drive significant technology initiatives end to end...

  • Big Data Developer

    2 hours ago

    Gurgaon, Haryana, India Viraaj HR Solutions Private Limited Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    About The OpportunityA staffing and HR services firm focused on placing talent into Enterprise IT, Analytics, and Big Data engineering projects across Banking, Retail, Telecom, and SaaS sectors. We partner with product and services organisations to deliver scalable data platforms, real-time analytics, and high-throughput ETL solutions.We are hiring an...

  • GCP Big Data Engineer

    5 days ago

    Gurgaon, Haryana, India Acme Services Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    We are looking for GCP Big Data Engineer who has skill set with Big Query and Airflow

  • Big Data Automation QA

    4 hours ago

    Gurgaon, Haryana, India Xcel HR Solutions Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Responsibilities: Develop and automate processes for gathering of expected results from data sources and comparing data results from testing.Assist with the development and maintenance of smoke, performance, functional, and regression tests to ensure code is functioning as designed.Work with the team to understand how changes in the DL affect maintenance of...

  • Big Data + Pharmacovigilance

    2 weeks ago

    Gurgaon, India Spectral Consultants Full time

    Bring PV & Safety domain knowledge to help identify top use cases that remain unsolved for clients - Identify opportunities in PV & safety to build assets that are common solutions for common business problems across clients (assets = frameworks or accelerators or products) - Ownership to ensure the proposed design/ architecture, deliverables meet the client...

  • Big Data Engineer

    2 hours ago

    Gurgaon, Haryana, India MyCareernet Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Company:Indian / Global Digital OrganizationKey Skills:Pyspark, AWS, Python, SCALA, ETLRoles and Responsibilities:Develop and deploy ETL and data warehousing solutions using Python libraries and Linux bash scripts on AWS EC2, with data stored in Redshift.Collaborate with product and analytics teams to scope business needs, design metrics, and build...

  • Big Data Engineer

    8 hours ago

    Gurgaon, Haryana, India Qcentrio Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    Notice Period : Immediate - 30 days Mandatory Skills : Big Data, Python, SQL, Spark/Pyspark, AWS Cloud JD and required Skills & Responsibilities : Actively participate in all phases of the software development lifecycle, including requirements gathering, functional and technical design, development, testing, roll-out, and support. Solve complex...

  • Engineer - Data Management / Big Data

    31 minutes ago

    Gurgaon, Haryana, India American Express Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    At American Express, our culture is built on a 175-year history of innovation, shared values and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. As part of Team Amex, you'll experience this powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new...