Big Data Administrator

7 months ago


Gurgaon, India Green Arrow Career Services Full time

**Location**: Gurugram

**Experience**: 8 to 10 yrs

**Notice Period: 0 to 15 days**

**Mandatory Certifications**:

- Spark Developer Certification (HDPCD)
- HDP Certified Administrator (HDPCA)
- Certified Hadoop Administrator

**Responsibilities**:

- Installing Hadoop in Linux environment.
- Deployment in a Hadoop cluster and its maintenance.
- Health check of a Hadoop cluster monitoring whether it is up and running all the time.
- Analyse the storage data volume and allocating the space in HDFS.
- Resource management in a cluster environment. This involves new node creation and removal of unused ones.
- Configuring Name Node to ensure its high availability
- Implementing and administering Hadoop infrastructure on an ongoing basis.
- Required hardware and software deployment in Hadoop environment, furthermore to expanding of existing environments.
- Software installation and its configuration.
- Backup and recovery operation of Database.
- Checking database connectivity and its security measurements.
- Performance monitoring and fine tuning on actual basis.
- Managing and optimizing disk space for handling data
- Installing patches and upgrading software as and when needed.
- Automate manual tasks for faster performance.
- A Hadoop administrator loads a large volume of data

SOME OTHER RESPONSIBILITIES INCLUDE
- User creation in Linux for Hadoop and its components in the ecosystem. Moreover, setting up Kerberos principals is a part of Hadoop administration.
- Performance tuning and running jobs in Hadoop clusters.
- Capacity planning
- Monitoring connectivity and security of Hadoop cluster
- Managing and reviewing log files in Hadoop.
- Management of HDFS file system and monitoring them.
- Maintaining HDFS and providing necessary supports.
- Backup and recovery tasks.
- Working as a key person for Vendor escalation

**Job Types**: Full-time, Regular / Permanent

**Salary**: ₹2,400,000.00 - ₹3,000,000.00 per year

**Experience**:

- Big Data Administrator: 7 years (required)
- Big data: 8 years (required)

License/Certification:

- Spark Developer Certification (HDPCD) (required)
- HDP Certified Administrator (HDPCA) (required)

Work Location: One location


  • Big Data Architect

    7 months ago


    Gurgaon, India NMS Consultant Full time

    From 9 to 14 year(s) of experience ₹ Not Disclosed by Recruiter - Gurgaon/ Gurugram,Haryana Requires Skill: - Expertise on structured and unstructured data Architecture of big data technology like Hadoop, HDFS, HIVE and other open source tools which are part of Hadoop ecosystem Big Data use case analysis Knowledge of big data analytics RDBMS expertise -...


  • Bangalore/Gurgaon/Gurugram/Nagpur, India Intuitive Apps Full time

    As a Big Data Admin, you will play a crucial role in ensuring the smooth operation and optimization of our Hadoop and Spark infrastructure. Your responsibilities will include : Hadoop Installation and Deployment : - Install Hadoop in Linux environments. - Deploy and maintain Hadoop clusters. - Monitor cluster health to ensure continuous uptime. -...

  • Big Data Developer

    2 weeks ago


    Gurgaon, Haryana, India Material Full time

    Job Description: We are looking for a highly skilled Big Data Developer to join our team at Material. The ideal candidate will have extensive experience with big data technologies such as Hadoop, Spark, and Hive, as well as programming languages like Java, Python, and Scala.As a Big Data Developer, you will be responsible for designing and developing big...

  • Big Data Architect

    7 months ago


    Gurgaon, India Techfrolic Software Solutions Pvt. Ltd Full time

    **Job description** We are seeking a highly skilled and experienced Big Data Architect to join our team. As a Big Data Architect, you will be responsible for designing and implementing robust, scalable, and high-performance big data solutions that meet our client's diverse and complex requirements. Your expertise in big data technologies, data modeling, and...

  • Big Data Architect

    3 weeks ago


    Gurgaon, Haryana, India DEUTSCHE TELEKOM DIGITAL LABS PRIVATE LIMITED Full time

    Job Title: Big Data ArchitectWe are seeking an experienced Big Data Architect to join our team at Deutsche Telekom Digital Labs Private Limited. As a Senior Hadoop Engineer, you will design and implement scalable big data solutions using Hadoop-based technologies along with AWS. Your primary responsibilities include designing and implementing various big...

  • Big Data Architect

    6 days ago


    Gurgaon, India Number Theory Software Pvt.Ltd Full time

    **Responsibilities**: - Evaluate and recommend Big Data technology stack best suited for NT AI at scale Platform and other products - Lead the team for defining proper Big Data Architecture Design. - Design and implement features on NT AI at scale platform using Spark and other Hadoop Stack components. - Drive significant technology initiatives end to end...

  • Big Data Architect

    3 weeks ago


    Gurgaon, Haryana, India DEUTSCHE TELEKOM DIGITAL LABS PRIVATE LIMITED Full time

    Job SummaryWe are seeking a highly skilled Data Engineer to join our team at Deutsche Telekom Digital Labs Private Limited. The successful candidate will be responsible for designing and implementing big data solutions using Hadoop-based technologies, including AWS.About the RoleDesign and implement various big data platform components, including batch...

  • Big data developer

    2 months ago


    Gurgaon, India Impetus Full time

    Location: Indore, Pune, Noida, Gurugram Experience: 4- 8 years Description: We are looking for Big Data Developer having minimum experience of 4 year in big data ecosystem, passionate about technology, motivated for continuous learning and an individual who views every client interaction as an opportunity to create an exceptional customer experience....

  • Big Data Developer

    2 months ago


    Gurgaon, India Impetus Full time

    Location: Indore, Pune, Noida, GurugramExperience: 4- 8 yearsDescription:We are looking for Big Data Developer having minimum experience of 4 year in big data ecosystem, passionate about technology, motivated for continuous learning and an individual who views every client interaction as an opportunity to create an exceptional customer...

  • Big Data Architect

    7 months ago


    Gurgaon, India NMS Consultant Full time

    Required Skills (must have): - Strong Knowledges/hands-on experience about offers and features of Big data technologies (especially Hadoop, Hortonworks) - Strong experience of development using Spark Scala, Java, JavaScript, Nifi, Kafka, Hive, Hbase - Strong knowledge of API development - Strong knowledge of the java frameworks (Spring MVC, Spring...

  • Big data developer

    2 months ago


    Gurgaon, India Impetus Full time

    Location: Indore, Pune, Noida, GurugramExperience: 4- 8 yearsDescription:We are looking for Big Data Developer having minimum experience of 4 year in big data ecosystem, passionate about technology, motivated for continuous learning and an individual who views every client interaction as an opportunity to create an exceptional customer...

  • Big Data Developer

    2 months ago


    gurgaon, India Impetus Full time

    Location: Indore, Pune, Noida, GurugramExperience: 4- 8 yearsDescription:We are looking for Big Data Developer having minimum experience of 4 year in big data ecosystem, passionate about technology, motivated for continuous learning and an individual who views every client interaction as an opportunity to create an exceptional customer...

  • Data Scientist

    4 weeks ago


    Gurgaon, Haryana, India Impetus Full time

    We are seeking a highly skilled Data Scientist - Big Data Expert to join our team at Impetus.About the RoleThis is an exciting opportunity for a seasoned professional with extensive experience in big data technologies. As a Data Scientist - Big Data Expert, you will play a crucial role in developing efficient ETL pipelines, performing integration testing,...

  • Data Architect

    4 weeks ago


    Gurgaon, Haryana, India Impetus Full time

    Job SummaryWe are seeking a skilled Data Architect - Big Data Engineer to join our team at Impetus. As a key member of our data engineering team, you will design, develop, and implement efficient ETL pipelines using big data technologies.About the RoleDevelop scalable and secure data pipelines using Hadoop, Hive, and PySpark.Collaborate with cross-functional...


  • Gurgaon, Haryana, India IT Source Global Full time

    **Job Overview:** IT Source Global is seeking a highly skilled Data Engineer to join our team. The successful candidate will have a strong background in data engineering with a focus on big data technologies. You will be responsible for designing, implementing, and maintaining large-scale data systems using GCP services such as BigQuery, Cloud Storage,...

  • Big Data Engineer

    3 weeks ago


    Gurgaon, Haryana, India IGT Solutions Full time

    Data Engineer Position:We're seeking a highly skilled Big Data Engineer to join our data engineering team. The ideal candidate will have over 8 years of hands-on experience designing, architecting, and implementing robust ETL pipelines using technologies such as Python, PySpark, PLSQL, Snowflake, and AWS.Main Responsibilities:Design and develop...


  • Gurgaon, Haryana, India SMARTWORK IT SERVICES Full time

    Job Overview:At SMARTWORK IT SERVICES, we are looking for a highly skilled Big Data Solutions Architect to lead our team in designing and implementing cutting-edge data processing solutions using Google Cloud Platform (GCP) technologies. As a key member of our team, you will be responsible for selecting and integrating big data tools and frameworks,...


  • Gurgaon, Haryana, India DEUTSCHE TELEKOM DIGITAL LABS PRIVATE LIMITED Full time

    About our Ideal Candidate:">We are looking for a motivated and experienced data engineer who can lead our team in delivering high-quality big data solutions. The ideal candidate should have a strong background in big data engineering, excellent problem-solving skills, and the ability to work effectively in a collaborative environment.


  • Gurgaon, Haryana, India Populace World Solution Full time

    Job Title: Big Data DeveloperWe are looking for a skilled Big Data Developer to join our team at Populace World Solution. As a key member of our technology group, you will be responsible for designing, developing, and maintaining large-scale data processing systems.About the Role:Design and develop scalable data processing architectures using Apache Spark,...


  • Gurgaon, Haryana, India Aays Full time

    About UsAays is a cutting-edge company at the forefront of innovation, dedicated to harnessing the power of data to drive business growth.Salary and BenefitsWe offer an attractive salary range of $120,000 - $180,000 per annum, along with a comprehensive benefits package that includes health insurance, retirement plans, and generous paid time off.Job...