Big Data Administrator
7 months ago
**Location**: Gurugram
**Experience**: 8 to 10 yrs
**Notice Period: 0 to 15 days**
**Mandatory Certifications**:
- Spark Developer Certification (HDPCD)
- HDP Certified Administrator (HDPCA)
- Certified Hadoop Administrator
**Responsibilities**:
- Installing Hadoop in Linux environment.
- Deployment in a Hadoop cluster and its maintenance.
- Health check of a Hadoop cluster monitoring whether it is up and running all the time.
- Analyse the storage data volume and allocating the space in HDFS.
- Resource management in a cluster environment. This involves new node creation and removal of unused ones.
- Configuring Name Node to ensure its high availability
- Implementing and administering Hadoop infrastructure on an ongoing basis.
- Required hardware and software deployment in Hadoop environment, furthermore to expanding of existing environments.
- Software installation and its configuration.
- Backup and recovery operation of Database.
- Checking database connectivity and its security measurements.
- Performance monitoring and fine tuning on actual basis.
- Managing and optimizing disk space for handling data
- Installing patches and upgrading software as and when needed.
- Automate manual tasks for faster performance.
- A Hadoop administrator loads a large volume of data
SOME OTHER RESPONSIBILITIES INCLUDE
- User creation in Linux for Hadoop and its components in the ecosystem. Moreover, setting up Kerberos principals is a part of Hadoop administration.
- Performance tuning and running jobs in Hadoop clusters.
- Capacity planning
- Monitoring connectivity and security of Hadoop cluster
- Managing and reviewing log files in Hadoop.
- Management of HDFS file system and monitoring them.
- Maintaining HDFS and providing necessary supports.
- Backup and recovery tasks.
- Working as a key person for Vendor escalation
**Job Types**: Full-time, Regular / Permanent
**Salary**: ₹2,400,000.00 - ₹3,000,000.00 per year
**Experience**:
- Big Data Administrator: 7 years (required)
- Big data: 8 years (required)
License/Certification:
- Spark Developer Certification (HDPCD) (required)
- HDP Certified Administrator (HDPCA) (required)
Work Location: One location
-
Big Data Architect
7 months ago
Gurgaon, India NMS Consultant Full timeFrom 9 to 14 year(s) of experience ₹ Not Disclosed by Recruiter - Gurgaon/ Gurugram,Haryana Requires Skill: - Expertise on structured and unstructured data Architecture of big data technology like Hadoop, HDFS, HIVE and other open source tools which are part of Hadoop ecosystem Big Data use case analysis Knowledge of big data analytics RDBMS expertise -...
-
Big Data Administrator
1 month ago
Bangalore/Gurgaon/Gurugram/Nagpur, India Intuitive Apps Full timeAs a Big Data Admin, you will play a crucial role in ensuring the smooth operation and optimization of our Hadoop and Spark infrastructure. Your responsibilities will include : Hadoop Installation and Deployment : - Install Hadoop in Linux environments. - Deploy and maintain Hadoop clusters. - Monitor cluster health to ensure continuous uptime. -...
-
Big Data Developer
2 weeks ago
Gurgaon, Haryana, India Material Full timeJob Description: We are looking for a highly skilled Big Data Developer to join our team at Material. The ideal candidate will have extensive experience with big data technologies such as Hadoop, Spark, and Hive, as well as programming languages like Java, Python, and Scala.As a Big Data Developer, you will be responsible for designing and developing big...
-
Big Data Architect
7 months ago
Gurgaon, India Techfrolic Software Solutions Pvt. Ltd Full time**Job description** We are seeking a highly skilled and experienced Big Data Architect to join our team. As a Big Data Architect, you will be responsible for designing and implementing robust, scalable, and high-performance big data solutions that meet our client's diverse and complex requirements. Your expertise in big data technologies, data modeling, and...
-
Big Data Architect
3 weeks ago
Gurgaon, Haryana, India DEUTSCHE TELEKOM DIGITAL LABS PRIVATE LIMITED Full timeJob Title: Big Data ArchitectWe are seeking an experienced Big Data Architect to join our team at Deutsche Telekom Digital Labs Private Limited. As a Senior Hadoop Engineer, you will design and implement scalable big data solutions using Hadoop-based technologies along with AWS. Your primary responsibilities include designing and implementing various big...
-
Big Data Architect
6 days ago
Gurgaon, India Number Theory Software Pvt.Ltd Full time**Responsibilities**: - Evaluate and recommend Big Data technology stack best suited for NT AI at scale Platform and other products - Lead the team for defining proper Big Data Architecture Design. - Design and implement features on NT AI at scale platform using Spark and other Hadoop Stack components. - Drive significant technology initiatives end to end...
-
Big Data Architect
3 weeks ago
Gurgaon, Haryana, India DEUTSCHE TELEKOM DIGITAL LABS PRIVATE LIMITED Full timeJob SummaryWe are seeking a highly skilled Data Engineer to join our team at Deutsche Telekom Digital Labs Private Limited. The successful candidate will be responsible for designing and implementing big data solutions using Hadoop-based technologies, including AWS.About the RoleDesign and implement various big data platform components, including batch...
-
Big data developer
2 months ago
Gurgaon, India Impetus Full timeLocation: Indore, Pune, Noida, Gurugram Experience: 4- 8 years Description: We are looking for Big Data Developer having minimum experience of 4 year in big data ecosystem, passionate about technology, motivated for continuous learning and an individual who views every client interaction as an opportunity to create an exceptional customer experience....
-
Big Data Developer
2 months ago
Gurgaon, India Impetus Full timeLocation: Indore, Pune, Noida, GurugramExperience: 4- 8 yearsDescription:We are looking for Big Data Developer having minimum experience of 4 year in big data ecosystem, passionate about technology, motivated for continuous learning and an individual who views every client interaction as an opportunity to create an exceptional customer...
-
Big Data Architect
7 months ago
Gurgaon, India NMS Consultant Full timeRequired Skills (must have): - Strong Knowledges/hands-on experience about offers and features of Big data technologies (especially Hadoop, Hortonworks) - Strong experience of development using Spark Scala, Java, JavaScript, Nifi, Kafka, Hive, Hbase - Strong knowledge of API development - Strong knowledge of the java frameworks (Spring MVC, Spring...
-
Big data developer
2 months ago
Gurgaon, India Impetus Full timeLocation: Indore, Pune, Noida, GurugramExperience: 4- 8 yearsDescription:We are looking for Big Data Developer having minimum experience of 4 year in big data ecosystem, passionate about technology, motivated for continuous learning and an individual who views every client interaction as an opportunity to create an exceptional customer...
-
Big Data Developer
2 months ago
gurgaon, India Impetus Full timeLocation: Indore, Pune, Noida, GurugramExperience: 4- 8 yearsDescription:We are looking for Big Data Developer having minimum experience of 4 year in big data ecosystem, passionate about technology, motivated for continuous learning and an individual who views every client interaction as an opportunity to create an exceptional customer...
-
Data Scientist
4 weeks ago
Gurgaon, Haryana, India Impetus Full timeWe are seeking a highly skilled Data Scientist - Big Data Expert to join our team at Impetus.About the RoleThis is an exciting opportunity for a seasoned professional with extensive experience in big data technologies. As a Data Scientist - Big Data Expert, you will play a crucial role in developing efficient ETL pipelines, performing integration testing,...
-
Data Architect
4 weeks ago
Gurgaon, Haryana, India Impetus Full timeJob SummaryWe are seeking a skilled Data Architect - Big Data Engineer to join our team at Impetus. As a key member of our data engineering team, you will design, develop, and implement efficient ETL pipelines using big data technologies.About the RoleDevelop scalable and secure data pipelines using Hadoop, Hive, and PySpark.Collaborate with cross-functional...
-
Big Data Solutions Developer
2 weeks ago
Gurgaon, Haryana, India IT Source Global Full time**Job Overview:** IT Source Global is seeking a highly skilled Data Engineer to join our team. The successful candidate will have a strong background in data engineering with a focus on big data technologies. You will be responsible for designing, implementing, and maintaining large-scale data systems using GCP services such as BigQuery, Cloud Storage,...
-
Big Data Engineer
3 weeks ago
Gurgaon, Haryana, India IGT Solutions Full timeData Engineer Position:We're seeking a highly skilled Big Data Engineer to join our data engineering team. The ideal candidate will have over 8 years of hands-on experience designing, architecting, and implementing robust ETL pipelines using technologies such as Python, PySpark, PLSQL, Snowflake, and AWS.Main Responsibilities:Design and develop...
-
Big Data Solutions Architect
3 weeks ago
Gurgaon, Haryana, India SMARTWORK IT SERVICES Full timeJob Overview:At SMARTWORK IT SERVICES, we are looking for a highly skilled Big Data Solutions Architect to lead our team in designing and implementing cutting-edge data processing solutions using Google Cloud Platform (GCP) technologies. As a key member of our team, you will be responsible for selecting and integrating big data tools and frameworks,...
-
Senior Big Data Specialist
3 weeks ago
Gurgaon, Haryana, India DEUTSCHE TELEKOM DIGITAL LABS PRIVATE LIMITED Full timeAbout our Ideal Candidate:">We are looking for a motivated and experienced data engineer who can lead our team in delivering high-quality big data solutions. The ideal candidate should have a strong background in big data engineering, excellent problem-solving skills, and the ability to work effectively in a collaborative environment.
-
Big Data Analytics Expert
3 weeks ago
Gurgaon, Haryana, India Populace World Solution Full timeJob Title: Big Data DeveloperWe are looking for a skilled Big Data Developer to join our team at Populace World Solution. As a key member of our technology group, you will be responsible for designing, developing, and maintaining large-scale data processing systems.About the Role:Design and develop scalable data processing architectures using Apache Spark,...
-
Big Data Solutions Developer
1 month ago
Gurgaon, Haryana, India Aays Full timeAbout UsAays is a cutting-edge company at the forefront of innovation, dedicated to harnessing the power of data to drive business growth.Salary and BenefitsWe offer an attractive salary range of $120,000 - $180,000 per annum, along with a comprehensive benefits package that includes health insurance, retirement plans, and generous paid time off.Job...