Big Data Administrator
1 month ago
As a Big Data Admin, you will play a crucial role in ensuring the smooth operation and optimization of our Hadoop and Spark infrastructure. Your responsibilities will include :
Hadoop Installation and Deployment :
- Install Hadoop in Linux environments.
- Deploy and maintain Hadoop clusters.
- Monitor cluster health to ensure continuous uptime.
- Analyze storage data volume and allocate space in HDFS.
- Manage cluster resources, including node creation and removal.
- Configure NameNode for high availability.
Hadoop Administration :
- Implement and administer Hadoop infrastructure on an ongoing basis.
- Deploy and configure required hardware and software.
- Expand existing Hadoop environments.
- Install and configure software components.
- Perform database backup, recovery, and security measures.
- Monitor and optimize database performance.
- Manage and optimize disk space for data handling.
- Install patches and upgrade software as needed.
- Automate manual tasks for improved :
- 7+ years of experience as a Big Data Admin.
- In-depth knowledge of Hadoop and Spark ecosystems.
- Strong Linux administration skills.
- Experience with distributed file systems (HDFS).
- Familiarity with big data tools and technologies (Hive, Pig, Impala, etc.).
- Understanding of data warehousing and data modeling concepts.
- Excellent problem-solving and analytical skills.
- Ability to work independently and as part of a team.
Preferred Qualifications :
- Experience with cloud platforms (AWS, GCP, Azure).
- Knowledge of scripting languages (Python, Bash).
- Certification in Hadoop or Spark.
-
Hadoop Administrator
5 months ago
Mumbai/Bangalore/Bhubaneshwar/Anywhere in India/Multiple Locations, IN Tehno Right Full timeJob Role : Hadoop Administrator (Role open for multiple locations) - WFH and WFOJob description :What is your Role ?- You will manage Hadoop clusters, data storage, server resources, and other virtual computing platforms. - You perform a variety of functions, including data migration, virtual machine set-up and training, troubleshooting end-user problems,...
-
Data Strategist
1 month ago
Gurgaon/Gurugram, IN PrimeJobs Management Consultants Pvt Ltd Full timeWe're looking for a talented Data Strategist to join our EdTech client's UK team.Job Description :Key Responsibilities :- Lead data architecture and ensure seamless integration across platforms.- Develop and execute data strategies aligned with business objectives.- Collaborate with cross-functional teams to establish data governance and security.-...
-
Big Data Developer
1 month ago
Gurgaon/Gurugram, IN Spectral Consultants – Search & Recruitment firm Full timeSALARY : Description :We are looking for an experienced Big Data Developer with a strong background in building scalable and efficient data pipelines. The ideal candidate should have hands-on experience with Hive, Spark, Hadoop, and MapReduce, and possess strong programming skills in Python, Java, or ScalaKey Responsibilities : - Develop and maintain...
-
Big Data Developer
1 month ago
Gurgaon/Gurugram, IN PRONTO CONSULTING SERVICES Full timeClient : LTI Mindtree Hybrid.Type : Fulltime Employment. Location : Gurgaon Only.NP : Serving the NP and can join within 60 days Only. Job Description : Skills : Big Data : Spark, Hive, Python, SQL. Location : Gurgaon Key Responsibilities : - Responsible for designing Data Engineering solutions on bigdata ecosystem developing custom applications and...
-
Data Engineer
1 month ago
Bangalore/Pune/Trivandrum/Thiruvananthapuram, IN Rao Career Solutions Full timeJob Summary :- We are looking for a skilled Data Engineer with hands-on experience in PySpark and Big Data platforms to join our growing team. The ideal candidate will have strong expertise in building data pipelines, working with big data technologies like Apache Hive and Parquet, and handling diverse data use cases. You will work closely with data...
-
Big Data Developer
1 month ago
Pune/Gurgaon/Gurugram, IN Talent Toppers LLP Full timeResponsibilities :- Undertake complete ownership in accomplishing activities and assigned responsibilities across all phases of project lifecycle to solve business problems across one or more client engagements;- Apply appropriate development methodologies (e.g.: agile, waterfall) and best practices (e.g.: mid-development client reviews, embedded QA...
-
Big Data Engineer
1 month ago
Chennai/Noida/Gurgaon/Gurugram/Mumbai, IN ANRI Solutions HR Services Full timeRole : Big Data Engineer Looking for an experienced Spark and Scala developer able to create an end-to-end data pipeline.Associate should be self-driven, can work with minimal guidance and guide the team technically. Job Details : 1. Expertise in Spark framework with scala language and Pyspark 2. Expertise in ETL and Data Warehousing and cloud concepts 3....
-
NITS Solutions
1 month ago
Gurgaon/Gurugram, IN NITS Solutions Full timePosition Overview :We are looking for an Associate Big Data Engineer with hands-on experience on Python, SQL,POSTGRESQL with Basic understanding of Pandas, Pyspark and ETL process. The individual will be responsible to create solutions suitable for the job in a real-time, highly data-driven organization and make technical innovations happen.Job...
-
Big Data Developer
1 month ago
Hyderabad/Bangalore/Chennai/Bhubaneshwar, IN Rigel networks Full timeJob Title : Big Data/Spark Scala DeveloperLocation : Type : Full-TimeJob Overview : We are looking for an experienced Big Data/Spark Scala Developer to join our team. The ideal candidate will have a deep understanding of big data technologies and strong programming skills in Scala. In this role, you will be responsible for designing, developing, and...
-
Senior Big Data Engineer
3 weeks ago
Mumbai/Pune/Kolkata/Delhi/Nagpur/Ahmedabad, IN AEXONIC TECHNOLOGIES PRIVATE LIMITED Full timePosition - Senior Big Data Engineer (GCP)Experience - 5 to 8 YrsLocation - RemoteShift - EST Shift 5:30 PM to 2:30 AMWe are seeking a highly skilled Senior Big Data Engineer with extensive experience in Big Data technologies, including Hadoop, Hive, PySpark, and expertise in Google Cloud Platform (GCP) and BigQuery. The successful candidate will be...
-
Big Data Engineer
1 month ago
Chennai/Hyderabad/Bangalore/Coimbatore/Mumbai/Delhi/Pune, IN GAIUS HYPERLOCAL PRIVATE LIMITED Full timeJob Description : Big Data Engineer - Scala, SparkYears of exp: 6 to 13 yearsJob location: Chennai / Hyderabad / Bangalore / Pune / Mumbai / Delhi / CoimbatoreAbout the Role :We are seeking a highly skilled Big Data Engineer to join our team and help us leverage the power of big data to drive innovation and business value. As a Big Data Engineer, you will be...
-
Big Data Engineer
1 month ago
Bangalore/Pune/Mumbai/Chennai, IN a client of change leaders Full timeJob Description : - 5+ years of experience developing scalable Big Data applications or solutions on distributed platforms- Design and implement data pipelines using Snowflake, PostgreSQL, and Python.- Experience in AWS/ Azure/ GCP and good to have other cloud platform tools- Experience working with Big Data platforms, including Hadoop- Hive, Data Bricks...
-
Azimuth GRC
1 month ago
Gurgaon/Gurugram, IN AzimuthGRC Technologies India Private Limited Full timeJob Description :- Conceptualize and communicate Data architecture strategy, technical design and technology roadmap for data platform solutions and services.- Lead design and development of data architecture to support implementation of large-scale data solutions in Databricks to support multiple use cases (delta lake, cloud Datawarehouse migrations,...
-
Data Engineer
1 month ago
Gurgaon/Gurugram, IN Paddlelift Full timeJob Description :You will work closely with the data analytics team to analyze and interpret data, develop data visualizations, and assist in data-driven decision-making processes. This includes collecting and cleaning data, conducting data analysis using statistical software, and creating reports and presentations to communicate insights.Requirements : -...
-
Informatica Administrator
1 month ago
Bangalore/Gurgaon/Gurugram, IN OMEGA HIRES CONSULTANCY Full timeJob Description :We are seeking a skilled Informatica Administrator with experience in platform migration and upgrade activities. The ideal candidate will have a strong background in Informatica administration and Linux server administration.Key Responsibilities :- Manage and maintain the Informatica platform, ensuring optimal performance and availability-...
-
SAS Developer
4 weeks ago
Gurgaon/Gurugram, IN Elite recruitments Full timeJob Opportunity for SAS DI Developers with global consulting firm. Location : Gurgaon. As a SAS DI Developer, you will be responsible for designing, developing, and managing the data integration processes using SAS Data Integration Studio. You will work closely with business analysts, data architects, and other team members to build efficient data pipelines,...
-
ZS - Engineering Lead - Big Data
1 month ago
Pune/Gurgaon/Gurugram/Bangalore, IN ZS Full timeComapany Description :ZS is a place where passion changes lives. As a management consulting and technology firm focused on transforming global healthcare and beyond, our most valuable asset is our people. Here you'll work side-by-side with a powerful collective of thinkers and experts shZS is a place where passion changes lives. As a management...
-
Big Data Team Lead
1 month ago
Bangalore/Chennai/Pune, IN Rigel networks Full timeJob Title : Senior Software Developer / Applications Development ManagerLocation : Pune, Chennai, Bangalore Shift Timings : 10 AM - 7 PMPosition Overview : We are seeking an experienced Senior Software Developer / Applications Development Manager with a strong background in software development and project management. The ideal candidate will possess...
-
Big Data Engineer
6 months ago
Rajasthan/Karnataka/Metros/Jaipur/Udaipur/Bangalore/Raipur, IN ATech Full timeHiring For Big Data Engineer (Spark, Scala, AWS)Job description :- Spark, SCALA, AWS OR Spark, python with AWS lambda exposure.- Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements.- Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing...
-
Senior Azure Data Engineer
1 month ago
Gurgaon/Gurugram, IN Gallop Research Full timeRoles and Responsibilities : - Build ETL & data pipelines using Azure Data Factory & Databricks to help feed the data into data products/dashboards. - Automate processes and workflows to drive efficiencies for client. - Liaise with different stakeholders on ad-hoc analyses and monitor the entire DWH/Data Lake. - Working with stakeholders to gather...