Big Data Hadoop Cluster Specialist

21 hours ago


India Smartavya Analytica Private Limited Full time

We are seeking an experienced Big Data Hadoop Cluster Specialist to manage and support our large-scale Hadoop ecosystem in Mumbai. The ideal candidate will have strong expertise in Hadoop cluster administration, excellent troubleshooting skills, and a proven track record of maintaining and optimizing complex Hadoop environments.

About the Role:

  • Install, configure, and manage Hadoop clusters, including HDFS, YARN, Hive, HBase, and other ecosystem components.
  • Monitor and manage Hadoop cluster performance, capacity, and security.
  • Perform routine maintenance tasks such as upgrades, patching, and backups.
  • Implement and maintain data ingestion processes using tools like Sqoop, Flume, and Kafka.
  • Ensure high availability and disaster recovery of Hadoop clusters.
  • Collaborate with development teams to understand requirements and provide appropriate Hadoop solutions.
  • Troubleshoot and resolve issues related to the Hadoop ecosystem.

Key Responsibilities:

The successful candidate will be responsible for managing and maintaining our large-scale Hadoop ecosystem, ensuring optimal performance, reliability, and scalability. This includes installing, configuring, and managing Hadoop clusters, as well as monitoring and managing performance, capacity, and security.

Requirements:

  • 5+ years of experience in Hadoop administration
  • Hands-on experience with Cloudera
  • Understanding of Hadoop design principles and factors that affect distributed system performance
  • Experience with infrastructure recommendations, capacity planning, workload management, and data ingestion processes
  • Knowledge of scripting languages such as Shell, Python, or Perl
  • Experience with orchestration and deployment tools
  • Cloudera and CDP certifications mandatory

Benefits:

The selected candidate will enjoy a competitive salary package, including a base salary of ₹1,200,000 per annum, along with additional benefits such as health insurance, retirement plan, and paid time off.


  • Big Data

    3 months ago


    india Myananta Technologies Full time

    At Myananta Technologies, we’re looking for a Big Data (Hadoop). The ideal candidate is excited by experimentation and looking for a new challenge that stretches their talents. Job descriptionFull-Time Big Data (Hadoop) DeveloperMyananta Technologies | Gurugram is hiring for “Big Data (Hadoop) Developer” Experience: 3 - 5 Years.Salary: 5.0 - 12.0...

  • Big Data Engineer

    4 weeks ago


    India Pert Telecom Solutions Full time

    Job Description : We are seeking a skilled Big Data Engineer with deep expertise in PySpark, Python, MySQL, Hadoop and Linux. The ideal candidate should have extensive experience deploying and managing these tools within on-premises environments (no public cloud). Proficiency in cluster management, performance optimization, and monitoring is essential...

  • Big Data Engineer

    1 month ago


    Anywhere in India/Multiple Locations IT Source Global Full time

    Job SummaryWe are seeking a skilled Hadoop Developer to join our team at IT Source Global. As a Hadoop Developer, you will be responsible for designing and developing complex data pipelines for ingestion, transformation, and processing of structured and unstructured data.Key ResponsibilitiesDevelop, implement, and maintain large-scale data processing...


  • india Pert Telecom Solutions Full time

    Job Description : We are seeking a skilled Big Data Engineer with deep expertise in PySpark, Python, MySQL, Hadoop and Linux. The ideal candidate should have extensive experience deploying and managing these tools within on-premises environments (no public cloud). Proficiency in cluster management, performance optimization, and monitoring is essential for...

  • Big data developer

    4 weeks ago


    India Manuh Technologies Full time

    Big Data Engineer with 5+ years of experience on technologies Cloudera, Hadoop, sqoop, Spark, Py Spark, Impala, SQL Previous experince into big data projects using hadoop and spark. Atleast one project experience into Cloudera hadoop with Impala and Hue Strong Programming experience in Python and Py Spark Hands on experience in SQL using Impala ...

  • Big Data Engineer

    1 month ago


    Jaipur/Ahmedabad/Anywhere in India/Multiple Locations ATech Full time

    Job Profile: Hadoop Administrator at ATechWe are seeking a skilled and experienced Hadoop Administrator to join our team at ATech. As a key member of our technical staff, you will be responsible for the installation, configuration, and maintenance of our Hadoop clusters.Skills and Qualifications:- Good understanding of SDLC and agile methodologies- Strong...


  • india Grid Dynamics Full time

    Note -Candidate should be an Immediate joiner or within 30 days.This is a Hybrid position in Bangalore (Local candidates Preferred)Job Description:Minimum of 6-8 years of software development experience in building large-scale applications using open source technologies. Design and coding skills with Big Data technologies like Hadoop, Spark, Hive, and Map...

  • Big Data Developer

    1 month ago


    India Manuh Technologies Full time

    Big Data Engineer with 5+ years of experience on technologies Cloudera, Hadoop, sqoop, Spark, PySpark, Impala, SQLPrevious experince into big data projects using hadoop and spark.Atleast one project experience into Cloudera hadoop with Impala and HueStrong Programming experience in Python and PySparkHands on experience in SQL using ImpalaExperience in...

  • Big Data Developer

    1 month ago


    india Manuh Technologies Full time

    Big Data Engineer with 5+ years of experience on technologies Cloudera, Hadoop, sqoop, Spark, PySpark, Impala, SQLPrevious experince into big data projects using hadoop and spark.Atleast one project experience into Cloudera hadoop with Impala and HueStrong Programming experience in Python and PySparkHands on experience in SQL using ImpalaExperience in...

  • Big Data Developer

    4 weeks ago


    India Manuh Technologies Full time

    Big Data Engineer with 5+ years of experience on technologies Cloudera, Hadoop, sqoop, Spark, PySpark, Impala, SQL Previous experince into big data projects using hadoop and spark. Atleast one project experience into Cloudera hadoop with Impala and Hue Strong Programming experience in Python and PySpark Hands on experience in SQL using Impala Experience in...

  • Hadoop Developer

    2 weeks ago


    Anywhere in India/Multiple Locations IT Source Global Full time

    Role : Hadoop DeveloperJob Description :- Develop, implement, and maintain large-scale data processing applications using Hadoop and related Big Data technologies.- Design and develop complex data pipelines for ingestion, transformation, and processing of structured and unstructured data.- Work with tools in the Hadoop ecosystem such as HDFS, MapReduce, Pig,...


  • India ITI Data Full time

    We are seeking an experienced PySpark Data Engineer to join our team at ITI Data. As a key member of our team, you will design and build scalable data solutions for one of our Fortune 500 Client programs.About the Role:The ideal candidate will have extensive experience in working with Hadoop, NoSQL databases, and Spark framework on Python. You will be...


  • india ITI Data Full time

    Location : IndiaType : Full-timeExperience : 10 – 13 years Functions : Consulting, Finance, Information Technology, Big Data Engineering Industries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, HealthcareJob DescriptionWe are looking for a PySpark solutions...


  • india Smartavya Analytica Private Limited Full time

    We are seeking an experienced Hadoop Administrator to manage and support our Hadoop ecosystem with 5+ Years of Experience. The ideal candidate will have strong expertise in Hadoop cluster administration, excellent troubleshooting skills, and a proven track record of maintaining and optimizing Hadoop environments.Location: MumbaiKey Responsibilities:Install,...

  • Hadoop Administrator

    3 weeks ago


    India Tata Consultancy Services Full time

    Role - Hadoop Administrator Experience - 4 to 8 yrs Location - Pune, Chennai, Bangalore 2 - 8 years of total experience within Production support & relevant experience in Hadoop. Work in 24*7 L0/L1 Production support team. Should have sound understanding of ITIL process (Incident, Change, Events, Alerts, Problem management process) Should have...


  • India Coffeee Full time

    We are seeking an experienced Hadoop developer to join our innovative team at Coffeee. As a Senior Hadoop Developer, you will play a key role in designing and implementing scalable big data solutions using the Hadoop ecosystem.Our ideal candidate has hands-on experience with Hadoop tools such as HDFS, Hive, and Pig. Proficiency in Spark and Scala for data...

  • Big Data Architect

    8 months ago


    India Princeton IT Services Full time

    **Job Title**: Big Data Architect **Location**:Kakinada (work from office) or Bangalore (work from office) **Shift**: UK shift preferred **Job Overview**: We are seeking a highly skilled and motivated Big Data Architect to join our team. This individual will play a crucial role in designing and implementing scalable and efficient big data solutions,...

  • Big Data Architect

    6 months ago


    India Persistent Systems Full time

    **About Persistent** We are a trusted Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and industry experience to help our clients anticipate what’s next. Our offerings and proven solutions create a unique competitive advantage for our clients by giving them the power to see beyond and rise above. We work with...

  • Big Data Developer

    2 days ago


    India Tata Consultancy Services Full time

    Desired Competencies (Technical/Behavioral Competency) Must-Have •5+ years of active development experience with Java, Scala, Spark, Hive, Kafka, NoSql Databases •Having core fundamentals experience of Apache Hadoop components •Understanding best practices for Big Data (in Hadoop), data processing •Strong experience and debugging skills in Java,...

  • Big Data Developer

    2 days ago


    India Tata Consultancy Services Full time

    Desired Competencies (Technical/Behavioral Competency) Must-Have •5+ years of active development experience with Java, Scala, Spark, Hive, Kafka, NoSql Databases •Having core fundamentals experience of Apache Hadoop components •Understanding best practices for Big Data (in Hadoop), data processing •Strong experience and debugging skills in Java,...