Senior Hadoop Cluster Engineer

3 weeks ago


Mumbai, Maharashtra, India Smartavya Analytica Private Limited Full time

Estimated salary: ₹15,00,000 - ₹20,00,000 per annum.

About the Role

Smartavya Analytica Private Limited is seeking an experienced Hadoop Administrator to lead our Big Data ecosystem and drive business growth. The ideal candidate will have 5+ years of experience in managing and supporting large-scale Hadoop environments.

Job Responsibilities
  • Cluster Administration: Install, configure, and manage Hadoop clusters, including HDFS, YARN, Hive, HBase, and other ecosystem components.
  • Performance Monitoring: Monitor and manage Hadoop cluster performance, capacity, and security.
  • Maintenance and Upgrades: Perform routine maintenance tasks such as upgrades, patching, and backups.
  • Data Ingestion: Implement and maintain data ingestion processes using tools like Sqoop, Flume, and Kafka.
  • High Availability: Ensure high availability and disaster recovery of Hadoop clusters.
  • Collaboration: Collaborate with development teams to understand requirements and provide appropriate Hadoop solutions.
  • Troubleshooting: Troubleshoot and resolve issues related to the Hadoop ecosystem.
Requirements
  • Experience: Experience in installing, configuring, and tuning Hadoop distributions.
  • Cloudera Expertise: Hands-on experience in Cloudera.
  • Understanding: Understanding of Hadoop design principles and factors that affect distributed system performance, including hardware and network considerations.
  • Infrastructure Management: Provide infrastructure recommendations, capacity planning, workload management.
  • Cluster Maintenance: Manage large clusters with huge volumes of data, perform cluster maintenance tasks, create and remove nodes, and monitor and troubleshoot clusters.
  • Security: Install and implement security for Hadoop clusters, manage and review Hadoop log files.
  • Update Management: Install Hadoop updates, patches, and version upgrades, automate the same through scripts.
  • Vendor Escalation: Point of contact for vendor escalation, work with Hortonworks in resolving issues.
  • Data Management: Conceptual/working knowledge of basic data management concepts like ETL, reference/master data, data quality, RDBMS.
  • Scripting: Working knowledge of any scripting language like Shell, Python, Perl.
  • Orchestration: Experience in orchestration & deployment tools.
  • Certifications: Cloudera and CDP certifications are mandatory.


  • Mumbai, Maharashtra, India Smartavya Analytica Private Limited Full time

    We are seeking an experienced Big Data Cluster Administrator to manage and support our Hadoop ecosystem with 5+ years of experience. The ideal candidate will have strong expertise in Hadoop cluster administration, excellent troubleshooting skills, and a proven track record of maintaining and optimizing Hadoop environments.Key Responsibilities:Install,...


  • Mumbai, Maharashtra, India Tata Consultancy Services Full time

    Tata Consultancy Services is a leading IT service company that provides innovative solutions to clients globally.We offer an attractive salary package of around 1200000 INR per annum for this role.Job Description:This is an opportunity to work as a Hadoop Developer in our team, where you will be responsible for developing and maintaining large-scale systems...

  • Data Engineer

    4 days ago


    Mumbai, Maharashtra, India Integrated Personnel Services Limited Full time

    Data Engineer - Big Data Hadoop ExpertWe are seeking a highly skilled Data Engineer to join our team at Integrated Personnel Services Limited.Estimated Salary: ₹1200000 - ₹1800000 per annumJob Description:Requirements Gathering and Data Analysis for Multiple Business ProcessesDevelopment of Data Ingestion Framework using Spark, Hive, Sqoop Tech...


  • Mumbai, Maharashtra, India Cloud Counselage Pvt Ltd Full time

    Cloud Counselage Pvt Ltd is seeking a highly skilled Senior Machine Learning Specialist to join our team. This role offers an excellent opportunity to grow your skills in a collaborative environment while contributing to cutting-edge projects.About the RoleWe are looking for a talented machine learning engineer with a strong background in developing,...


  • Mumbai, Maharashtra, India Vodafone Idea Limited Full time

    About the RoleWe are seeking a seasoned Senior Cluster Retention Strategist to join our Enterprise, Customer Service team in Mumbai.Job SummaryThe successful candidate will be responsible for driving customer retention and revenue enhancement across assigned accounts in West and Central Clusters. This role requires a proactive and reactive approach to churn...


  • Mumbai, Maharashtra, India Maverick Minds Full time

    Job OverviewWe are looking for a highly skilled Senior System Administrator - HPC Linux to join our team at Maverick Minds. In this role, you will be responsible for managing and optimizing our HPC Linux environment, ensuring its stability, efficiency, and scalability.Responsibilities:Manage and maintain HPC Linux clusters, ensuring optimal performance and...


  • Mumbai, Maharashtra, India The Hird Full time

    The Hird is seeking a highly skilled Senior Enterprise Linux Systems Engineer to join our team in Airoli, Navi Mumbai. This role involves providing technical expertise in the design, implementation, and maintenance of enterprise-level Linux systems.Salary: ₹15Lpa-30Lpa (Estimated)Job DescriptionWe are looking for an experienced Senior Enterprise Linux...


  • Mumbai, Maharashtra, India iXceed Solutions Full time

    Job Summary: We are seeking an experienced Senior DevOps Engineer to join our team at iXceed Solutions. The ideal candidate will have a strong background in designing, developing, and maintaining scalable software solutions using Java and Python in a cloud environment. The Senior DevOps Engineer will be responsible for architecting and implementing AKS...


  • Mumbai, Maharashtra, India VAYUZ Technologies Full time

    Job Summary:VAYUZ Technologies is looking for a Senior Data Engineer Lead to join our data engineering team. The ideal candidate will have a strong background in data integration and governance, with experience leading teams and implementing data pipelines.About the Role:The Senior Data Engineer Lead will be responsible for designing and implementing...


  • Mumbai, Maharashtra, India Wysetek Systems Technologists Pvt. Ltd. Full time

    About Wysetek Systems Technologists Pvt. Ltd.">We are a leading technology solutions provider, delivering innovative and cost-effective solutions to our clients. We believe in empowering our team members with the latest technologies and tools to help them grow professionally and personally.">Job Summary">We are seeking an experienced Senior OpenShift...


  • Mumbai, Maharashtra, India Novo Tree Minds Full time

    Job DescriptionAt Novo Tree Minds, we are seeking an experienced Senior Data Engineer to join our team. As a key member of our data engineering group, you will play a critical role in designing, building, and maintaining our big data infrastructure.Key Responsibilities:Design and implement end-to-end data pipelines using Hadoop, Spark, and other big data...


  • Mumbai, Maharashtra, India Tata Consultancy Services Full time

    About the RoleWe are seeking a highly skilled Senior Unix/Linux Systems Engineer to join our team at Tata Consultancy Services in Mumbai. As a key member of our IT infrastructure team, you will be responsible for designing, building, and implementing complex systems that meet our business requirements.Job DescriptionIn this role, you will oversee a team of...


  • Navi Mumbai, Maharashtra, India Tech Mahindra Full time

    **Job Title:** Senior AIX Systems EngineerLocation: Navi Mumbai-Belapur (Work from office & 24/7 support)Salary: ₹20-35 Lakhs per annum (estimated)At Tech Mahindra, we are seeking a skilled and experienced Senior AIX Systems Engineer to join our team. As a key member of our IT infrastructure team, you will be responsible for the installation,...


  • Mumbai, Maharashtra, India Sr Branch Manager Retail Banking Full time

    About the RoleWe are seeking a highly skilled and experienced Senior Retail Banking Cluster Manager to join our team. As a key member of our leadership team, you will be responsible for leading a team of Branch Managers in achieving sales targets and delivering excellent customer service.Job ResponsibilitiesDevelop and implement strategic sales plans to...


  • Mumbai, Maharashtra, India Novo Tree Minds Consulting Full time

    Company Overview">At Novo Tree Minds Consulting, we are a dynamic and forward-thinking consulting firm that leverages the power of data to drive business growth and success. Our team is passionate about delivering innovative solutions that make a real impact on our clients' operations.">About the Role">We are seeking an experienced Data Engineer who can join...


  • Mumbai, Maharashtra, India XHire Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled and experienced Senior Data Engineer to lead our data engineering team. The successful candidate will have expertise in cluster computing technologies, particularly Apache Spark, and experience with cloud technologies such as AWS, Azure, or GCP.About the Role:The ideal candidate will have a...


  • Mumbai, Maharashtra, India Innova ESI Full time

    **Company Overview:**Innova ESI is a leading innovator in the field of cloud-native applications.**Job Description:**We are seeking a highly skilled Senior OpenShift Container Platform Engineer to join our team. As a key member of our infrastructure team, you will be responsible for designing, deploying, and managing OpenShift Container Platform clusters....


  • Mumbai, Maharashtra, India iXceed Solutions Full time

    Job Title: Senior Azure SpecialistiXceed Solutions is seeking a highly skilled Senior Azure Specialist to join our team. As a Senior Cloud Engineer, you will be responsible for designing, developing, and maintaining scalable software solutions using Java and Python in a cloud environment.Key Responsibilities:Design, develop, and maintain scalable software...


  • Mumbai, Maharashtra, India Recruit Elite Full time

    Job Title: Senior Cloud Data ArchitectWe are seeking a highly skilled Senior Cloud Data Architect to join our team at Freelancer Appudas. As a key member of our data strategy team, you will play a crucial role in designing and implementing scalable data architectures that drive business growth.Key Responsibilities:* Design and implement cloud-based data...


  • Mumbai, Maharashtra, India IT Resource Hunter Full time

    Job DescriptionWe are seeking an experienced Senior DevOps Engineer to join our team at IT Resource Hunter. This is a full-time position based in Mumbai, MH, India.About the RoleThe ideal candidate will have a strong background in DevOps engineering and experience working on large-scale systems. They should be comfortable with cloud infrastructure,...