Hadoop Cluster Specialist

3 days ago


Pune, Maharashtra, India Kenn IT Business Solutions Full time

Hadoop Administrator Job Description

We are seeking a skilled Hadoop Administrator to join our team at Kenn IT Business Solutions. The ideal candidate will have experience in designing, managing, and supporting Hadoop clusters in Cloudera Distribution.

Key Responsibilities:

  • Design and manage the commencement of new Hadoop projects.
  • Execute system upgrades for existing Hadoop clusters using Cloudera.
  • Install, configure, and support HIVE, IMPALA, SOLR, SPARK, KAFKA.
  • Handle severity incidents related to Hadoop.
  • Manage MySQL database related to Hadoop clusters.
  • Set up and manage BDR jobs.
  • Procure and license Hadoop hardware.
  • Implement SSL and TLS on clusters.
  • Work closely with clients as part of a cross-functional team to support operational, tactical, and strategic reporting, as well as other analytical business needs.
  • Ensure change management and incident management protocols are followed.
  • Collaborate with internal teams throughout project delivery lifecycle.
  • Investigate, model, define, and document required processes, including business processes.
  • Leverage automation skills to minimize manual efforts in daily support tasks.
  • Provide on call support.
  • Review and analyse change requests to ensure adherence to protocols.
  • Manage code in Github and experience in managing Git repositories.
  • Engage necessary teams via JIRA.
  • Install Hadoop patches, updates, and version upgrades.
  • Understand UDFs and Lambda Architecture.
  • Have a good understanding of Spark Streaming with Kafka for real-time processing.
  • Experience in Airflow DAG analysis.
  • Mandatory skill: Hadoop Admin, DevOps and Cloud skills.
  • Desired/Secondary skills:
    • Debugging Java Code
    • Aws knowledge on managing emr clusters and s3 buckets
    • Azure devops pipelines to manage airflow dags
    • Ansible and chef knowledge to automate builds
    • Python Scripting to automate manual tasks
    • Domain: Banking

Requirements:

  • Hadoop Admin, DevOps and Cloud skills
  • Desired/Secondary skills: Debugging Java Code, Aws knowledge on managing emr clusters and s3 buckets, Azure devops pipelines to manage airflow dags, Ansible and chef knowledge to automate builds, Python Scripting to automate manual tasks, Domain: Banking


  • Pune, Maharashtra, India Seventh Contact Hiring Solutions Full time

    Hadoop Cluster SpecialistWe are seeking a highly skilled Hadoop Cluster Specialist to join our team at Seventh Contact Hiring Solutions. As a key member of our big data team, you will be responsible for designing, implementing, and managing large-scale Hadoop clusters for our clients.Key Responsibilities:Hadoop Cluster Management: Ensure the optimal setup...


  • Pune, Maharashtra, India Vodafone Full time

    About _VOIS India:Job Role Related Content (Role Specific)The role of a Hadoop administrator involves deploying, maintaining, and administering Hadoop clusters, including deploying a Hadoop cluster, maintaining a Hadoop cluster, adding and removing nodes using cluster monitoring tools like Ganglia Nagios or Cloudera Manager, configuring the NameNode high...


  • Pune, Maharashtra, India Vodafone Full time

    About _VOIS India:Vodafone Intelligent Solutions (VOS) is a strategic arm of Vodafone Group Plc, creating value and enhancing quality and efficiency across 28 countries, operating from 7 locations: Albania, Egypt, Hungary, India, Romania, Spain, and the UK.With over 29,000 highly skilled individuals, VOS delivers the best services across IT, Business...


  • Pune, Maharashtra, India Vodafone Full time

    About _VOIS India:_VOIS (Vodafone Intelligent Solutions) is a strategic arm of Vodafone Group Plc, creating value and enhancing quality and efficiency across 28 countries, and operating from 7 locations: Albania, Egypt, Hungary, India, Romania, Spain and the UK.Our team of 29,000 highly skilled individuals is dedicated to being Vodafone Group's partner of...


  • Pune, Maharashtra, India Seventh Contact Hiring Solutions Full time

    Job Title: Hadoop Administrator for Start-Up in DataWe are seeking a highly skilled Hadoop Administrator to join our team at Seventh Contact Hiring Solutions. As a Hadoop Administrator, you will be responsible for managing and maintaining our Hadoop clusters, ensuring optimal performance and scalability.Key Responsibilities:Hadoop Cluster Management:...


  • Pune, Maharashtra, India Circana Full time

    Senior Hadoop AdministratorCircana is seeking a highly skilled Senior Hadoop Administrator to join our team. As a key member of our data infrastructure team, you will be responsible for the maintenance and reliability of our Hadoop platforms, ensuring 24/7 uninterrupted support for our Production Data Factory.Key Responsibilities:Install, configure, and...


  • Pune, Maharashtra, India Circana Full time

    Job Title: Senior Hadoop AdminJob Summary:Circana is seeking a highly skilled Senior Hadoop Admin to join our team. As a key member of our infrastructure team, you will be responsible for the maintenance and reliability of our Hadoop platforms, ensuring 24/7 uninterrupted support.Key Responsibilities:Install, configure, and manage MapR and ODP Apache Hadoop...


  • Pune, Maharashtra, India Circana Full time

    Hadoop Administrator RoleCircana is seeking a skilled Hadoop Administrator to join our team. As a Hadoop Administrator, you will be responsible for the maintenance and reliability of our Hadoop Platforms, ensuring 24/7 uninterrupted support. You will focus on keeping Hadoop and other production systems and processes running efficiently while ensuring we meet...


  • Pune, Maharashtra, India Seventh Contact Hiring Solutions Full time

    Hadoop Administrator Job DescriptionSeventh Contact Hiring Solutions is seeking a highly skilled Hadoop Administrator to join our team. As a Hadoop Administrator, you will be responsible for managing and maintaining large-scale Hadoop clusters, ensuring optimal performance and reliability.Key Responsibilities:Manage and configure Hadoop clusters using...


  • Pune, Maharashtra, India Velloni Full time

    Key Responsibilities:As a Middleware Administrator at Velloni, you will be responsible for:Cluster Management: Install, configure, and maintain Kafka clusters to ensure high availability and performance.Middleware Integration: Work with middleware tools (e.g., Apache Camel, NiFi) to facilitate data streaming and transformation.Data Migration: Lead efforts to...

  • Big Data Engineer

    7 days ago


    Pune, Maharashtra, India HARP Technologies and Services Full time

    Job Title: Hadoop DeveloperHARP Technologies and Services is seeking a highly skilled Hadoop Developer to join our team. As a Hadoop Developer, you will be responsible for designing, developing, and maintaining robust applications that efficiently communicate with Hadoop to support data processing and analytics initiatives.Key Responsibilities:Design and...


  • Pune, Maharashtra, India Virtusa Full time

    Job Title: Python MLOps EngineerJoin Virtusa as a Python MLOps Engineer and contribute to the development of cutting-edge machine learning solutions.Key Responsibilities:Design and implement Python batch processes for data processing and analysis.Develop REST APIs using Python frameworks such as Flask or FastAPI.Collaborate with cross-functional teams to...


  • Pune, Maharashtra, India Tata Consultancy Services Full time

    Job Title: Cloud Infrastructure SpecialistGreetings from Tata Consultancy ServicesJob Location: Multiple LocationsExperience required: 8-12 yearsKey Responsibilities:Design and deploy scalable Kubernetes clusters for 4G and 5G networks, adhering to industry best practices.Ensure the stability and performance of Kubernetes clusters through proactive...


  • Pune, Maharashtra, India B.Uri Motors Pvt. Ltd. Full time

    Job OverviewWe are seeking a highly skilled Maintenance Technician to join our team at B.Uri Motors Pvt. Ltd.Key ResponsibilitiesUtilize workshop management systems (e.g. WIS, ASRA, EPC) to optimize workflow and efficiency.Employ workshop information systems (e.g. TIPS, News, Star Diagnosis, WIS) for effective diagnosis and repairs.Exhibit in-depth knowledge...


  • Pune, Maharashtra, India Invokhr Full time

    Job SummaryWe are seeking an experienced Red Hat OpenShift Container Platform specialist to design, deploy, and maintain scalable and secure containerized applications. As a key member of our team, you will work closely with development and infrastructure teams to ensure seamless availability, scalability, and security of our containerized solutions.Key...


  • Pune, Maharashtra, India Proactive Data Systems Pvt. Ltd. Full time

    Job Description:At Proactive Data Systems Pvt. Ltd., we are seeking a highly skilled Senior Networking Specialist to join our team. The ideal candidate will have in-depth knowledge of converged and hyper-converged infrastructure, as well as data centre networking technology. Key responsibilities include performing business impact analysis and risk...

  • Data Engineer

    1 day ago


    Pune, Maharashtra, India DATAECONOMY Full time

    Job Title: Data Engineer - Cloud Solutions SpecialistJob Description: At DATAECONOMY, we are seeking a highly skilled Data Engineer to join our team. As a Data Engineer - Cloud Solutions Specialist, you will be responsible for designing and developing scalable data solutions on AWS and Azure.Responsibilities:* Design and develop scalable data solutions on...

  • Big Data Engineer

    3 days ago


    Pune, Maharashtra, India SGS Technical Services Pvt. Ltd Full time

    Job Title: Data Processing SpecialistJob Summary:We are seeking a highly skilled Data Processing Specialist to join our team at SGS Technical Services Pvt. Ltd. The ideal candidate will have strong experience with Hadoop ecosystem, PySpark, and data warehousing solutions.Key Responsibilities:Design, develop, and maintain scalable data processing systems...


  • Pune, Maharashtra, India Proactive Data Systems Pvt. Ltd. Full time

    Job OpportunityProactive Data Systems Pvt. Ltd. is seeking a skilled Network Infrastructure Specialist to join our team.Key Responsibilities:• Perform business impact analysis and risk assessments to minimize service outages and disasters.• Develop expertise in converged, hyper-converged, and data centre networking technologies.• Collaborate with...


  • Pune, Maharashtra, India Swift Strategic Staff Solutions INC Full time

    Job Title: VMware Infrastructure SpecialistJob Summary:We are seeking a highly skilled VMware Infrastructure Specialist to join our team at Swift Strategic Staff Solutions INC. As a VMware Infrastructure Specialist, you will be responsible for designing, implementing, and managing VMware vSphere environments, including vCenter, ESXi hosts, and virtual...