Big data-Pyspark Developer-Hadoop

22 hours ago

Bengaluru, Karnataka, India Infosys Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Key Responsibilities:Deploying a hadoop cluster maintaining a hadoop cluster adding and removing nodes using cluster monitoring tools like Cloudera Manager configuring the NameNode high availability and keeping a track of all the running hadoop jobsImplementing managing and administering the overall hadoop infrastructureKnowledge all the components in the Hadoop ecosystem like Apache Spark Apache Hive HBase Kafka Sqoop Yarn Zookeeper etcTakes care of the day to day running of Hadoop clustersCandidate will have to work closely with the database team network team BI team and application teams to make sure that all the big data applications are highly available and performing as expectedCandidate is responsible for capacity planning and estimating the requirements for lowering or increasing the capacity of the hadoop clusterEnsure that the hadoop cluster is up and running all the timeMonitoring the cluster connectivity and performanceManage and review Hadoop log filesBackup and recovery tasksResource and security managementTroubleshooting application errors and ensuring that they do not occur againTechnical Requirements:Skillset requiredExcellent knowledge of UNIX LINUX OSKnowing of core java is a plus but not mandatoryGood understanding of OS concepts process management and resource schedulingBasics of networking CPU memory and storageGood hold of shell scriptingPreferred Skills:Technology->Big Data - Hadoop->Hadoop Administration->Hadoop

  • Big Data Pyspark Developer

    1 day ago

    Bengaluru, Karnataka, India Infosys Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Big data-Pyspark Developer-HadoopSkillset required: 1. Excellent knowledge of UNIX/LINUX OS. 2. Knowing of core java is a plus but not mandatory. 3. Good understanding of OS concepts, process management and resource scheduling. 4. Basics of networking, CPU, memory and storage. 5. Good hold of shell scripting. 1. Deploying a hadoop cluster, maintaining a...

  • Big Data/Hadoop Engineer

    1 day ago

    Bengaluru, Karnataka, India Rackspace Technology Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are hiring for Big Data / Hadoop EngineerExp - 3+yrsLocation - Bangalore ( 3days WFO)Notice Period - Less than 30days only. Big Data Development: Design, build, and maintain robust and scalable data pipelines for ETL/ELT processes using tools within the Hadoop ecosystem.. Programming & Scripting: Develop complex data processing applications using Spark...

  • Big Data/Hadoop Engineer

    24 hours ago

    Bengaluru, Karnataka, India Rackspace Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are hiring for Big Data / Hadoop Engineer Exp - 3 yrs Location - Bangalore ( 3days WFO Notice Period - Less than 30days only Big Data Development: Design, build, and maintain robust and scalable data pipelines for ETL/ELT processes using tools within the Hadoop ecosystem Programming & Scripting: Develop complex data processing applications using Spark...

  • Big Data/Hadoop Engineer

    3 days ago

    Bengaluru, Karnataka, India Rackspace Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are hiring for Big Data / Hadoop EngineerExp - 3+yrs Location - Bangalore ( 3days WFO)Notice Period - Less than 30days only.    Big Data Development: Design, build, and maintain robust and scalable data pipelines for ETL/ELT processes using tools within the Hadoop ecosystem..    Programming & Scripting: Develop complex data processing applications...

  • Big Data/Pyspark Developer

    2 weeks ago

    Bengaluru, Karnataka, India Contactx Resource Management Pvt. Ltd. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Senior Big Data Engineer / PySpark Developer with deep expertise in distributed computing, PySpark, and Spark performance tuning for both batch and streaming data processing.Hands-on experience with Hive, open table formats such as Iceberg, and workflow orchestration tools like Airflow or Oozie.Strong coding skills adhering to OOP principles, design...

  • Rackspace - Big Data/Hadoop Engineer

    1 day ago

    Bengaluru, Karnataka, India rackspace technology Full time ₹ 80,000 - ₹ 1,50,000 per year

    Job Description Big Data/Hadoop Engineer Location: India - BangaloreDepartment: Public Cloud - Offerings and Delivery Cloud Data Services / HybridExperience: 3 yearsNotice Period: Less than 30 days onlyWork Arrangement: 3 days Work From OfficeJob Responsibilities Big Data Development: Design, build, and maintain robust and scalable data pipelines for...

  • Big Data Engineer Lead

    1 week ago

    Bengaluru, Karnataka, India Brillio Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Key Skills - Hadoop, PySpark, Python, SQL, Apache Iceberg (niche) , HiveRequirementsSolid knowledge of Hadoop ecosystem such as Hive, Iceberg, Spark SQL and Proficiency in Python, Unix ,SQLExperience with Apache Kafka, Apache Flink, and other relevant streaming technologies.Strong hands-on experience with Hive and SQL for querying and data...

  • Big Data

    5 days ago

    Bengaluru, Karnataka, India TEKNIKOZ Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    Greetings from TeknikozExperience : 5-7 YearsSkill Required: Digital: Big Data and Hadoop Ecosystems~Digital: Python~Digital: PySparkSpecific activities required:Lead the implementation of infrastructure via code and provide strategic advice/recommendations for the development and advancement of Microsoft Azure technologies based on previous research on...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Fractal Analytics Private Limited Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    BigData Engineer It's fun to work in a company where people truly BELIEVE in what they are doing We're committed to bringing passion and customer focus to the business.About the Role:We are seeking highly skilled Big Data Engineers/Senior Engineers with a strong background in building and supporting big data solutions. The ideal candidate will have...

  • Senior Big Data Developer

    20 hours ago

    Bengaluru, Karnataka, India Info Origin Inc. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    NEW OPPORTUNITY || IMMEDIATE TO 30 DAYS JOINERS REQUIRED || SENIOR BIG DATA DEVELOPER ||Job Title: Senior Big Data DeveloperRequired Experience: 6+ YearsLocation: BangaloreEmployment Type: Full-timeJob SummaryKey Responsibilities· Develop, test, and deploy high-performance data pipelines using Hadoop, Spark, Kudu, and HBase.· Implement ETL/ELT workflows...