Big data-Pyspark Developer-Hadoop

1 day ago

Bengaluru, Karnataka, India Infosys Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Key Responsibilities:Deploying a hadoop cluster maintaining a hadoop cluster adding and removing nodes using cluster monitoring tools like Cloudera Manager configuring the NameNode high availability and keeping a track of all the running hadoop jobsImplementing managing and administering the overall hadoop infrastructureKnowledge all the components in the Hadoop ecosystem like Apache Spark Apache Hive HBase Kafka Sqoop Yarn Zookeeper etcTakes care of the day to day running of Hadoop clustersCandidate will have to work closely with the database team network team BI team and application teams to make sure that all the big data applications are highly available and performing as expectedCandidate is responsible for capacity planning and estimating the requirements for lowering or increasing the capacity of the hadoop clusterEnsure that the hadoop cluster is up and running all the timeMonitoring the cluster connectivity and performanceManage and review Hadoop log filesBackup and recovery tasksResource and security managementTroubleshooting application errors and ensuring that they do not occur againTechnical Requirements:Skillset requiredExcellent knowledge of UNIX LINUX OSKnowing of core java is a plus but not mandatoryGood understanding of OS concepts process management and resource schedulingBasics of networking CPU memory and storageGood hold of shell scriptingPreferred Skills:Technology->Big Data - Hadoop->Hadoop Administration->Hadoop

  • Big Data Pyspark Developer

    2 days ago

    Bengaluru, Karnataka, India Infosys Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Big data-Pyspark Developer-HadoopSkillset required: 1. Excellent knowledge of UNIX/LINUX OS. 2. Knowing of core java is a plus but not mandatory. 3. Good understanding of OS concepts, process management and resource scheduling. 4. Basics of networking, CPU, memory and storage. 5. Good hold of shell scripting. 1. Deploying a hadoop cluster, maintaining a...

  • Big Data/Hadoop Engineer

    2 days ago

    Bengaluru, Karnataka, India Rackspace Technology Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are hiring for Big Data / Hadoop EngineerExp - 3+yrsLocation - Bangalore ( 3days WFO)Notice Period - Less than 30days only. Big Data Development: Design, build, and maintain robust and scalable data pipelines for ETL/ELT processes using tools within the Hadoop ecosystem.. Programming & Scripting: Develop complex data processing applications using Spark...

  • Big Data/Hadoop Engineer

    2 days ago

    Bengaluru, Karnataka, India Rackspace Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are hiring for Big Data / Hadoop Engineer Exp - 3 yrs Location - Bangalore ( 3days WFO Notice Period - Less than 30days only Big Data Development: Design, build, and maintain robust and scalable data pipelines for ETL/ELT processes using tools within the Hadoop ecosystem Programming & Scripting: Develop complex data processing applications using Spark...

  • Pyspark Developer

    5 days ago

    Bengaluru, Karnataka, India Infosys Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Pyspark developer• Primary skills:Bigdata->Pyspark,Bigdata->Python,Bigdata->Spark,Technology->Functional Programming->Scala • Ability to work with clients to identify business challenges and contribute to client deliverables by refining, analyzing, and structuring relevant data • Awareness of latest technologies and trends • Logical thinking and...

  • Data Engineer – Hadoop

    5 days ago

    Bengaluru, Karnataka, India NAZZTEC Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per year

    We are seeking an experiencedData Engineerwith strong expertise in theHadoop ecosystemandPySpark. The ideal candidate should have a deep understanding of large-scale data processing, data pipelines, and automation using Python.Key ResponsibilitiesDesign, develop, and optimize data pipelines using Hadoop and PySpark.Work extensively on HDFS, Hive, and...

  • Big Data/Hadoop Engineer

    3 days ago

    Bengaluru, Karnataka, India Rackspace Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are hiring for Big Data / Hadoop EngineerExp - 3+yrs Location - Bangalore ( 3days WFO)Notice Period - Less than 30days only.    Big Data Development: Design, build, and maintain robust and scalable data pipelines for ETL/ELT processes using tools within the Hadoop ecosystem..    Programming & Scripting: Develop complex data processing applications...

  • Big Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full time

    Job Title :- Data Engineer - PysparkExperience: 5 to 8 YearsLocation: Pune/HyderabadJob DescriptionRequired Skills:5+ years of experience in Big data and pysparkMust-HaveGood work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQLGood-to-HaveGood Spark, Pyspark,Big Data experienceSpark UI/Optimization/debugging techniquesGood...

  • Big Data/Pyspark Developer

    2 weeks ago

    Bengaluru, Karnataka, India Contactx Resource Management Pvt. Ltd. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Senior Big Data Engineer / PySpark Developer with deep expertise in distributed computing, PySpark, and Spark performance tuning for both batch and streaming data processing.Hands-on experience with Hive, open table formats such as Iceberg, and workflow orchestration tools like Airflow or Oozie.Strong coding skills adhering to OOP principles, design...

  • Pyspark developer

    3 weeks ago

    Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full time

    Greetings from TCS!TCS is hiring for Pyspark DeveloperVirtual Interview Date-11th October 2025Desired Experience: 4-11 yearsJob Location: Bangalore / Chennai / HyderabadRequire skillset: Big Data, Hadoop, Spark, Hive ,PysparkJob Description:-Must Have Technical Qualifications:SparkHadoopHiveNice to Have Qualifications:Data Engineer CertificationExperience...

  • Rackspace - Big Data/Hadoop Engineer

    2 days ago

    Bengaluru, Karnataka, India rackspace technology Full time ₹ 80,000 - ₹ 1,50,000 per year

    Job Description Big Data/Hadoop Engineer Location: India - BangaloreDepartment: Public Cloud - Offerings and Delivery Cloud Data Services / HybridExperience: 3 yearsNotice Period: Less than 30 days onlyWork Arrangement: 3 days Work From OfficeJob Responsibilities Big Data Development: Design, build, and maintain robust and scalable data pipelines for...