Big data-Pyspark Developer-Hadoop

2 hours ago

Bengaluru, Karnataka, India Infosys Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Key Responsibilities:Deploying a hadoop cluster maintaining a hadoop cluster adding and removing nodes using cluster monitoring tools like Cloudera Manager configuring the NameNode high availability and keeping a track of all the running hadoop jobsImplementing managing and administering the overall hadoop infrastructureKnowledge all the components in the Hadoop ecosystem like Apache Spark Apache Hive HBase Kafka Sqoop Yarn Zookeeper etcTakes care of the day to day running of Hadoop clustersCandidate will have to work closely with the database team network team BI team and application teams to make sure that all the big data applications are highly available and performing as expectedCandidate is responsible for capacity planning and estimating the requirements for lowering or increasing the capacity of the hadoop clusterEnsure that the hadoop cluster is up and running all the timeMonitoring the cluster connectivity and performanceManage and review Hadoop log filesBackup and recovery tasksResource and security managementTroubleshooting application errors and ensuring that they do not occur againTechnical Requirements:Skillset requiredExcellent knowledge of UNIX LINUX OSKnowing of core java is a plus but not mandatoryGood understanding of OS concepts process management and resource schedulingBasics of networking CPU memory and storageGood hold of shell scriptingPreferred Skills:Technology->Big Data - Hadoop->Hadoop Administration->Hadoop

  • Big Data/Hadoop Engineer

    2 days ago

    Bengaluru, Karnataka, India Rackspace Technology Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are hiring for Big Data / Hadoop EngineerExp - 3+yrsLocation - Bangalore ( 3days WFO)Notice Period - Less than 30days only. Big Data Development: Design, build, and maintain robust and scalable data pipelines for ETL/ELT processes using tools within the Hadoop ecosystem.. Programming & Scripting: Develop complex data processing applications using Spark...

  • Big Data/Hadoop Engineer

    2 days ago

    Bengaluru, Karnataka, India Rackspace Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are hiring for Big Data / Hadoop EngineerExp - 3+yrs Location - Bangalore ( 3days WFO)Notice Period - Less than 30days only.    Big Data Development: Design, build, and maintain robust and scalable data pipelines for ETL/ELT processes using tools within the Hadoop ecosystem..    Programming & Scripting: Develop complex data processing applications...

  • Data Engineer – Hadoop

    3 days ago

    Bengaluru, Karnataka, India NAZZTEC Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per year

    We are seeking an experiencedData Engineerwith strong expertise in theHadoop ecosystemandPySpark. The ideal candidate should have a deep understanding of large-scale data processing, data pipelines, and automation using Python.Key ResponsibilitiesDesign, develop, and optimize data pipelines using Hadoop and PySpark.Work extensively on HDFS, Hive, and...

  • Big Data Engineer

    1 hour ago

    Bengaluru, Karnataka, India Coforge Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Hiring Now: Big Data Engineer Bangalore || Coforge LtdNote: This position requires 5 days mandatory - Work From Office.Send your updated CV to: For queries, reach out on WhatsApp: Job Location: BangaloreExperience Required: 6 YearsAvailability: Immediate Joiners PreferredKey Technologies & Skills Required:Big Data Tools: Hadoop, HiveProgramming Languages:...

  • Big Data Developer

    1 week ago

    Bengaluru, Karnataka, India Xebia Full time ₹ 5,00,000 - ₹ 25,00,000 per year

    Job Title : Big Data Developer - Spark/ScalaJob location : BengaluruNotice Period : immediate - 15 daysPosition Overview : We are looking for Scala/Spark developers with strong expertise on Python / Hadoop and Azure cloud ..Big Data Orchestration: Airflow, Spark on Kubernetes, Yarn, OozieBig Data Processing: Hadoop, Kafka, Spark & Spark Structured...

  • Big Data Developer

    7 days ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Greetings from TCSTCS has been a great pioneer in feeding the fire of young Techies like you. We are a global leader in the technology arena and there's nothing that can stop us from growing together.Your role is of key importance, as it lays down the foundation for the entire project.Position:Bigdata DeveloperJob Location:BangaloreExperience:6-12 YearsMust...

  • Big Data Developer

    4 days ago

    Bengaluru, Karnataka, India Sourcebae Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Alert: Senior Big Data Engineer (5-8 Yrs) | Spark, Python, Scala Are you a seasonedBig Data Engineerready to build and optimize large-scale, distributed data processing applications? We are seeking a senior engineer with5-8 yearsof experience in the core Big Data ecosystem to deliver high-performance solutions.This is a great opportunity to join a...

  • Big Data Developer

    7 days ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time ₹ 5,00,000 - ₹ 25,00,000 per year

    Greetings From Tata Consultancy ServicesRole: Big Data Developer (Hive, Pyspark)Years of Experience: 4 to 10 yrsLocation: Chennai, Hyderabad, BengaluruNotice Period: 0- 90 daysDate of Interview: 21st Nov 2025Mode of Interview: Virtual Drive (Cisco or Webex)Time Of Interview: 5.00PM To 7.00PMJob Description:Roles & Responsibilities:Hands-on experience of...

  • Apache Hadoop Developer

    2 weeks ago

    Bengaluru, Karnataka, India BairesDev Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works on roles that drive significant impact worldwide.When you apply for this position, you're...

  • Data Engineer with SQL/ETL/Pyspark

    6 days ago

    Bengaluru, Karnataka, India Infosys Finacle Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Mandate Skills - SQL, ETL ,hadoop, pyspark,Required SkillsPipeline/ETL (Extract, Transform, Load) processes, API integration, scripting languages (Python), and big data technologies (Trio, Iceberg, DuckDB/Parquet).Database design, data modeling, and data warehousing. SQL and at least one cloud platform.Analytical tools (Superset, Power BI), statistical...