Big Data Spark Developer

1 week ago

Bengaluru Chennai, India f44eb59e-dd6c-43a2-9d85-83bdf151972b Full time ₹ 15,00,000 - ₹ 25,00,000 per year

Job Description:

We are looking for a Big Data Engineer with strong hands-on experience in building and optimizing data pipelines using Spark and Python. The role involves working in a large-scale distributed environment, performing ETL, and ensuring high data quality and performance.

Key Responsibilities:

  • Develop and optimize Big Data pipelines using Spark, Python, and Hive
  • Perform data ingestion, transformation, and validation in distributed systems
  • Write and maintain Shell scripts for automation and workflow management
  • Work with large datasets in Hadoop/HDFS environments
  • Collaborate with cross-functional teams to deliver scalable data solutions

Required Skills:

  • 8-12 years of experience in Big Data technologies
  • Strong coding skills in Python, Spark (PySpark/Scala) & Hive
  • Experience with Hadoop ecosystem
  • Good knowledge of Shell scripting
  • Strong problem-solving and debugging skillsRole & responsibilities

  • Big Data Developer

    7 days ago

    Bengaluru, India Xebia Full time

    Job Title : Big Data Developer - Spark/ScalaJob location : BengaluruNotice Period : immediate - 15 daysPosition Overview : We are looking for Scala/Spark developers with strong expertise on Python / Hadoop and Azure cloud ..Big Data Orchestration: Airflow, Spark on Kubernetes, Yarn, Oozie Big Data Processing: Hadoop, Kafka, Spark & Spark Structured...

  • Big Data Developer

    7 days ago

    Bengaluru, India Xebia Full time

    Job Title : Big Data Developer - Spark/ScalaJob location : BengaluruNotice Period : immediate - 15 daysPosition Overview : We are looking for Scala/Spark developers with strong expertise on Python / Hadoop and Azure cloud ..Big Data Orchestration: Airflow, Spark on Kubernetes, Yarn, Oozie Big Data Processing: Hadoop, Kafka, Spark & Spark Structured...

  • Big Data Developer

    7 days ago

    Bengaluru, India Xebia Full time

    Job Title : Big Data Developer - Spark/ScalaJob location : BengaluruNotice Period : immediate - 15 daysPosition Overview : We are looking for Scala/Spark developers with strong expertise on Python / Hadoop and Azure cloud ..Big Data Orchestration: Airflow, Spark on Kubernetes, Yarn, Oozie Big Data Processing: Hadoop, Kafka, Spark & Spark Structured...

  • Big data developer

    7 days ago

    Bengaluru, India Xebia Full time

    Job Title : Big Data Developer - Spark/Scala Job location : Bengaluru Notice Period : immediate - 15 days Position Overview : We are looking for Scala/Spark developers with strong expertise on Python / Hadoop and Azure cloud.. Big Data Orchestration: Airflow, Spark on Kubernetes, Yarn, Oozie Big Data Processing: Hadoop, Kafka, Spark & Spark Structured...

  • Big Data Developer

    6 days ago

    Bengaluru, India Xebia Full time

    Job Title : Big Data Developer - Spark/Scala Job location : Bengaluru Notice Period : immediate - 15 days Position Overview : We are looking for Scala/Spark developers with strong expertise on Python / Hadoop and Azure cloud .. Big Data Orchestration: Airflow, Spark on Kubernetes, Yarn, Oozie Big Data Processing: Hadoop, Kafka, Spark & Spark Structured...

  • Big Data Developer

    7 days ago

    Bengaluru, India Xebia Full time

    Job Title : Big Data Developer - Spark/Scala Job location : Bengaluru Notice Period : immediate - 15 days Position Overview : We are looking for Scala/Spark developers with strong expertise on Python / Hadoop and Azure cloud .. Big Data Orchestration: Airflow, Spark on Kubernetes, Yarn, Oozie Big Data Processing: Hadoop, Kafka, Spark & Spark Structured...

  • Big Data Developer

    7 days ago

    Bengaluru, India Xebia Full time

    Job Title : Big Data Developer - Spark/Scala Job location : Bengaluru Notice Period : immediate - 15 days Position Overview : We are looking for Scala/Spark developers with strong expertise on Python / Hadoop and Azure cloud .. Big Data Orchestration: Airflow, Spark on Kubernetes, Yarn, Oozie Big Data Processing: Hadoop, Kafka, Spark & Spark Structured...

  • Big Data Developer

    3 hours ago

    Bengaluru, India Whatjobs IN C2 Full time

    Job Title : Big Data Developer - Spark/Scala Job location : Bengaluru Notice Period : immediate - 15 days Position Overview : We are looking for Scala/Spark developers with strong expertise on Python / Hadoop and Azure cloud .. Big Data Orchestration: Airflow, Spark on Kubernetes, Yarn, Oozie Big Data Processing: Hadoop, Kafka, Spark & Spark Structured...

  • Big Data Developer

    6 days ago

    Bengaluru, India Xebia Full time

    Job Title : Big Data Developer - Spark/ScalaJob location : BengaluruNotice Period : immediate - 15 daysPosition Overview : We are looking for Scala/Spark developers with strong expertise on Python / Hadoop and Azure cloud ..Big Data Orchestration: Airflow, Spark on Kubernetes, Yarn, OozieBig Data Processing: Hadoop, Kafka, Spark & Spark Structured...

  • Big Data Developer

    7 days ago

    Bengaluru, India Xebia Full time

    Job Title : Big Data Developer - Spark/ScalaJob location : BengaluruNotice Period : immediate - 15 daysPosition Overview : We are looking for Scala/Spark developers with strong expertise on Python / Hadoop and Azure cloud ..Big Data Orchestration: Airflow, Spark on Kubernetes, Yarn, OozieBig Data Processing: Hadoop, Kafka, Spark & Spark Structured...