Spark Developer

5 days ago

Bengaluru Chennai Hyderabad, India ti Steps Full time ₹ 8,00,000 - ₹ 24,00,000 per year

About the Role:

We are looking for a skilled and passionate Spark Developer to design, build, and optimize large-scale data processing systems. The ideal candidate will have strong expertise in Apache Spark, Big Data ecosystems, and distributed computing frameworks.

Key Responsibilities:

  • Design, develop, and maintain data processing pipelines using Apache Spark (Core, SQL, Streaming, Structured Streaming).
  • Implement ETL workflows for data ingestion, transformation, and integration across multiple data sources.
  • Optimize Spark applications for performance, scalability, and reliability in distributed environments.
  • Work with large structured and unstructured datasets to support analytical and reporting needs.
  • Collaborate with data scientists and business analysts to understand data requirements and provide engineering solutions.
  • Integrate Spark applications with cloud platforms (AWS, Azure, GCP) and data storage systems (HDFS, S3, Hive, Cassandra, etc.).

Preferred Skills:

  • Experience with cloud-based data platforms (AWS EMR, Databricks, Azure Synapse, GCP Dataproc).
  • Familiarity with containerization (Docker, Kubernetes) and orchestration tools (Airflow, Luigi).
  • Knowledge of data lake architectures, Delta Lake, or Parquet/Avro file formats.
  • Exposure to machine learning pipelines and data science integrations.
  • Understanding of data security, compliance, and governance principles.

  • Scala Developer/Spark Developer

    1 week ago

    Bengaluru, Chennai, Hyderabad, India Prointegrate World It Consulting Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    JD:Primary: Spark/Scala, Shell script / Python Script, Kafka, SQL, AWS.Secondary: JavaScala/Spark developer who has good experience on coding Spark/Scala applications.Should be able to handle Spark/Scala application individually, guide/mentor junior team members on Spark/Scala.Should have good experience working in an Agile Team.Should promote collaboration...

  • Spark, Scala Developer

    2 weeks ago

    Bengaluru, Chennai, Hyderabad, India SRS Infoway Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Role & responsibilitiesAt least 5+ years of experience and strong knowledge in Scala programming language.Able to write clean, maintainable and efficient Scala code following best practices.Good knowledge on the fundamental Data Structures and their usageAt least 5+ years of experience in designing and developing large scale, distributed data processing...

  • Spark Developer

    2 weeks ago

    Chennai, Tamil Nadu, India Citi Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    ETL Developer will be responsible for designing, implementing, and optimizing distributed data processing jobs to handle large-scale data in Hadoop Distributed File System(HDFS) using Apache Spark and Python. This role required deep understanding of data engineering principles, proficiency in Python and hands-on experience with Spark and Hadoop ecosystems....

  • Scala Spark Developer

    2 weeks ago

    Chennai, Tamil Nadu, India Path Mentors Staffing Solution Full time ₹ 12,50,000 - ₹ 25,00,000 per year

    Scala/Spark Developer: 5+ yrs experience in designing scalable data pipelines with Scala, Spark, Hadoop, Kafka. Skilled in data formats(Avro,Parquet),HDFS, SQL, NoSQL. Proficient in troubleshooting, optimization, delivering reliable bigdata solutions Required Candidate profileScala/Spark Developer with 5+ years' experience in building scalable data...

  • Spark Scala Developer

    4 weeks ago

    Chennai, India Tata Consultancy Services Full time

    Dear Candidates, Greetings from TCS!!!! TCS is looking for Spark Scala Developer Experience: 6-8 years Location: Chennai MUST HAVE SKILLS: - Data Engineer Design and develop scalable and efficient solutions using Spark, Scala, Python, Airflow. - Good code and configuration spark knowledge (at least 1 or 2 profiles should be very good at spark configuration...

  • Spark Scala Developer

    4 weeks ago

    Chennai, India Tata Consultancy Services Full time

    Dear Candidates, Greetings from TCS!!!! TCS is looking for Spark Scala Developer Experience: 6-8 years Location: Chennai MUST HAVE SKILLS: Data Engineer Design and develop scalable and efficient solutions using Spark, Scala, Python, Airflow. Good code and configuration spark knowledge (at least 1 or 2 profiles should be very good at spark configuration and...

  • java + spark developer

    2 weeks ago

    Ahmedabad, Bengaluru, Chennai, India Infosys Full time ₹ 7,50,000 - ₹ 15,00,000 per year

    Hiring Java + Spark Developer with experience range 5 to 15 Years of experienceMandatory Skills: Java /Spark/ Pyspark/ HadoopEducation: Btech/BE, BCA/MCA,Bsc/MSc

  • Spark, Scala, Spark Streaming

    2 weeks ago

    Hyderabad, India Fusion Plus Solutions Full time

    Job Description Extensive development experience with Spark, Scala and other Big Data technologies. Experience with object oriented/scripting language. Hands-on experience in Spark, Scala, Spark Streaming, Big Data technologies(Hive, Sqoop, Impala), Eclipse, Bitbucket. Understanding Business Requirements and Functional Requirements provided by Business...

  • Spark Scala Developer

    4 weeks ago

    Chennai, India Tata Consultancy Services Full time

    Dear Candidates,Greetings from TCS!!!!TCS is looking for Spark Scala DeveloperExperience: 6-8 yearsLocation: ChennaiMUST HAVE SKILLS:- Data Engineer Design and develop scalable and efficient solutions using Spark, Scala, Python, Airflow.- Good code and configuration spark knowledge (at least 1 or 2 profiles should be very good at spark configuration and...

  • Java/ Spark Developer

    2 weeks ago

    Chennai, Tamil Nadu, India Path Mentors Staffing Solution Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Translate use cases into functional apps; design, build, and optimize Java/Spark code; identify bottlenecks and fix bugs; process data with Hive, Impala, HBASE. Skills: 8+ yrs Java, Big Data (HDFS, Spark, Kafka), SQL, multithreading, Agile, Git. Required Candidate profileJava/Spark Developer with 5+ years' experience in Big Data, HDFS, Hive, Kafka, SQL, and...