PySpark Scala Developer

2 weeks ago

Bengaluru, Karnataka, India Talent Worx Full time
Role: Spark Scala Developer

Experience: 3–8 years

Location: Bengaluru

Employment Type: Full-time

⸻

What We're Looking For

We're hiring a Spark Scala Developer who has real-world experience working in Big Data environments, both on-prem and/or in the cloud. You should know how to write production-grade Spark applications, fine-tune performance, and work fluently with Scala's functional style. Experience with cloud platforms and modern data tools like Snowflake or Databricks is a strong plus.

⸻

Your Responsibilities

• Design and develop scalable data pipelines using Apache Spark and Scala

• Optimize and troubleshoot Spark jobs for performance (e.g. memory management, shuffles, skew)

• Work with massive datasets in on-prem Hadoop clusters or cloud platforms like AWS/GCP/Azure

• Write clean, modular Scala code using functional programming principles

• Collaborate with data teams to integrate with platforms like Snowflake, Databricks, or data lakes

• Ensure code quality, documentation, and CI/CD practices are followed

Requirements

Must-Have Skills

• 3+ years of experience with Apache Spark in Scala

• Deep understanding of Spark internals—DAG, stages, tasks, caching, joins, partitioning

• Hands-on experience with performance tuning in production Spark jobs

• Proficiency in Scala functional programming (e.g. immutability, higher-order functions, Option/Either)

• Proficiency in SQL

• Experience with any major cloud platform: AWS, Azure, or GCP

⸻

Nice-to-Have

• Worked with Databricks, Snowflake, or Delta Lake

• Exposure to data pipeline tools like Airflow, Kafka, Glue, or BigQuery

• Familiarity with CI/CD pipelines and Git-based workflows

• Comfortable with SQL optimization and schema design in distributed environments

Benefits

Work with one of the Big 4's in India

Healthy work Environment

Work Life Balance

  • Urgent) Azure, Spark,PySpark,Scala

    3 weeks ago

    Bengaluru, Karnataka, India Infosys Limited Full time

    Job DescriptionJob Description:- Azure Spark PySpark Scala- Azure Synapse- Azure knowledge mustKey Responsibilities:- Engage with Business Stakeholders with status update on progress of development and issue fix- Setup Standards related to Coding Pipelines and Documentation- Understand the requirements from the business and translate it into an appropriate...

  • Pyspark Architect

    3 days ago

    Bengaluru, Karnataka, India Talent Worx Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Job Description: PySpark ArchitectLocation: Bangalore,Pune,Kolkata Experience Required: 7 to 13 YearsRole Overview:We are seeking a highly skilled and motivated PySpark Manager to lead our dataengineering initiatives. The ideal candidate will have deep expertise in PySpark,Hadoop, AWS, Teradata, Scala, and data visualization tools. You will be responsible...

  • Scala Developer

    3 days ago

    Bengaluru, Karnataka, India beBeescaladeveloper Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Title: Scala DeveloperWe are looking for an experienced Scala developer to join our team.About the Role:This is a full-time position based in Bengaluru, Pune, Mumbai & ChennaiKey Responsibilities:Design and develop scalable and efficient software applications using ScalaMaintain and improve existing software systemsCollaborate with cross-functional teams...

  • Python/pyspark

    3 weeks ago

    Bengaluru, Karnataka, India CIEL HR Full time

    HiGreetings of the Day We have a critical opening with our client for the SAP ABAP Development for Python Pyspark for Bangalore Location Experience 8-12 years - Work Form Office Payroll Company Name CIEL Mode of Employment ContractNotice Period Immediate 15 days 30 days MaxJob descriptionBig data technologies Hadoop data lakes SQL scripting...

  • Scala Developer

    3 weeks ago

    Bengaluru, Karnataka, India Infosys Limited Full time

    Job DescriptionKey Responsibilities:- A day in the life of an Infoscion- As part of the Infosys delivery team your primary role would be to interface with the client for quality assurance issue resolution and ensuring high customer satisfaction- You will understand requirements create and review designs validate the architecture and ensure high levels of...

  • Scala Developer

    4 weeks ago

    Bengaluru, Karnataka, India Rapsys Technologies Full time

    Scala DeveloperExperience Required : Minimum 8+ Years.Location : Bangalore/ Mumbai.Job Type : Contract to hire (3 Months/ Renewable).Notice Period : Immediate to 1 Week Max.Mode of Interview : Virtual.Job Summary :We are looking for a skilled Scala Developer with at least 7+ years of professional experience in building scalable, high-performance backend...

  • Scala Developer

    3 days ago

    Bengaluru, Karnataka, India Weekday AI Full time ₹ 10,00,000 - ₹ 20,00,000 per year

    This role is for one of Weekday's clientsSalary range: Rs Rs ie INR 10-20 LPA)Min Experience: 8 yearsLocation: Bengaluru, MumbaiJobType: full-timeRequirementsJob Summary:We are looking for a skilled Scala Developer with at least 7+ years of professional experience in building scalable, high-performance backend applications. The ideal candidate should have a...

  • Scala Developer

    2 days ago

    Bengaluru, Karnataka, India Weekday AI Full time ₹ 10,00,000 - ₹ 20,00,000

    This role is for one of Weekday's clientsSalary range: Rs Rs ie INR 10-20 LPA)Min Experience: 8 yearsLocation: Bengaluru, MumbaiJobType: full-timeJob Summary:We are looking for a skilled Scala Developer with at least 7+ years of professional experience in building scalable, high-performance backend applications. The ideal candidate should have a strong grasp...

  • Scala Big Data Lead Engineer

    3 weeks ago

    Bengaluru, Karnataka, India UST Full time

    If you are highly interested and available immediately, please submit your resume along with your total experience, current CTC, notice period, and current location details to Nitin.patil@ust.comKey Responsibilities:- Design, develop, and optimize data pipelines and ETL workflows.- Work with Apache Hadoop, Airflow, Kubernetes, and Containers to streamline...

  • Scala Big Data Lead Engineer

    4 weeks ago

    Bengaluru, Karnataka, India UST Full time

    If you are highly interested and available immediately , please submit your resume along with your total experience, current CTC, notice period, and current location details to Key Responsibilities: Design, develop, and optimize data pipelines and ETL workflows . Work with Apache Hadoop, Airflow, Kubernetes, and Containers to streamline data processing....