Spark/Scala

6 days ago


Pune, Maharashtra, India Tata Consultancy Services (TCS) Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Role:Senior Developer

Required Technical Skill Set: Spark/Scala/Unix

Experience Range: 5-8 years

Location of Requirement : Pune

Must-Have

  1. Minimum 4+ years of experience in development of Spark Scala

  2. Experience in designing and development of solutions for Big Data using Hadoop ecosystem technologies such as with Hadoop Bigdata components like HDFS, Spark, Hive Parquet File format, YARN, MapReduce, Sqoop

  3. Good Experience in writing and optimizing Spark Jobs, Spark SQL etc. Should have worked on both batch and streaming data processing.

  4. Experience in writing and optimizing complex Hive and SQL queries to process huge data. good with UDFs, tables, joins, Views etc

  5. Experience in debugging the Spark code

  6. Working knowledge of basic UNIX commands and shell script

  7. Experience of Autosys, Gradle

Good-to-Have 1. Good analytical and debugging skills

  1. Ability to coordinate with SMEs, stakeholders, manage timelines, escalation & provide on time status

  2. Write clear and precise documentation / specification

  3. Work in an agile environment

  4. Create documentation and document all developed mappings

SN Responsibility of / Expectations from the Role

1 Create Scala/Spark jobs for data transformation and aggregation

2 Produce unit tests for Spark transformations and helper methods

3 Write Scaladoc-style documentation with all code

4 Design data processing pipelines

Location

Pune

Job Function

TECHNOLOGY

Role

Engineer

Job Id

381936

Desired Skills

Scala | Spark

Desired Candidate Profile

Qualifications : BACHELOR OF ENGINEERING


  • Scala Developer

    7 hours ago


    Pune, Maharashtra, India ID4 Consultancy Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    JD: Experience and Expertise in any of the following Languages at least 1 of them : Scala, Python, Java Experience and expertise in SPARK Architecture Experience in the range of 5-10 yrs plus Good Problem Solving and Analytical Skills Ability to Comprehend the Business requirement and translate to the Technical requirements Good communication...


  • Pune, Maharashtra, India HSBC Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Some careers shine brighter than others.If you're looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.HSBC is one of the largest banking and...


  • Pune, Maharashtra, India OPUS Technologies Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Who are we?Opus Technologies is a technology company with a focus on shaping the future of payment technology. With experience building highly innovative solutions and products, we combine our deep technology proficiency with unmatched domain expertise in payments and fintech, enabling us to deliver unparalleled quality and value in everything we do. For the...


  • Pune, Maharashtra, India Coforge Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are looking for a passionate and experiencedAWS-Scala Data Engineerto join our growing data engineering team. This role requires a strong foundation in cloud technologies, data processing, and programming, with a focus on building scalable and efficient data solutions.Key Responsibilities:Design, develop, and maintain scalable data pipelines on...

  • Scala Lead

    6 days ago


    Pune, Maharashtra, India Wipro Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Job DescriptionJob Title: Scala LeadReq Id: 72417City: PuneState/Province: MaharashtraPosting Start Date: 7/1/25Wipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) is a leading technology services and consulting company focused on building innovative solutions that address clients' most complex digital transformation needs. Leveraging our holistic portfolio...

  • Scala Lead

    1 week ago


    Pune, Maharashtra, India Wipro Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Wipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) is a leading technology services and consulting company focused on building innovative solutions that address clients' most complex digital transformation needs. Leveraging our holistic portfolio of capabilities in consulting, design, engineering, and operations, we help clients realize their boldest...


  • Pune, Maharashtra, India RM Technologies Full time ₹ 25 - ₹ 33 per year

    Hiring: Data Engineer (Scala) – High Priority Experience: 6+ years only Location: Hybrid (3 days/week from office) Pune Client: MNC Budget: 25-33 LPA Availability: Immediate Joiners only(max 30 days)We are looking for a skilled Data Engineer (Scala) to design, build, and optimize large-scale data pipelines and platforms. This role involves utilizing...


  • Pune, Maharashtra, India LTIMindtree Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Job description:Mandate Skills: Scala, Spark, SQLResponsibility:Overall, more than 5 Yrs of experience in Big Data projects.Experience in Scala programming languagesExperience in Big Data technologies including Spark Scala and KafkaWho have a good understanding of data structures and algorithmsHas worked in Implementation projects building data pipelines...

  • Lead Data Engineer

    1 week ago


    Pune, Maharashtra, India CG-VAK Software & Exports Ltd. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title:Data Engineer (Scala, Spark, Pyspark, Databricks)Remark - final round will be the F2FExperience: 10+ Years (Lead Role)ResponsibilitiesDesign, develop, and maintain robust and scalable data pipelines using Apache Spark and Scala on the Databricks platform.Implement ETL (Extract, Transform, Load) processes for various data sources, ensuring data...

  • Data Engineer

    7 days ago


    Pune, Maharashtra, India Opus Technologies Full time ₹ 4,00,000 - ₹ 12,00,000 per year

    Job Title: Data Engineer/Spark EngineerLocation: India(Pune)About the RoleWe are looking for a passionate and experienced Data Engineer to join our growing data team. This is a hands-on role for someone who thrives in building scalable data platforms from the ground up. Youll work with cutting-edge technologies including Apache Spark, Google Cloud Platform...