Spark Scala Developer

6 days ago


Pune, India Radioactive Technologies Full time

Spark Scala Developer

Shift- EUR

Exp- 10+ yrs


Full time Contract Opportunity

Fully Remote


please share resume at Khalil@weradioactive.com


Responsibilities-

Create Scala/Spark jobs for data transformation and aggregation

Produce unit tests for Spark transformations and helper methods

Write Scaladoc-style documentation with all code

Design data processing pipelines

Skills-

Scala (with a focus on the functional programming paradigm)

Scalatest, JUnit, Mockito, Embedded Cassandra

Apache Spark 2.x

Apache Spark RDD API

Apache Spark SQL Data Frame API

Apache Spark MLlib API

Apache Spark GraphX API

Apache Spark Streaming API

Spark query tuning and performance optimization

Data Modelling, Data Warehousing, Hadoop, Hive, ETL

SQL database integration ,Microsoft, Oracle, Postgres, and/or MySQL

Experience working with HDFS, S3, Cassandra, and/or DynamoDB

Deep understanding of distributed systems (e.g. CAP theorem, partitioning, replication, consistency, and consensus)


  • Spark scala developer

    2 months ago


    pune, India Wipro Full time

    Min 6+ year’s experience.BS or MS (preferred) in Computer Science or Information TechnologyHands on Experience as a software engineer in a globally distributed team working with Scala, Spark programming languageExperience with big-data technologies Spark/Databricks and Hadoop/ADLS is a mustExperience in any one of the cloud platform Azure (Preferred), AWS...

  • Spark scala developer

    2 months ago


    Pune, India Wipro Full time

    Min 6+ year’s experience.BS or MS (preferred) in Computer Science or Information TechnologyHands on Experience as a software engineer in a globally distributed team working with Scala, Spark programming languageExperience with big-data technologies Spark/Databricks and Hadoop/ADLS is a mustExperience in any one of the cloud platform Azure (Preferred), AWS...

  • Spark scala developer

    2 months ago


    pune, India Wipro Full time

    Min 6+ year’s experience.BS or MS (preferred) in Computer Science or Information TechnologyHands on Experience as a software engineer in a globally distributed team working with Scala, Spark programming languageExperience with big-data technologies Spark/Databricks and Hadoop/ADLS is a mustExperience in any one of the cloud platform Azure (Preferred), AWS...

  • Spark scala developer

    2 months ago


    pune, India Wipro Full time

    Min 6+ year’s experience. BS or MS (preferred) in Computer Science or Information Technology Hands on Experience as a software engineer in a globally distributed team working with Scala, Spark programming language Experience with big-data technologies Spark/Databricks and Hadoop/ADLS is a must Experience in any one of the cloud platform Azure...

  • Spark scala developer

    2 months ago


    Pune, India Wipro Full time

    Min 6+ year’s experience. BS or MS (preferred) in Computer Science or Information Technology Hands on Experience as a software engineer in a globally distributed team working with Scala, Spark programming language Experience with big-data technologies Spark/Databricks and Hadoop/ADLS is a must Experience in any one of the cloud platform Azure...

  • Scala Spark Developer

    4 weeks ago


    Pune, Maharashtra, India Wipro Full time

    We are seeking a highly skilled Scala Spark Developer to join our team at Wipro. In this role, you will be working with big-data technologies and cloud platforms to design and develop scalable data pipelines.Job DescriptionThe successful candidate will have a minimum of 6 years of experience in software development, with expertise in Scala and Spark...


  • Pune, India Citi Full time

    **Responsibilities**: - Bachelor’s degree (in Computer Science, Information Technology). - Must have good programming skills and should be aware of OOPS concept, design principles, data structures. - Good experience in Big Data technologies (A MUST) - HDFS. - Good knowledge of databases: Hive, Hbase. - Good knowledge in Apache Spark, Spark-SQL, UDF,...

  • Spark Scala Dev

    10 hours ago


    Pune, India Advance Agility Full time

    Pune, Maharashtra, India Job Type Full Time **About the Role**: 1. Experience on Spark with Scala/Python/Java. 2. Experience on Azure Cloud, Docker, Kubernetes will be added advantage Work in Hybrid Model

  • Data Engineer

    2 months ago


    Pune, India Huntsmen and barons Full time

    Skills : Apache Spark & ScalaKey Responsibilities :Spark Framework Expertise :- Demonstrate a thorough understanding of the Spark framework, including its architecture and core components.- Optimize Spark applications for performance, ensuring efficient data processing and resource management.Programming Skills :- Utilize Scala or PySpark for developing data...

  • Tcs data Streaming

    1 week ago


    Pashan, Pune, Maharashtra, India Response Informatics Full time

    JOB DESCRIPTION: Spark/Scala/PySpark developer who knows how to fully exploit the potential of our Spark cluster. Should have ability to clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data. SKILLS: Pyspark Scala (with a focus on the functional programming paradigm) Apache Spark 2.x, 3.x -...

  • Data Engineer

    6 days ago


    Bangalore/Hyderabad/Chennai/Pune/Gurgaon/Gurugram/Noida, India Huntsmen and barons Full time

    Skills : Apache Spark & Scala Key Responsibilities : Spark Framework Expertise : - Demonstrate a thorough understanding of the Spark framework, including its architecture and core components.- Optimize Spark applications for performance, ensuring efficient data processing and resource management.Programming Skills : - Utilize Scala or PySpark for developing...

  • Scala/Spark Developer

    1 month ago


    Mumbai/Pune/Bangalore, India Xoriant Solutions Full time

    We are eagerly seeking candidates with 5 to 9 years' experience for a Spark & Scala Developer to join our dynamic team. The ideal candidate will play a pivotal role for our business in delivering data and insights to our clients. We're driving the company's digital transformation and expanding business capabilities using industry best...


  • Pune, Maharashtra, India LTIMindtree Full time

    We are looking for a skilled Spark Development Professional to join our team at LTIMindtree. The successful candidate will be responsible for designing and developing scalable data processing systems using Spark.The ideal candidate should have experience working with EMR EKS AWS and be familiar with OSS Delta Lake and Open Source Storage. A strong...


  • Pune, Maharashtra, India ZettaMine Labs Pvt. Ltd. Full time

    About ZettaMine LabsWe are a cutting-edge data analytics company focused on delivering innovative solutions to our clients. Our team is comprised of highly skilled professionals who collaborate to design, build, and optimize scalable data pipelines and analytics platforms.Estimated Salary Range: ₹1,200,000 - ₹1,800,000 per annumJob DescriptionThe Senior...

  • Big Data Engineer

    1 day ago


    Pune, Maharashtra, India Radioactive Technologies Full time

    Job Description:We are seeking a highly skilled Big Data Engineer - Scala Developer to join our team at Radioactive Technologies.About the Role:The ideal candidate will have extensive experience in designing and developing data processing pipelines using Apache Spark and Scala. They should be proficient in creating unit tests for Spark transformations and...


  • Pune, India Zimetrics Technologies Private Limited Full time

    Job Summary :We are seeking a skilled Scala & Big Data Engineer to join our team in Pune. The ideal candidate will have expertise in Scala programming and Big Data technologies, with hands-on experience in designing and implementing data processing pipelines. This role offers an exciting opportunity to work with cutting-edge technologies in a dynamic...


  • Pune, Maharashtra, India Talent Pro Full time

    Job Overview: We are seeking an experienced Scaler Spark Developer to join our team at Talent Pro. In this role, you will be responsible for leading the development of scalable distributed architecture defined by the Architect or tech Lead in our team.Key Responsibilities:Develop the front-end of applications through visually appealing and user-friendly...

  • Spark Developer

    5 months ago


    Pune, India Talent Pro Full time

    Role : Spark DeveloperJob Description :- Work with development teams and product managers to build new product features, enhancements etc.- Build the front-end of applications through appealing visual design- Develop and manage well-functioning databases and applications- Design & develop data and event processing pipelines- Test software to ensure...


  • Pune, India Apptware Solutions LLP Full time

    About Us : Apptware is a leading technology solutions provider dedicated to delivering innovative digital products and services. Our team comprises creative thinkers, tech enthusiasts, and strategic experts committed to transforming businesses and enhancing user experiences with cutting-edge technology. We are passionate about enabling our partners'...


  • Pune, Maharashtra, India Capgemini Full time

    **At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world’s most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&D and...