Spark & Scala Developer

7 days ago


pune, India Radioactive Technologies Full time
Spark & Scala Developer
Shift- Malaysian / EUR
Exp- 4+ yrs (2 Positions), 9- 11 yrs (1 Position)
Full time Contract Opportunity
Fully Remote
please share resume at
Responsibilities-
Create Scala/Spark jobs for data transformation and aggregation
Produce unit tests for Spark transformations and helper methods
Write Scaladoc-style documentation with all code
Design data processing pipelines
Skills-
Scala (with a focus on the functional programming paradigm)
Scalatest, JUnit, Mockito, Embedded Cassandra
Apache Spark 2.x
Apache Spark RDD API
Apache Spark SQL Data Frame API
Apache Spark MLlib API
Apache Spark GraphX API
Apache Spark Streaming API
Spark query tuning and performance optimization
Data Modelling, Data Warehousing, Hadoop, Hive, ETL
SQL database integration ,Microsoft, Oracle, Postgres, and/or MySQL
Experience working with HDFS, S3, Cassandra, and/or DynamoDB
Deep understanding of distributed systems (e.g. CAP theorem, partitioning, replication, consistency, and consensus)

  • Pune, India Radioactive Technologies Full time

    Spark & Scala DeveloperExp- 7-13 yrsShift- Malaysian / EURFull time Contract OpportunityFully Remoteplease share resume at Responsibilities-Create Scala/Spark jobs for data transformation and aggregationProduce unit tests for Spark transformations and helper methodsWrite Scaladoc-style documentation with all codeDesign data processing pipelinesSkills-Scala...

  • Spark Scala Developer

    2 months ago


    pune, India Corporate Resources Full time

    Job Description 4+ years of experience with Java, Spark, Bigdata & Hadoop with strong Unix background Create Scala/Spark jobs for data transformation and aggregation Experience of writing code in spark and Scala Produce unit tests for Spark transformations and helper methods Write Scaladoc-style...


  • Pune, India Radioactive Technologies Full time

    Spark & Scala DeveloperExp- 7-13 yrsShift- Malaysian / EURFull time Contract OpportunityFully Remoteplease share resume at Khalil@weradioactive.comResponsibilities-Create Scala/Spark jobs for data transformation and aggregationProduce unit tests for Spark transformations and helper methodsWrite Scaladoc-style documentation with all codeDesign data processing...


  • Pune, India Radioactive Technologies Full time

    Spark & Scala Developer Exp- 7-13 yrs Shift- Malaysian / EUR Full time Contract Opportunity Fully Remote please share resume at Responsibilities- Create Scala/Spark jobs for data transformation and aggregation Produce unit tests for Spark transformations and helper methods Write Scaladoc-style documentation with all code Design data processing...


  • Pune, India Radioactive Technologies Full time

    Spark & Scala DeveloperShift- Malaysian / EURExp- 4+ yrs (2 Positions), 9- 11 yrs (1 Position)Full time Contract OpportunityFully Remoteplease share resume at Khalil@weradioactive.comResponsibilities-Create Scala/Spark jobs for data transformation and aggregationProduce unit tests for Spark transformations and helper methodsWrite Scaladoc-style documentation...


  • Pune, India Radioactive Technologies Full time

    Spark & Scala Developer Shift- Malaysian / EUR Exp- 4+ yrs (2 Positions), 9- 11 yrs (1 Position) Full time Contract Opportunity Fully Remote please share resume at Responsibilities- Create Scala/Spark jobs for data transformation and aggregation Produce unit tests for Spark transformations and helper methods Write Scaladoc-style documentation with all...

  • Spark Scala Developer

    3 weeks ago


    Pune, India Corporate Resources Full time

    Job Description4+ years of experience with Java, Spark, Bigdata & Hadoop with strong Unix backgroundCreate Scala/Spark jobs for data transformation and aggregationExperience of writing code in spark and ScalaProduce unit tests for Spark transformations and helper methodsWrite Scaladoc-style documentation with all codeDesign data processing pipelinesScala...

  • Scala Developer

    4 days ago


    pune, India T D Newton Full time

    Urgent requirement for Scala Developer.Experience : 4-7 YrsJob Location : Pune/Bangalore/HyderabadMust have : Scala, Spark, CI/CD, Airflow, Hadoop, SQL Job Description :As a key member of the technical team alongside Engineers, Data Scientists and Data Users, you will be expected to define and contribute at a high-level to many aspects of our collaborative...


  • Pune, India Robosoft Technologies Full time

    Technical/Functional SkillsMust have 4+ years of IT experienceMust have good experience in Spark and ScalaGood to have experience instreaming systems like Spark streaming and StormExperience with Spark Data processing, Performance Tuning, Memory Management, Fault Tolerance, ScalabilityGood knowledge of Hive, Sqoop, Spark, Data warehousing and information...

  • Scala Developer

    2 weeks ago


    Bangalore/Pune/Hyderabad, India T D Newton Full time

    Urgent requirement for Scala Developer.Experience : 4-7 YrsJob Location : Pune/Bangalore/HyderabadMust have : Scala, Spark, CI/CD, Airflow, Hadoop, SQL Job Description :As a key member of the technical team alongside Engineers, Data Scientists and Data Users, you will be expected to define and contribute at a high-level to many aspects of our collaborative...

  • Scala Developer

    1 week ago


    Bangalore/Pune/Hyderabad, IN T D Newton Full time

    Urgent requirement for Scala Developer.Experience : 4-7 YrsJob Location : Pune/Bangalore/HyderabadMust have : Scala, Spark, CI/CD, Airflow, Hadoop, SQLJob Description :As a key member of the technical team alongside Engineers, Data Scientists and Data Users, you will be expected to define and contribute at a high-level to many aspects of our collaborative...

  • Aws and Big Data

    2 months ago


    Pune, India WUElev8 Innovation Services Full time

    **Invite Your Friend** - Invite **Share on** **Posted on** - 07/25/2023, 03:38:06 AM - **Applications** **AWS and Big Data (Scala & Spark)** - DataVerze Full Time 15 days Notice period acceptable 5 vacancies AWS Big Data Spark scala EC2 S3 EMR Java Python 12 to 45 LPA 4 to 12 Years Pune, Maharashtra - Job Description- Skills Required- Company DetailsWe...


  • Pune/Bangalore/Hyderabad/Mumbai/Delhi NCR, India TD Newton & Associates Full time

    Job Description : Main duties and responsibilities :- Delivering on critical business priorities while evolving platform towards its strategic vision- Working closely with product managers, end users, and business analysts to understand business objectives and key success measures - Partnering with technology teams to design and architect solutions that...


  • Pune, India CGI Information Systems and Management Consultants Full time

    Job Description :- Experience in application development experience in Scala, Spark, scala test/Junit libraries with maven.- Experience on Hive, Spark using Cloudera data platform.- Knowledge of performance optimization on Hadoop platform, Spark and Scala.- Ability to write optimized SQL queries.- Ability to learn & adapt.- Ability to communicate in clear &...

  • Data Streaming

    2 weeks ago


    Pune, India ACE Talent Consulting Full time

    Job Description: Spark/Scala/PySpark developer who knows how to fully exploit the potential of our Spark cluster. Should have ability to clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data. **Responsibilities**: Create Scala/Spark/Pyspark jobs for data transformation and aggregation Produce...

  • Data Streaming

    2 weeks ago


    Pune, India ACE Talent Consulting Full time

    ob Description: Spark/Scala/PySpark developer who knows how to fully exploit the potential of our Spark cluster. Should have ability to clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data. **Responsibilities**: Create Scala/Spark/Pyspark jobs for data transformation and aggregation Produce...


  • Pune,Bangalore,Chennai,Hyderabad, India CGI Information Systems and Management Consultants Full time

    Job Description : - Experience in application development experience in Scala, Spark, scala test/Junit libraries with maven.- Experience on Hive, Spark using Cloudera data platform.- Knowledge of performance optimization on Hadoop platform, Spark and Scala.- Ability to write optimized SQL queries.- Ability to learn & adapt.- Ability to communicate in clear...

  • Big Data Developer

    2 months ago


    Pune, India SP Software Pvt. Ltd. Full time

    Job Description :- Should have hands on experience in Software development- Responsible for designing, deploying, and managing high quality data solutions in the AWS cloud ecosystem.- Create and maintain optimal data architecture pipeline.- Collaborate with various onsite and client stakeholders in Agile environment to identify data engineering requirements...

  • WovV Technologies

    3 weeks ago


    Pune, India Wovv Technology Full time

    Job Description: Big Data Pune (Hybrid Work module compulsory, WFH not 5-7 years. Contract Duration: Contract position for 6 months (can be Technology: Product development, Application development, Spark, Apache Airflow, Snowflake, BigQuery. Role and is a mandatory skill here. Please ensure that the candidate has worked into Scala before sharing the...

  • WovV Technologies

    2 months ago


    Pune, India Wovv Technology Full time

    Job Description: Big Data Pune (Hybrid Work module compulsory, WFH not 5-7 years. Contract Duration: Contract position for 6 months (can be Technology: Product development, Application development, Spark, Apache Airflow, Snowflake, BigQuery. Role and is a mandatory skill here. Please ensure that the candidate has worked into Scala before sharing the...