Spark & Scala Developer

2 weeks ago


India Radioactive Technologies Full time

Spark & Scala Developer

Exp- 7-13 yrs

Shift- Malaysian / EUR

Full time Contract Opportunity

Fully Remote

please share resume at

Responsibilities-

Create Scala/Spark jobs for data transformation and aggregation

Produce unit tests for Spark transformations and helper methods

Write Scaladoc-style documentation with all code

Design data processing pipelines

Skills-

Scala (with a focus on the functional programming paradigm)

Scalatest, JUnit, Mockito, Embedded Cassandra

Apache Spark 2.x

Apache Spark RDD API

Apache Spark SQL Data Frame API

Apache Spark MLlib API

Apache Spark GraphX API

Apache Spark Streaming API

Spark query tuning and performance optimization

Data Modelling, Data Warehousing, Hadoop, Hive, ETL

SQL database integration ,Microsoft, Oracle, Postgres, and/or MySQL

Experience working with HDFS, S3, Cassandra, and/or DynamoDB

Deep understanding of distributed systems (e.g. CAP theorem, partitioning, replication, consistency, and consensus)


  • Scala Spark Developer

    2 weeks ago


    India Tavant Full time

    Scala Spark Developer Full Time Job Code: TI-82594 | Tavant Technologies India Private Limited India 15 positions Required Experience Years Skills scala, spark, Spark streaming + 3 more Job Description 3+ years of strong development experience in Scala and Spark Design, develop, test and deploy technical solutions Implement...

  • Scala Spark Developer

    4 weeks ago


    india Tavant Full time

    Scala Spark Developer Full Time Job Code: TI-82594 | Tavant Technologies India Private Limited  India 15 positions Required Experience 3 - 15 Years Skills scala, spark, Spark streaming + 3 more Job Description 3+ years of strong development experience in Scala and Spark Design, develop, test and deploy technical...


  • india Radioactive Technologies Full time

    Spark & Scala Developer Exp- 7-13 yrs Shift- Malaysian / EUR Full time Contract Opportunity Fully Remote please share resume at Responsibilities- Create Scala/Spark jobs for data transformation and aggregation Produce unit tests for Spark transformations and helper methods Write Scaladoc-style documentation with all code Design data processing...


  • india Gama Advisory Services LLP Full time

    Overview :We are seeking a talented Spark/Scala Developer with 2-3 years of experience in Big Data technologies to join our team. As a Spark/Scala Developer, you will be responsible for designing, implementing, and maintaining scalable data pipelines and applications using Apache Spark and Scala. Your expertise in Big Data processing and Scala programming...


  • Anywhere in India/Multiple Locations Gama Advisory Services LLP Full time

    Overview :We are seeking a talented Spark/Scala Developer with 2-3 years of experience in Big Data technologies to join our team. As a Spark/Scala Developer, you will be responsible for designing, implementing, and maintaining scalable data pipelines and applications using Apache Spark and Scala. Your expertise in Big Data processing and Scala programming...


  • Anywhere in India/Multiple Locations, IN Gama Advisory Services LLP Full time

    Overview :We are seeking a talented Spark/Scala Developer with 2-3 years of experience in Big Data technologies to join our team. As a Spark/Scala Developer, you will be responsible for designing, implementing, and maintaining scalable data pipelines and applications using Apache Spark and Scala. Your expertise in Big Data processing and Scala programming...

  • Big Data Developer

    7 days ago


    india Wipro Full time

    Looking for an experienced Spark and Scala developer able to create an end-to-end data pipeline. Associate should be self-driven, can work with minimal guidance and guide the team technically. Exp - 5 to 9 Yrs Immediate Joiner Job Details: Expertise in Spark framework with scala language and Pyspark Expertise in ETL and Data Warehousing and cloud concepts...


  • India ADEREN Full time

    Job Description BUSCAMOS : Scala Senior Developer Profesional con más de 3 años de experiencia en proyectos back end en spark-scala en los ultimos 6 años.Conocimientos & Experiencia ● Conocimientos sólidos de bash script, spark, scala.● Conocimientos Hive.● Experiencia en desarrollo de aplicaciones batch/etl en spark, scala.● Capacidad para...


  • india ADEREN Full time

    Job Description BUSCAMOS : Scala Senior Developer Profesional con más de 3 años de experiencia en proyectos back end en spark-scala en los ultimos 6 años.  Conocimientos & Experiencia ● Conocimientos sólidos de bash script, spark, scala.● Conocimientos Hive.● Experiencia en desarrollo de aplicaciones batch/etl en spark, scala.● Capacidad para...


  • Anywhere in India/Multiple Locations Varite Full time

    Salary : 12-20 LPA Responsibilities : Develop pipeline objects using PySpark, Flink, Apache Spark, and Scala. Design and implement real-time data streams utilizing Flink and PySpark. Utilize AWS services such as Glue, EMR, and VPC for infrastructure management and deployment. Design and develop data pipeline architectures using Confluent Kafka, Spark,...


  • india UBS Full time

    Your role Do you want to design and build next generation business applications using the latest technologies? Are you self-assured at iteratively refining user requirements and removing any ambiguity? Do you have a curious nature, always interested in how to innovate?We're looking for software engineers to:• Design and implement technology solutions...

  • Senior Data Engineer

    2 weeks ago


    india BLossomJob Full time

    Senior Data Engineers (Scala, Spark/PySpark, SQL) x2 headcounts- Primarily experts of Spark 3.X, SCALA, Delta lake implementation, streaming solution implementationfor IOT in Spark streaming. Kafka expertise.Any experience with MFG BI, DWH and Datalake implementation would be a bonus. Location : WFH from IndiaDomain : Semicon- 1x new headcount in 7-10 yrs...


  • india HTC Global Services Full time

    Job Details: • Should have hands on experience in Software development • Responsible for designing, deploying, and managing high quality data • Create and maintain optimal data architecture pipeline. • Collaborate with various onsite and client stakeholders in Agile environment to identify data engineering requirements and implement data...

  • Software Engineer

    4 weeks ago


    india UBS Full time

    Your role Azure Spark Scala DeveloperYour roleDo you want to design and build next generation business applications using the latest technologies? Are you self-assured at iteratively refining user requirements and removing any ambiguity? Do you have a curious nature, always interested in how to innovate?We're looking for software engineers to:• Design...


  • india Suitable.AI Full time

    Role Objective : Data Engineer will be responsible for expanding and optimizing our data and database architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building. The Data Engineer will support our...

  • Big Data Engineer

    2 weeks ago


    india ATech Full time

    Designation: BIG DATA ENGINEERJob Description:Your Role and Responsibilities:- Understand a data warehousing solution and able to work independently in such an environment- Responsible in Project development and delivery experience of a few good size projects- Design, build, optimize and support new and existing data models and ETL processes based on our...

  • Senior Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations BLossomJob Full time

    Senior Data Engineers (Scala, Spark/PySpark, SQL) x2 headcounts- Primarily experts of Spark 3.X, SCALA, Delta lake implementation, streaming solution implementationfor IOT in Spark streaming. Kafka expertise.Any experience with MFG BI, DWH and Datalake implementation would be a bonus. Location : WFH from IndiaDomain : Semicon- 1x new headcount in 7-10 yrs...

  • Senior Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations, IN BLossomJob Full time

    Senior Data Engineers (Scala, Spark/PySpark, SQL) x2 headcounts- Primarily experts of Spark 3.X, SCALA, Delta lake implementation, streaming solution implementationfor IOT in Spark streaming. Kafka expertise.Any experience with MFG BI, DWH and Datalake implementation would be a bonus. Location : WFH from IndiaDomain : Semicon- 1x new headcount in 7-10 yrs...


  • India RARR Technologies Pvt Ltd Full time

    For LTIMINDTREE - 5 - 8 Years- Full Time- PAN INDIA**Job Skills**: SQL MSSQL SPARK SCALA BIGDATA DATABASE - Design, code, and debug software enhancements and fixes in Scala, ensuring high performance and scalability. - Collaborate with cross-functional teams to gather requirements and translate them into technical specifications. - Perform unit testing...

  • Data Engineer

    2 weeks ago


    india Perfecthire Full time

    Job Description : We are seeking a talented and experienced Data Engineer to join our team and play a key role in the development and implementation of our end-to-end 834 EDI solution. A robust level of experience or familiarity with 834 EDI (Electronic Data Interchange) transactions is critical for this role. As a Data Engineer, you will be...