Spark & Scala Developer
Found in: Talent IN 2A C2 - 3 weeks ago
Spark & Scala Developer
Exp- 7-13 yrs
Shift- Malaysian / EUR
Full time Contract Opportunity
Fully Remote
please share resume at Khalil@weradioactive.com
Responsibilities-
Create Scala/Spark jobs for data transformation and aggregation
Produce unit tests for Spark transformations and helper methods
Write Scaladoc-style documentation with all code
Design data processing pipelines
Skills-
Scala (with a focus on the functional programming paradigm)
Scalatest, JUnit, Mockito, Embedded Cassandra
Apache Spark 2.x
Apache Spark RDD API
Apache Spark SQL Data Frame API
Apache Spark MLlib API
Apache Spark GraphX API
Apache Spark Streaming API
Spark query tuning and performance optimization
Data Modelling, Data Warehousing, Hadoop, Hive, ETL
SQL database integration ,Microsoft, Oracle, Postgres, and/or MySQL
Experience working with HDFS, S3, Cassandra, and/or DynamoDB
Deep understanding of distributed systems (e.g. CAP theorem, partitioning, replication, consistency, and consensus)
-
Spark & Scala Developer
Found in: Whatjobs IN C2 - 3 weeks ago
Pune, India Radioactive Technologies Full timeSpark & Scala DeveloperExp- 7-13 yrsShift- Malaysian / EURFull time Contract OpportunityFully Remoteplease share resume at Responsibilities-Create Scala/Spark jobs for data transformation and aggregationProduce unit tests for Spark transformations and helper methodsWrite Scaladoc-style documentation with all codeDesign data processing pipelinesSkills-Scala...
-
Spark Scala Developer
Found in: Whatjobs IN C2 - 3 weeks ago
pune, India Corporate Resources Full timeJob Description 4+ years of experience with Java, Spark, Bigdata & Hadoop with strong Unix background Create Scala/Spark jobs for data transformation and aggregation Experience of writing code in spark and Scala Produce unit tests for Spark transformations and helper methods Write Scaladoc-style...
-
Spark & Scala Developer
Found in: Appcast Linkedin IN C2 - 3 weeks ago
Pune, India Radioactive Technologies Full timeSpark & Scala DeveloperExp- 7-13 yrsShift- Malaysian / EURFull time Contract OpportunityFully Remoteplease share resume at Khalil@weradioactive.comResponsibilities-Create Scala/Spark jobs for data transformation and aggregationProduce unit tests for Spark transformations and helper methodsWrite Scaladoc-style documentation with all codeDesign data processing...
-
Spark & Scala Developer
Found in: Whatjobs IN C2 - 3 weeks ago
Pune, India Radioactive Technologies Full timeSpark & Scala Developer Exp- 7-13 yrs Shift- Malaysian / EUR Full time Contract Opportunity Fully Remote please share resume at Responsibilities- Create Scala/Spark jobs for data transformation and aggregation Produce unit tests for Spark transformations and helper methods Write Scaladoc-style documentation with all code Design data processing...
-
Big Data Developer
Found in: Whatjobs IN C2 - 3 weeks ago
Pune, India CloudQ IT Services Full timeLooking for a candidate to help with migration of on-premise capital markets data lake to data bricks. Key skills : Spark, Scala, Pyspark- Good to have experience in Databricks - 4+ experience with various Hadoop/Databricks ecosystem components, 3+ years hands-on experience in Spark (Scala). - Working experience with Spark based data processing in Scala-...
-
Aws and Big Data
4 days ago
Pune, India WUElev8 Innovation Services Full time**Invite Your Friend** - Invite **Share on** **Posted on** - 07/25/2023, 03:38:06 AM - **Applications** **AWS and Big Data (Scala & Spark)** - DataVerze Full Time 15 days Notice period acceptable 5 vacancies AWS Big Data Spark scala EC2 S3 EMR Java Python 12 to 45 LPA 4 to 12 Years Pune, Maharashtra - Job Description- Skills Required- Company DetailsWe...
-
Developer - Spark/Scala
Found in: Whatjobs IN C2 - 3 weeks ago
Pune,Bangalore,Hyderabad,Mumbai,Delhi NCR, India TD Newton & Associates Full timeJob Description : Main duties and responsibilities :- Delivering on critical business priorities while evolving platform towards its strategic vision- Working closely with product managers, end users, and business analysts to understand business objectives and key success measures - Partnering with technology teams to design and architect solutions that...
-
Developer - Spark/Scala
Found in: Whatjobs IN C2 - 3 days ago
Pune/Bangalore/Hyderabad/Mumbai/Delhi NCR, India TD Newton & Associates Full timeJob Description : Main duties and responsibilities :- Delivering on critical business priorities while evolving platform towards its strategic vision- Working closely with product managers, end users, and business analysts to understand business objectives and key success measures - Partnering with technology teams to design and architect solutions that...
-
Developer - Spark/Scala
Found in: Adzuna IN C2 - 2 weeks ago
Pune/Bangalore/Hyderabad/Mumbai/Delhi NCR, IN TD Newton & Associates Full timeJob Description : Main duties and responsibilities :- Delivering on critical business priorities while evolving platform towards its strategic vision- Working closely with product managers, end users, and business analysts to understand business objectives and key success measures - Partnering with technology teams to design and architect solutions that...
-
CGI - Big Data Engineer - Scala/Spark
Found in: Talent IN 2A C2 - 3 weeks ago
Pune, India CGI Information Systems and Management Consultants Full timeJob Description :- Experience in application development experience in Scala, Spark, scala test/Junit libraries with maven.- Experience on Hive, Spark using Cloudera data platform.- Knowledge of performance optimization on Hadoop platform, Spark and Scala.- Ability to write optimized SQL queries.- Ability to learn & adapt.- Ability to communicate in clear &...
-
Data Engineer
Found in: Whatjobs IN C2 - 3 weeks ago
Pune,Hyderabad, India SKYGATE CONSULTING Full timeRole : Data EngineerExp : 5-12yrsLocation : Pune/HyderabadNotice Period : Immediate Joiners/ServingJob Description : Candidates who have good exposure in : - Strong Experience in Scala-Spark Development. - Strong experience in Apache, PySpark, Hadoop, Scala, Apache spark .- Extensive experience in writing advanced SQL statements and performance tuning...
-
Data Engineer
Found in: Whatjobs IN C2 - 3 days ago
Pune/Hyderabad, India SKYGATE CONSULTING Full timeRole : Data EngineerExp : 5-12yrsLocation : Pune/HyderabadNotice Period : Immediate Joiners/ServingJob Description : Candidates who have good exposure in : - Strong Experience in Scala-Spark Development. - Strong experience in Apache, PySpark, Hadoop, Scala, Apache spark .- Extensive experience in writing advanced SQL statements and performance tuning...
-
CGI - Big Data Engineer - Scala/Spark
Found in: Adzuna IN C2 - 2 weeks ago
Pune/Bangalore/Chennai/Hyderabad, IN CGI Information Systems and Management Consultants Full timeJob Description :- Experience in application development experience in Scala, Spark, scala test/Junit libraries with maven.- Experience on Hive, Spark using Cloudera data platform.- Knowledge of performance optimization on Hadoop platform, Spark and Scala.- Ability to write optimized SQL queries.- Ability to learn & adapt.- Ability to communicate in clear &...
-
CGI - Big Data Engineer - Scala/Spark
Found in: Whatjobs IN C2 - 3 weeks ago
Pune,Bangalore,Chennai,Hyderabad, India CGI Information Systems and Management Consultants Full timeJob Description : - Experience in application development experience in Scala, Spark, scala test/Junit libraries with maven.- Experience on Hive, Spark using Cloudera data platform.- Knowledge of performance optimization on Hadoop platform, Spark and Scala.- Ability to write optimized SQL queries.- Ability to learn & adapt.- Ability to communicate in clear...
-
Senior Data and Analytics Engineer
Found in: Appcast Linkedin IN C2 - 2 days ago
Pune, India QAAgility Technologies Full timeSenior Data and Analytics Engineer (Hadoop, Scala Spark)Experience Level: 5-8 yearsLocation: RemoteMandatory skills:Experience with Large Scale DatasetsScala SparkHadoop EcosystemKey Responsibilities:Manage and analyze large-scale datasets to extract actionable insights.Utilize hands-on experience in batch data processing within the Hadoop ecosystem.Develop...
-
Senior Data and Analytics Engineer
Found in: Talent IN 2A C2 - 2 days ago
Pune, India QAAgility Technologies Full timeSenior Data and Analytics Engineer (Hadoop, Scala Spark)Experience Level: 5-8 yearsLocation: RemoteMandatory skills:Experience with Large Scale DatasetsScala SparkHadoop EcosystemKey Responsibilities:Manage and analyze large-scale datasets to extract actionable insights.Utilize hands-on experience in batch data processing within the Hadoop ecosystem.Develop...
-
Senior Data and Analytics Engineer
Found in: Whatjobs IN C2 - 2 days ago
pune, India QAAgility Technologies Full timeSenior Data and Analytics Engineer (Hadoop, Scala Spark) Experience Level: 5-8 years Location: Remote Mandatory skills: Experience with Large Scale Datasets Scala Spark Hadoop Ecosystem Key Responsibilities: Manage and analyze large-scale datasets to extract actionable insights. Utilize hands-on experience in batch data processing within the Hadoop...
-
WovV Technologies
Found in: Adzuna IN C2 - 2 weeks ago
Pune, Maharashtra, India Wovv Technology Full timeJob Description: Big Data Pune (Hybrid Work module compulsory, WFH not 5-7 years.Contract Duration: Contract position for 6 months (can be Technology: Product development, Application development, Spark, Apache Airflow, Snowflake, BigQuery.Role and is a mandatory skill here. Please ensure that the candidate has worked into Scala before sharing the profiles....
-
WovV Technologies
Found in: Talent IN 2A C2 - 3 weeks ago
Pune, India Wovv Technology Full timeJob Description: Big Data Pune (Hybrid Work module compulsory, WFH not 5-7 years.Contract Duration: Contract position for 6 months (can be Technology: Product development, Application development, Spark, Apache Airflow, Snowflake, BigQuery.Role and is a mandatory skill here. Please ensure that the candidate has worked into Scala before sharing the...
-
WovV Technologies
Found in: Whatjobs IN C2 - 3 weeks ago
Pune, India Wovv Technology Full timeJob Description: Big Data Pune (Hybrid Work module compulsory, WFH not 5-7 years. Contract Duration: Contract position for 6 months (can be Technology: Product development, Application development, Spark, Apache Airflow, Snowflake, BigQuery. Role and is a mandatory skill here. Please ensure that the candidate has worked into Scala before sharing the...