Spark/Scala Developer

6 days ago

india Gama Advisory Services LLP Full time

Overview :

We are seeking a talented Spark/Scala Developer with 2-3 years of experience in Big Data technologies to join our team.

As a Spark/Scala Developer, you will be responsible for designing, implementing, and maintaining scalable data pipelines and applications using Apache Spark and Scala.

Your expertise in Big Data processing and Scala programming will contribute to optimizing data workflows and driving actionable insights from large datasets.

Responsibilities :

- Design, develop, and deploy Spark-based applications and data pipelines for data processing and analytics.

- Implement data ingestion, transformation, and aggregation processes using Apache Spark and Scala.

- Collaborate with data engineers, data scientists, and analysts to understand data requirements and translate them into technical solutions.

- Optimize Spark jobs for performance, scalability, and reliability in a distributed computing environment.

- Develop and maintain ETL processes to integrate data from multiple sources into Spark-based systems.

- Implement data quality checks, validation, and monitoring processes to ensure data integrity.

- Troubleshoot and resolve issues related to data processing, job failures, and infrastructure problems.

- Document design decisions, technical specifications, and test plans.

- Stay updated with emerging technologies and industry trends in Big Data and Spark ecosystem.

Requirements :

- Bachelor's degree in Computer Science, Engineering, or related field.

- 2-3 years of hands-on experience as a Spark/Scala Developer or Big Data Engineer.

- Proficiency in Apache Spark and Scala programming for data processing and analytics.

- Solid understanding of distributed computing principles and Big Data technologies.

- Experience with Spark SQL, DataFrame/Dataset APIs, and performance tuning.

- Familiarity with data warehousing concepts, ETL processes, and data modeling.

- Strong analytical and problem-solving skills with attention to detail.

- Ability to work independently and as part of a team in a fast-paced environment.

- Excellent communication and collaboration skills.

Preferred Qualifications :

- Experience with other Big Data technologies such as Hadoop, Hive, Kafka, etc.

- Knowledge of cloud platforms (e.g, AWS, Azure, GCP) and their Big Data services.

- Familiarity with containerization (e.g, Docker, Kubernetes) and orchestration tools.

- Certification in Apache Spark or Scala programming is a plus

(ref:hirist.tech)

  • Scala Spark Developer

    2 weeks ago

    India Tavant Full time

    Scala Spark Developer Full Time Job Code: TI-82594 | Tavant Technologies India Private Limited India 15 positions Required Experience Years Skills scala, spark, Spark streaming + 3 more Job Description 3+ years of strong development experience in Scala and Spark Design, develop, test and deploy technical solutions Implement...

  • Scala Spark Developer

    4 weeks ago

    india Tavant Full time

    Scala Spark Developer Full Time Job Code: TI-82594 | Tavant Technologies India Private Limited  India 15 positions Required Experience 3 - 15 Years Skills scala, spark, Spark streaming + 3 more Job Description 3+ years of strong development experience in Scala and Spark Design, develop, test and deploy technical...

  • Spark & Scala Developer

    2 weeks ago

    India Radioactive Technologies Full time

    Spark & Scala Developer Exp- 7-13 yrs Shift- Malaysian / EUR Full time Contract Opportunity Fully Remote please share resume at Responsibilities- Create Scala/Spark jobs for data transformation and aggregation Produce unit tests for Spark transformations and helper methods Write Scaladoc-style documentation with all code Design data processing pipelines...

  • Spark & Scala Developer

    4 weeks ago

    india Radioactive Technologies Full time

    Spark & Scala Developer Exp- 7-13 yrs Shift- Malaysian / EUR Full time Contract Opportunity Fully Remote please share resume at Responsibilities- Create Scala/Spark jobs for data transformation and aggregation Produce unit tests for Spark transformations and helper methods Write Scaladoc-style documentation with all code Design data processing...

  • Spark/Scala Developer

    4 days ago

    Anywhere in India/Multiple Locations Gama Advisory Services LLP Full time

    Overview :We are seeking a talented Spark/Scala Developer with 2-3 years of experience in Big Data technologies to join our team. As a Spark/Scala Developer, you will be responsible for designing, implementing, and maintaining scalable data pipelines and applications using Apache Spark and Scala. Your expertise in Big Data processing and Scala programming...

  • Spark/Scala Developer

    5 days ago

    Anywhere in India/Multiple Locations, IN Gama Advisory Services LLP Full time

    Overview :We are seeking a talented Spark/Scala Developer with 2-3 years of experience in Big Data technologies to join our team. As a Spark/Scala Developer, you will be responsible for designing, implementing, and maintaining scalable data pipelines and applications using Apache Spark and Scala. Your expertise in Big Data processing and Scala programming...

  • Big Data Developer

    6 days ago

    india Wipro Full time

    Looking for an experienced Spark and Scala developer able to create an end-to-end data pipeline. Associate should be self-driven, can work with minimal guidance and guide the team technically. Exp - 5 to 9 Yrs Immediate Joiner Job Details: Expertise in Spark framework with scala language and Pyspark Expertise in ETL and Data Warehousing and cloud concepts...

  • Scala Senior Developer

    2 weeks ago

    India ADEREN Full time

    Job Description BUSCAMOS : Scala Senior Developer Profesional con más de 3 años de experiencia en proyectos back end en spark-scala en los ultimos 6 años.Conocimientos & Experiencia ● Conocimientos sólidos de bash script, spark, scala.● Conocimientos Hive.● Experiencia en desarrollo de aplicaciones batch/etl en spark, scala.● Capacidad para...

  • Scala Senior Developer

    4 weeks ago

    india ADEREN Full time

    Job Description BUSCAMOS : Scala Senior Developer Profesional con más de 3 años de experiencia en proyectos back end en spark-scala en los ultimos 6 años.  Conocimientos & Experiencia ● Conocimientos sólidos de bash script, spark, scala.● Conocimientos Hive.● Experiencia en desarrollo de aplicaciones batch/etl en spark, scala.● Capacidad para...

  • Senior Python Developer

    4 weeks ago

    Anywhere in India/Multiple Locations Varite Full time

    Salary : 12-20 LPA Responsibilities : Develop pipeline objects using PySpark, Flink, Apache Spark, and Scala. Design and implement real-time data streams utilizing Flink and PySpark. Utilize AWS services such as Glue, EMR, and VPC for infrastructure management and deployment. Design and develop data pipeline architectures using Confluent Kafka, Spark,...

  • Azure Spark Scala Developer

    4 weeks ago

    india UBS Full time

    Your role Do you want to design and build next generation business applications using the latest technologies? Are you self-assured at iteratively refining user requirements and removing any ambiguity? Do you have a curious nature, always interested in how to innovate?We're looking for software engineers to:• Design and implement technology solutions...

  • Senior Data Engineer

    2 weeks ago

    india BLossomJob Full time

    Senior Data Engineers (Scala, Spark/PySpark, SQL) x2 headcounts- Primarily experts of Spark 3.X, SCALA, Delta lake implementation, streaming solution implementationfor IOT in Spark streaming. Kafka expertise.Any experience with MFG BI, DWH and Datalake implementation would be a bonus. Location : WFH from IndiaDomain : Semicon- 1x new headcount in 7-10 yrs...

  • Senior Bigdata Engineer with Scala

    2 months ago

    india HTC Global Services Full time

    Job Details: • Should have hands on experience in Software development • Responsible for designing, deploying, and managing high quality data • Create and maintain optimal data architecture pipeline. • Collaborate with various onsite and client stakeholders in Agile environment to identify data engineering requirements and implement data...

  • Software Engineer

    4 weeks ago

    india UBS Full time

    Your role Azure Spark Scala DeveloperYour roleDo you want to design and build next generation business applications using the latest technologies? Are you self-assured at iteratively refining user requirements and removing any ambiguity? Do you have a curious nature, always interested in how to innovate?We're looking for software engineers to:• Design...

  • Senior Associate Big Data Engineer

    7 days ago

    india Suitable.AI Full time

    Role Objective : Data Engineer will be responsible for expanding and optimizing our data and database architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building. The Data Engineer will support our...

  • Big Data Engineer

    2 weeks ago

    india ATech Full time

    Designation: BIG DATA ENGINEERJob Description:Your Role and Responsibilities:- Understand a data warehousing solution and able to work independently in such an environment- Responsible in Project development and delivery experience of a few good size projects- Design, build, optimize and support new and existing data models and ETL processes based on our...

  • Senior Data Engineer

    4 weeks ago

    Anywhere in India/Multiple Locations BLossomJob Full time

    Senior Data Engineers (Scala, Spark/PySpark, SQL) x2 headcounts- Primarily experts of Spark 3.X, SCALA, Delta lake implementation, streaming solution implementationfor IOT in Spark streaming. Kafka expertise.Any experience with MFG BI, DWH and Datalake implementation would be a bonus. Location : WFH from IndiaDomain : Semicon- 1x new headcount in 7-10 yrs...

  • Senior Data Engineer

    4 weeks ago

    Anywhere in India/Multiple Locations, IN BLossomJob Full time

    Senior Data Engineers (Scala, Spark/PySpark, SQL) x2 headcounts- Primarily experts of Spark 3.X, SCALA, Delta lake implementation, streaming solution implementationfor IOT in Spark streaming. Kafka expertise.Any experience with MFG BI, DWH and Datalake implementation would be a bonus. Location : WFH from IndiaDomain : Semicon- 1x new headcount in 7-10 yrs...

  • Data Engineer

    2 weeks ago

    india Perfecthire Full time

    Job Description : We are seeking a talented and experienced Data Engineer to join our team and play a key role in the development and implementation of our end-to-end 834 EDI solution. A robust level of experience or familiarity with 834 EDI (Electronic Data Interchange) transactions is critical for this role. As a Data Engineer, you will be...

  • Scala+msSQL(Rarr Job 3282)

    3 weeks ago

    India RARR Technologies Pvt Ltd Full time

    For LTIMINDTREE - 5 - 8 Years- Full Time- PAN INDIA**Job Skills**: SQL MSSQL SPARK SCALA BIGDATA DATABASE - Design, code, and debug software enhancements and fixes in Scala, ensuring high performance and scalability. - Collaborate with cross-functional teams to gather requirements and translate them into technical specifications. - Perform unit testing...