Spark/Scala Developer

4 days ago

Anywhere in IndiaMultiple Locations Gama Advisory Services LLP Full time

Overview :

We are seeking a talented Spark/Scala Developer with 2-3 years of experience in Big Data technologies to join our team.

As a Spark/Scala Developer, you will be responsible for designing, implementing, and maintaining scalable data pipelines and applications using Apache Spark and Scala.

Your expertise in Big Data processing and Scala programming will contribute to optimizing data workflows and driving actionable insights from large datasets.

Responsibilities :

- Design, develop, and deploy Spark-based applications and data pipelines for data processing and analytics.

- Implement data ingestion, transformation, and aggregation processes using Apache Spark and Scala.

- Collaborate with data engineers, data scientists, and analysts to understand data requirements and translate them into technical solutions.

- Optimize Spark jobs for performance, scalability, and reliability in a distributed computing environment.

- Develop and maintain ETL processes to integrate data from multiple sources into Spark-based systems.

- Implement data quality checks, validation, and monitoring processes to ensure data integrity.

- Troubleshoot and resolve issues related to data processing, job failures, and infrastructure problems.

- Document design decisions, technical specifications, and test plans.

- Stay updated with emerging technologies and industry trends in Big Data and Spark ecosystem.

Requirements :

- Bachelor's degree in Computer Science, Engineering, or related field.

- 2-3 years of hands-on experience as a Spark/Scala Developer or Big Data Engineer.

- Proficiency in Apache Spark and Scala programming for data processing and analytics.

- Solid understanding of distributed computing principles and Big Data technologies.

- Experience with Spark SQL, DataFrame/Dataset APIs, and performance tuning.

- Familiarity with data warehousing concepts, ETL processes, and data modeling.

- Strong analytical and problem-solving skills with attention to detail.

- Ability to work independently and as part of a team in a fast-paced environment.

- Excellent communication and collaboration skills.

Preferred Qualifications :

- Experience with other Big Data technologies such as Hadoop, Hive, Kafka, etc.

- Knowledge of cloud platforms (e.g, AWS, Azure, GCP) and their Big Data services.

- Familiarity with containerization (e.g, Docker, Kubernetes) and orchestration tools.

- Certification in Apache Spark or Scala programming is a plus

(ref:hirist.tech)

  • Spark/Scala Developer

    5 days ago

    Anywhere in India/Multiple Locations, IN Gama Advisory Services LLP Full time

    Overview :We are seeking a talented Spark/Scala Developer with 2-3 years of experience in Big Data technologies to join our team. As a Spark/Scala Developer, you will be responsible for designing, implementing, and maintaining scalable data pipelines and applications using Apache Spark and Scala. Your expertise in Big Data processing and Scala programming...

  • Senior Python Developer

    4 weeks ago

    Anywhere in India/Multiple Locations Varite Full time

    Salary : 12-20 LPA Responsibilities : Develop pipeline objects using PySpark, Flink, Apache Spark, and Scala. Design and implement real-time data streams utilizing Flink and PySpark. Utilize AWS services such as Glue, EMR, and VPC for infrastructure management and deployment. Design and develop data pipeline architectures using Confluent Kafka, Spark,...

  • Scala Spark Developer

    2 weeks ago

    India Tavant Full time

    Scala Spark Developer Full Time Job Code: TI-82594 | Tavant Technologies India Private Limited India 15 positions Required Experience Years Skills scala, spark, Spark streaming + 3 more Job Description 3+ years of strong development experience in Scala and Spark Design, develop, test and deploy technical solutions Implement...

  • Scala Spark Developer

    4 weeks ago

    india Tavant Full time

    Scala Spark Developer Full Time Job Code: TI-82594 | Tavant Technologies India Private Limited  India 15 positions Required Experience 3 - 15 Years Skills scala, spark, Spark streaming + 3 more Job Description 3+ years of strong development experience in Scala and Spark Design, develop, test and deploy technical...

  • Spark & Scala Developer

    2 weeks ago

    India Radioactive Technologies Full time

    Spark & Scala Developer Exp- 7-13 yrs Shift- Malaysian / EUR Full time Contract Opportunity Fully Remote please share resume at Responsibilities- Create Scala/Spark jobs for data transformation and aggregation Produce unit tests for Spark transformations and helper methods Write Scaladoc-style documentation with all code Design data processing pipelines...

  • Spark & Scala Developer

    4 weeks ago

    india Radioactive Technologies Full time

    Spark & Scala Developer Exp- 7-13 yrs Shift- Malaysian / EUR Full time Contract Opportunity Fully Remote please share resume at Responsibilities- Create Scala/Spark jobs for data transformation and aggregation Produce unit tests for Spark transformations and helper methods Write Scaladoc-style documentation with all code Design data processing...

  • Senior Data Engineer

    4 weeks ago

    Anywhere in India/Multiple Locations BLossomJob Full time

    Senior Data Engineers (Scala, Spark/PySpark, SQL) x2 headcounts- Primarily experts of Spark 3.X, SCALA, Delta lake implementation, streaming solution implementationfor IOT in Spark streaming. Kafka expertise.Any experience with MFG BI, DWH and Datalake implementation would be a bonus. Location : WFH from IndiaDomain : Semicon- 1x new headcount in 7-10 yrs...

  • Senior Data Engineer

    4 weeks ago

    Anywhere in India/Multiple Locations, IN BLossomJob Full time

    Senior Data Engineers (Scala, Spark/PySpark, SQL) x2 headcounts- Primarily experts of Spark 3.X, SCALA, Delta lake implementation, streaming solution implementationfor IOT in Spark streaming. Kafka expertise.Any experience with MFG BI, DWH and Datalake implementation would be a bonus. Location : WFH from IndiaDomain : Semicon- 1x new headcount in 7-10 yrs...

  • Spark/Scala Developer

    7 days ago

    india Gama Advisory Services LLP Full time

    Overview :We are seeking a talented Spark/Scala Developer with 2-3 years of experience in Big Data technologies to join our team. As a Spark/Scala Developer, you will be responsible for designing, implementing, and maintaining scalable data pipelines and applications using Apache Spark and Scala. Your expertise in Big Data processing and Scala programming...

  • Data Engineer

    4 weeks ago

    Anywhere in India/Multiple Locations Perfecthire Full time

    Job Description : We are seeking a talented and experienced Data Engineer to join our team and play a key role in the development and implementation of our end-to-end 834 EDI solution. A robust level of experience or familiarity with 834 EDI (Electronic Data Interchange) transactions is critical for this role. As a Data Engineer, you will be...

  • Data Engineer

    4 weeks ago

    Anywhere in India/Multiple Locations, IN Perfecthire Full time

    Job Description : We are seeking a talented and experienced Data Engineer to join our team and play a key role in the development and implementation of our end-to-end 834 EDI solution. A robust level of experience or familiarity with 834 EDI (Electronic Data Interchange) transactions is critical for this role. As a Data Engineer, you will be responsible for...

  • Big Data Developer

    7 days ago

    india Wipro Full time

    Looking for an experienced Spark and Scala developer able to create an end-to-end data pipeline. Associate should be self-driven, can work with minimal guidance and guide the team technically. Exp - 5 to 9 Yrs Immediate Joiner Job Details: Expertise in Spark framework with scala language and Pyspark Expertise in ETL and Data Warehousing and cloud concepts...

  • Scala & Hadoop Engineer - ETL/Data Ingestion

    3 days ago

    Anywhere in India/Multiple Locations Taggd Full time

    Responsibilities :- Design, develop, and implement data pipelines and ETL processes using Scala and Spark for efficient data ingestion, transformation, and loading.- Utilize PySpark and Spark SQL for large-scale data analysis and manipulation.- Possess strong proficiency in SQL for querying and manipulating data within Big Data platforms.- Leverage your...

  • Scala & Hadoop Engineer - ETL/Data Ingestion

    4 days ago

    Anywhere in India/Multiple Locations, IN Taggd Full time

    Responsibilities :- Design, develop, and implement data pipelines and ETL processes using Scala and Spark for efficient data ingestion, transformation, and loading.- Utilize PySpark and Spark SQL for large-scale data analysis and manipulation.- Possess strong proficiency in SQL for querying and manipulating data within Big Data platforms.- Leverage your...

  • Colan Infotech

    2 months ago

    Bangalore/Anywhere in India/Multiple Locations, IN Colan Infotech Pvt Ltd Full time

    Skill Set : Pyspark / Scala Spark, Data Factory, Databricks, Python, SQL.Job Description :Roles And Responsibilities :- Must have cloud knowledge in Azure- Should have programming skills with the ability to write optimized and reusable high-quality code.- Design, develop and maintain scalable data pipelines using Pyspark / Scala Spark, Databricks, Python,...

  • Colan Infotech

    2 months ago

    Bangalore/Anywhere in India/Multiple Locations Colan Infotech Pvt Ltd Full time

    Skill Set : Pyspark / Scala Spark, Data Factory, Databricks, Python, SQL. Job Description : Roles And Responsibilities : - Must have cloud knowledge in Azure - Should have programming skills with the ability to write optimized and reusable high-quality code.- Design, develop and maintain scalable data pipelines using Pyspark / Scala Spark, Databricks,...

  • Data Engineer

    4 weeks ago

    Anywhere in India/Multiple Locations Shankheshwar Enterprises Full time

    Our client is a leading player in the Digital Transformation space have 17 centers in USA and India Job Description : - Analyze and organize raw data, developing and maintaining data systems and pipelines, and collaborating closely with data scientists and business analysts to ensure data quality and reliability. - Quickly grasp and translate business...

  • Data Engineer

    4 weeks ago

    Anywhere in India/Multiple Locations, IN Shankheshwar Enterprises Full time

    Our client is a leading player in the Digital Transformation space have 17 centers in USA and IndiaJob Description :- Analyze and organize raw data, developing and maintaining data systems and pipelines, and collaborating closely with data scientists and business analysts to ensure data quality and reliability.- Quickly grasp and translate business...

  • Azure Data Engineer

    10 hours ago

    Anywhere in India/Multiple Locations, IN Stratosphere IT Services PVT Ltd Full time

    Job Description :We are seeking a talented Azure Data Engineer with expertise in Azure Databricks and Scala to join our dynamic team. As a key member of our data engineering group, you will be responsible for designing, developing, and maintaining scalable data pipelines and infrastructure on the Azure platform. You will collaborate closely with data...

  • Scala Senior Developer

    2 weeks ago

    India ADEREN Full time

    Job Description BUSCAMOS : Scala Senior Developer Profesional con más de 3 años de experiencia en proyectos back end en spark-scala en los ultimos 6 años.Conocimientos & Experiencia ● Conocimientos sólidos de bash script, spark, scala.● Conocimientos Hive.● Experiencia en desarrollo de aplicaciones batch/etl en spark, scala.● Capacidad para...