Spark/Scala Developer

1 day ago

Hyderabad, India Unify Technologies Full time

Job Description
We are looking for a candidate with strong experience into
Spark
with
Scala
with Machine Learning and AI, Should have hands-on programming experience and Good Understanding of Data Structures, Algorithms, Data Transformation, Data Ingestion, Optimization mechanism/techniques, Good understanding of Big Data (Hadoop, MapReduce, Kafka, Cassandra) Technologies.

We deal with huge amounts of data at a massive scale, so we are looking for engineers who love solving challenging problems through conducting independent research and collaborating with teams across our product teams to help improve the overall product experience.

Key Responsibilities

  • Develop, optimize, and maintain large-scale distributed data processing systems using Apache Spark with Scala.
  • Design and implement complex data transformation and ingestion pipelines for structured and unstructured data.
  • Collaborate with data scientists and AI/ML engineers to integrate machine learning models into data workflows.
  • Optimize Spark jobs for performance, scalability, and reliability.
  • Work with large-scale data platforms involving Hadoop, Kafka, Cassandra, MapReduce, and related big data technologies.

Required Skills And Qualifications

  • 5 to 10 years of hands-on experience in data engineering with a focus on Spark and Scala.
  • Strong knowledge of data structures, algorithms, and software engineering principles.
  • Proficient in building data ingestion and ETL pipelines from diverse data sources.
  • Experience with machine learning frameworks and integrating ML/AI models into data pipelines.
  • Solid understanding of big data ecosystems including Hadoop, Kafka, Cassandra, and MapReduce.
  • Proven experience with performance tuning, optimization techniques, and distributed systems.
  • Familiarity with CI/CD pipelines, containerization (Docker), and orchestration tools (Kubernetes) is a plus.

)

  • Spark Scala Developer

    2 weeks ago

    Hyderabad, Telangana, India Unify Technologies Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Role & responsibilitiesWe are looking for a candidate with strong experience into Spark Core/Streaming, Spark RDD API, Spark Dataframes API  with Scala with Machine Learning and AI, Should have hands-on programming experience and Good Understanding of Data Structures, Algorithms, Data Transformation, Data Ingestion, Optimization mechanism/techniques, Good...

  • Spark Scala Developer

    1 day ago

    Hyderabad, India Unify Technologies Full time

    Role & responsibilities We are looking for a candidate with strong experience into Spark Core/Streaming, Spark RDD API, Spark Dataframes API  with Scala with Machine Learning and AI, Should have hands-on programming experience and Good Understanding of Data Structures, Algorithms, Data Transformation, Data Ingestion, Optimization mechanism/techniques, Good...

  • Spark, Scala

    1 week ago

    Hyderabad, Telangana, India Cognizant Full time

    **Skill**: Spark, Scala **Experience**: 4 to 16 years **Location**: Hyderabad **Walkin date**: 8th Feb 25 - **Data Engineer Design and develop scalable and efficient solutions using Spark, Scala, Python, Airflow.**: - **Good code and configuration spark knowledge (at least 1 or 2 profiles should be very good at spark configuration and cluster...

  • Spark/Scala Developer

    2 weeks ago

    Hyderabad, Telangana, India Unify Technologies Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Job DescriptionWe are looking for a candidate with strong experience intoSparkwithScalawith Machine Learning and AI, Should have hands-on programming experience and Good Understanding of Data Structures, Algorithms, Data Transformation, Data Ingestion, Optimization mechanism/techniques, Good understanding of Big Data (Hadoop, MapReduce, Kafka, Cassandra)...

  • Spark, Scala Developer

    2 weeks ago

    Bengaluru, Chennai, Hyderabad, India SRS Infoway Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Role & responsibilitiesAt least 5+ years of experience and strong knowledge in Scala programming language.Able to write clean, maintainable and efficient Scala code following best practices.Good knowledge on the fundamental Data Structures and their usageAt least 5+ years of experience in designing and developing large scale, distributed data processing...

  • Senior Spark and Scala Professional

    1 week ago

    Hyderabad / Secunderabad, Telangana, India beBeeDataEngineer Full time ₹ 1,50,000 - ₹ 28,00,000

    Job Opportunity:Spark and Scala Developer Role Experience: 5+ years in Data EngineeringOur expectations for the ideal candidate are:Strong DataFrame and programming skills with expertise in complex data structures.Experience in handling large datasets using Scala or Python.Effective communication skills to convey technical views.

  • Unify Technologies

    4 days ago

    Hyderabad, India UNIFY TECHNOLOGIES PVT LTD Full time

    Spark Core/Streaming with programming language Scala also in Machine Learing OR AI, Good Understanding of Data Structures, Algorithms, Data Transformation, Data Ingestion, Optimization mechanism/techniques, Good understanding of Big Data (Hadoop, MapReduce, Kafka, Cassandra) TechnologiesJob Summary : We are looking for a candidate with strong experience into...

  • Scala Developer

    2 weeks ago

    Hyderabad, Telangana, India EdgeVerve Full time

    Organization : Infosys LimitedExperience : 6-12 yrsMust have skills : Scala, Apache Spark, Database/SQL Desired Skills : UNIX shell scriptingJob Description :- At least 5+ years of experience and strong knowledge in Scala programming language.- Able to write clean, maintainable and efficient Scala code following best practices.- Good knowledge on the...

  • Scala Developer

    2 weeks ago

    Hyderabad, Telangana, India Tata Consultancy Services Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Desired Competencies (Technical/Behavioral Competency)Must-Have**(Ideally should not bemore than 3-5) Hands on development experience in programming languages such as JAVA,SCALA using Maven, Apache Spark Frameworks and Unix Shell scripting Should be comfortable with Unix File system as well as HDFS commands Should have worked on query languages such as...

  • Bigdata Scala Developer

    2 weeks ago

    Chennai, Hyderabad, Pune, India IDESLABS PRIVATE LIMITED Full time US$ 1,50,000 - US$ 2,00,000 per year

    Job type: contract to hire10+ years of software development experience building large scale distributed data processing systems/application, Data Engineering or large scale internet systems.Experience of at least 4 years in Developing/ Leading Big Data solution at enterprise scale with at least one end to end implementationStrong experience in programming...