Spark/Scala Developer

3 days ago

Hyderabad, Telangana, India Unify Technologies Full time ₹ 8,00,000 - ₹ 24,00,000 per year

Job Description
We are looking for a candidate with strong experience into
Spark
with
Scala
with Machine Learning and AI, Should have hands-on programming experience and Good Understanding of Data Structures, Algorithms, Data Transformation, Data Ingestion, Optimization mechanism/techniques, Good understanding of Big Data (Hadoop, MapReduce, Kafka, Cassandra) Technologies.

We deal with huge amounts of data at a massive scale, so we are looking for engineers who love solving challenging problems through conducting independent research and collaborating with teams across our product teams to help improve the overall product experience.

Key Responsibilities

  • Develop, optimize, and maintain large-scale distributed data processing systems using Apache Spark with Scala.
  • Design and implement complex data transformation and ingestion pipelines for structured and unstructured data.
  • Collaborate with data scientists and AI/ML engineers to integrate machine learning models into data workflows.
  • Optimize Spark jobs for performance, scalability, and reliability.
  • Work with large-scale data platforms involving Hadoop, Kafka, Cassandra, MapReduce, and related big data technologies.

Required Skills And Qualifications

  • 5 to 10 years of hands-on experience in data engineering with a focus on Spark and Scala.
  • Strong knowledge of data structures, algorithms, and software engineering principles.
  • Proficient in building data ingestion and ETL pipelines from diverse data sources.
  • Experience with machine learning frameworks and integrating ML/AI models into data pipelines.
  • Solid understanding of big data ecosystems including Hadoop, Kafka, Cassandra, and MapReduce.
  • Proven experience with performance tuning, optimization techniques, and distributed systems.
  • Familiarity with CI/CD pipelines, containerization (Docker), and orchestration tools (Kubernetes) is a plus.

)

  • Spark Scala Developer

    2 days ago

    Hyderabad, Telangana, India Unify Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role & responsibilitiesWe are looking for a candidate with strong experience into Spark Core/Streaming, Spark RDD API, Spark Dataframes API  with Scala with Machine Learning and AI, Should have hands-on programming experience and Good Understanding of Data Structures, Algorithms, Data Transformation, Data Ingestion, Optimization mechanism/techniques, Good...

  • Scala Spark Bigdata Engineer

    5 days ago

    Hyderabad, Telangana, India Talent21 Full time ₹ 7,00,000 - ₹ 16,00,000 per year

    Scala & Spark - Intermediate/Advanced level is a mandate.Data structures and algorithms in Scala.Minimum 4+ years of experience in Scala/Spark.4. Need to have a big-data background

  • Scala Developer

    3 weeks ago

    Hyderabad, Telangana, India EdgeVerve Full time

    Organization : Infosys LimitedExperience : 6-12 yrsMust have skills : Scala, Apache Spark, Database/SQL Desired Skills : UNIX shell scriptingJob Description :- At least 5+ years of experience and strong knowledge in Scala programming language.- Able to write clean, maintainable and efficient Scala code following best practices.- Good knowledge on the...

  • Scala Developer

    1 day ago

    Hyderabad, Telangana, India Tata Consultancy Services Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Desired Competencies (Technical/Behavioral Competency)Must-Have**(Ideally should not bemore than 3-5) Hands on development experience in programming languages such as JAVA,SCALA using Maven, Apache Spark Frameworks and Unix Shell scripting Should be comfortable with Unix File system as well as HDFS commands Should have worked on query languages such as...

  • Scala Developer

    5 days ago

    Hyderabad, Telangana, India Talent21 Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Scala/Play - 5+ years experienceLocation: HYD onlyScala/Spark/PlayJob SummaryWe are looking for engineering leads who can be part of the team building massive, scalable, distributed systems that process geospatial data at scale to power our products.Key Qualifications• years of experience working in a software product development organization building...

  • Scala Professional

    7 days ago

    Hyderabad, Telangana, India IDESLABS PRIVATE LIMITED Full time ₹ 40,00,000 - ₹ 1,20,00,000 per year

    Previous candidates does not have much knowledge on the Scala side and was also lagging in spark concepts.Hands on experience of 4-5 years on Spark-Scala combinationAwareness of Hive DBAwareness and experience of working on Hadoop platformGood SQL knowledge

  • Spark & Delta Lake

    5 days ago

    Hyderabad, Telangana, India IDESLABS PRIVATE LIMITED Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Spark & Delta LakeUnderstanding of Spark core concepts like RDDs, DataFrames, DataSets, SparkSQL and Spark Streaming.Experience with Spark optimization techniques.Deep knowledge of Delta Lake features like time travel, schema evolution, data partitioning.Ability to design and implement data pipelines using Spark and Delta Lake as the data storage...

  • Scala Developer

    4 weeks ago

    Hyderabad, Telangana, India TekIT Software Solutions Pvt. Ltd. Full time

    Senior Scala DeveloperExperience Level : 6 to 8 years.Location : Bangalore, Hyderabad.Notice Period : 1 Day.Role Overview :We are seeking a highly skilled Scala Developer to work with high-performing software and applications at the forefront of the digital telecommunications industry.The ideal candidate will be responsible for translating user needs and...

  • Scala Developer

    2 days ago

    Hyderabad, Telangana, India Wipro Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    **Long DescriptionExperienceand Expertise inany of the followingLanguagesat least 1 of them : Java, Scala, PythonExperienceand expertise in SPARKArchitectureExperience in the range of 6-10 yrs plusGood Problem SolvingandAnalytical SkillsAbility to Comprehend the Business requirementand translate to the Technical requirementsGood communicationand...

  • JAVA Developer WITH SCALA

    2 days ago

    Hyderabad, Telangana, India NMK Global Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Responsibilities:* Design, develop, test and maintain Java applications using J2EE technologies with Scala* Collaborate on microservice architecture implementation* Implement Kafka messaging system integration