Spark/Scala Developer

3 weeks ago

Hyderabad, India Unify Technologies Full time

Job Description
We are looking for a candidate with strong experience into
Spark
with
Scala
with Machine Learning and AI, Should have hands-on programming experience and Good Understanding of Data Structures, Algorithms, Data Transformation, Data Ingestion, Optimization mechanism/techniques, Good understanding of Big Data (Hadoop, MapReduce, Kafka, Cassandra) Technologies.

We deal with huge amounts of data at a massive scale, so we are looking for engineers who love solving challenging problems through conducting independent research and collaborating with teams across our product teams to help improve the overall product experience.

Key Responsibilities

  • Develop, optimize, and maintain large-scale distributed data processing systems using Apache Spark with Scala.
  • Design and implement complex data transformation and ingestion pipelines for structured and unstructured data.
  • Collaborate with data scientists and AI/ML engineers to integrate machine learning models into data workflows.
  • Optimize Spark jobs for performance, scalability, and reliability.
  • Work with large-scale data platforms involving Hadoop, Kafka, Cassandra, MapReduce, and related big data technologies.

Required Skills And Qualifications

  • 5 to 10 years of hands-on experience in data engineering with a focus on Spark and Scala.
  • Strong knowledge of data structures, algorithms, and software engineering principles.
  • Proficient in building data ingestion and ETL pipelines from diverse data sources.
  • Experience with machine learning frameworks and integrating ML/AI models into data pipelines.
  • Solid understanding of big data ecosystems including Hadoop, Kafka, Cassandra, and MapReduce.
  • Proven experience with performance tuning, optimization techniques, and distributed systems.
  • Familiarity with CI/CD pipelines, containerization (Docker), and orchestration tools (Kubernetes) is a plus.

)

  • Scala Developer/Spark Developer

    1 week ago

    Bengaluru, Chennai, Hyderabad, India Prointegrate World It Consulting Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    JD:Primary: Spark/Scala, Shell script / Python Script, Kafka, SQL, AWS.Secondary: JavaScala/Spark developer who has good experience on coding Spark/Scala applications.Should be able to handle Spark/Scala application individually, guide/mentor junior team members on Spark/Scala.Should have good experience working in an Agile Team.Should promote collaboration...

  • Spark Scala Developer

    2 weeks ago

    Hyderabad, Telangana, India Unify Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role & responsibilitiesWe are looking for a candidate with strong experience into Spark Core/Streaming, Spark RDD API, Spark Dataframes API  with Scala with Machine Learning and AI, Should have hands-on programming experience and Good Understanding of Data Structures, Algorithms, Data Transformation, Data Ingestion, Optimization mechanism/techniques, Good...

  • Spark Scala Developer

    3 weeks ago

    Hyderabad, India Unify Technologies Full time

    Role & responsibilities We are looking for a candidate with strong experience into Spark Core/Streaming, Spark RDD API, Spark Dataframes API  with Scala with Machine Learning and AI, Should have hands-on programming experience and Good Understanding of Data Structures, Algorithms, Data Transformation, Data Ingestion, Optimization mechanism/techniques, Good...

  • Spark/Scala Developer

    2 weeks ago

    Hyderabad, Telangana, India Unify Technologies Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Job DescriptionWe are looking for a candidate with strong experience intoSparkwithScalawith Machine Learning and AI, Should have hands-on programming experience and Good Understanding of Data Structures, Algorithms, Data Transformation, Data Ingestion, Optimization mechanism/techniques, Good understanding of Big Data (Hadoop, MapReduce, Kafka, Cassandra)...

  • Spark, Scala

    21 hours ago

    Hyderabad, Telangana, India Cognizant Full time

    **Skill**: Spark, Scala **Experience**: 4 to 16 years **Location**: Hyderabad **Walkin date**: 8th Feb 25 - **Data Engineer Design and develop scalable and efficient solutions using Spark, Scala, Python, Airflow.**: - **Good code and configuration spark knowledge (at least 1 or 2 profiles should be very good at spark configuration and cluster...

  • Spark, Scala Developer

    2 weeks ago

    Bengaluru, Chennai, Hyderabad, India SRS Infoway Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Role & responsibilitiesAt least 5+ years of experience and strong knowledge in Scala programming language.Able to write clean, maintainable and efficient Scala code following best practices.Good knowledge on the fundamental Data Structures and their usageAt least 5+ years of experience in designing and developing large scale, distributed data processing...

  • Scala Developer

    2 weeks ago

    Hyderabad, India Grackle Business Solutions Pvt Ltd Full time

    Key Responsibilities :- Develop and maintain data processing applications using Spark and Scala.- Collaborate with cross-functional teams to understand data requirements and design efficient solutions.- Implement test-driven deployment practices to enhance the reliability of application.- Deploy artifacts from lower to higher environment ensuring smooth...

  • Big Data Developer

    3 weeks ago

    Hyderabad, India Sourcingxpress Full time

    Company : : Visit Type : Consulting FirmCompany Type : Model : Stage : : IT Description : We are looking for an experienced Senior Big Data Engineer (Scala/Spark) with 8+ years of expertise in designing and developing large-scale, distributed data processing pipelines. The role requires strong knowledge of Scala, Apache Spark (Core, SQL,...

  • Spark Scala Developer

    1 week ago

    Delhi, Hyderabad, NCR, Pune, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role - Spark / Scala Data EngineerExperience - 8 to 10 yrsLocation - Bangalore/Chennai/Hyderabad/Delhi/PuneMust Have - Big Data Hadoop - Hive and Spark/Scala solid experience - SQL advance knowledge - Been able to test changes and issues properly, replicating the code functionality into SQL - Worked with Code Repositories as GIT, Maven, ... - DevOps...

  • Data Engineer

    2 weeks ago

    Hyderabad, India MANOJAVAM TECHNOLOGIES PRIVATE LIMITED Full time

    Job Title : Data Engineer Scala with Play OR SparkLocation : HyderabadExperience : 4 to 7 YearsEmployment Type : Full-TimeAbout the Role :We are looking for an exceptional Backend Engineer who thrives in solving complex challenges and building scalable, distributed, and high-performance systems. If you are passionate about functional programming,...