
Spark/Scala Developer
14 hours ago
Job Description
We are looking for a candidate with strong experience into
Spark
with
Scala
with Machine Learning and AI, Should have hands-on programming experience and Good Understanding of Data Structures, Algorithms, Data Transformation, Data Ingestion, Optimization mechanism/techniques, Good understanding of Big Data (Hadoop, MapReduce, Kafka, Cassandra) Technologies.
We deal with huge amounts of data at a massive scale, so we are looking for engineers who love solving challenging problems through conducting independent research and collaborating with teams across our product teams to help improve the overall product experience.
Key Responsibilities
- Develop, optimize, and maintain large-scale distributed data processing systems using Apache Spark with Scala.
- Design and implement complex data transformation and ingestion pipelines for structured and unstructured data.
- Collaborate with data scientists and AI/ML engineers to integrate machine learning models into data workflows.
- Optimize Spark jobs for performance, scalability, and reliability.
- Work with large-scale data platforms involving Hadoop, Kafka, Cassandra, MapReduce, and related big data technologies.
Required Skills And Qualifications
- 5 to 10 years of hands-on experience in data engineering with a focus on Spark and Scala.
- Strong knowledge of data structures, algorithms, and software engineering principles.
- Proficient in building data ingestion and ETL pipelines from diverse data sources.
- Experience with machine learning frameworks and integrating ML/AI models into data pipelines.
- Solid understanding of big data ecosystems including Hadoop, Kafka, Cassandra, and MapReduce.
- Proven experience with performance tuning, optimization techniques, and distributed systems.
- Familiarity with CI/CD pipelines, containerization (Docker), and orchestration tools (Kubernetes) is a plus.
)
-
Spark Scala Developer
15 hours ago
Hyderabad, Telangana, India Unify Technologies Full time ₹ 1,04,000 - ₹ 1,30,878 per yearRole & responsibilitiesWe are looking for a candidate with strong experience into Spark Core/Streaming, Spark RDD API, Spark Dataframes API with Scala with Machine Learning and AI, Should have hands-on programming experience and Good Understanding of Data Structures, Algorithms, Data Transformation, Data Ingestion, Optimization mechanism/techniques, Good...
-
Scala Programmer
1 day ago
Hyderabad, Telangana, India beBeescalaprogrammer Full time ₹ 1,00,00,000 - ₹ 2,00,00,000About the Role:We are seeking a seasoned Scala Expert to join our team. As a key member of our engineering group, you will be responsible for designing, implementing, and optimizing high-performance applications using Scala.Main Responsibilities:Develop and maintain scalable applications using Scala.Design and implement data pipelines and...
-
Scala Developer
2 days ago
Hyderabad, Telangana, India TekIT Software Solutions Pvt. Ltd. Full timeSenior Scala DeveloperExperience Level : 6 to 8 years.Location : Bangalore, Hyderabad.Notice Period : 1 Day.Role Overview :We are seeking a highly skilled Scala Developer to work with high-performing software and applications at the forefront of the digital telecommunications industry.The ideal candidate will be responsible for translating user needs and...
-
Senior Big Data Engineer
1 day ago
Hyderabad, Telangana, India beBeeBigData Full time ₹ 20,00,000 - ₹ 25,00,000About the Role: We are seeking a seasoned Senior Big Data Engineer with expertise in Scala and Spark to lead large-scale data processing solutions. The ideal candidate will have hands-on experience working in high-performance environments, designing and developing scalable data pipelines.">Craft and maintain complex Big Data architectures using Spark and...
-
Scala Developer
15 hours ago
Hyderabad, Telangana, India Wipro Full time ₹ 9,00,000 - ₹ 12,00,000 per year**Long DescriptionExperienceand Expertise inany of the followingLanguagesat least 1 of them : Java, Scala, PythonExperienceand expertise in SPARKArchitectureExperience in the range of 6-10 yrs plusGood Problem SolvingandAnalytical SkillsAbility to Comprehend the Business requirementand translate to the Technical requirementsGood communicationand...
-
Spark & Delta Lake Professional
14 hours ago
Hyderabad, Telangana, India IDESLABS PRIVATE LIMITED Full time US$ 90,000 - US$ 1,20,000 per yearUnderstanding of Spark core concepts like RDDs, DataFrames, DataSets, SparkSQL and Spark Streaming.Experience with Spark optimization techniques.Deep knowledge of Delta Lake features like time travel, schema evolution, data partitioning.Ability to design and implement data pipelines using Spark and Delta Lake as the data storage layer.Proficiency in...
-
Spark Developer
4 weeks ago
Hyderabad, Telangana, India Infosys Limited Full timeJob DescriptionJob Description:- Spark Expertise- Expert proficiency in Spark- Ability to design and implement efficient data processing workflows- Experience with Spark SQL and DataFrames- Good exposure to Big Data architectures and good understanding of Big Data eco system- Experience with some framework building experience on Hadoop- Good with DB...
-
Java with Spark Developer
3 weeks ago
Hyderabad, Telangana, India VHL Technologies Inc Full timeExperience: 3-5 yearsExperience with Apache Spark is must.Looking for a skilled backend developer with strong experience in Java, Spring Boot, and Apache Spark. Responsible for building scalable microservices and processing large datasets in real-time or batch environments. Must have solid understanding of REST APIs, distributed systems, and data pipelines....
-
Java with Spark Developer
3 weeks ago
Hyderabad, Telangana, India VHL Technologies Inc Full timeJob DescriptionExperience: 3-5 yearsExperience with Apache Spark is must.Looking for a skilled backend developer with strong experience in Java, Spring Boot, and Apache Spark. Responsible for building scalable microservices and processing large datasets in real-time or batch environments. Must have solid understanding of REST APIs, distributed systems, and...
-
High-Performance Scala Developer
1 day ago
Hyderabad, Telangana, India beBeescaladeveloper Full time ₹ 1,20,00,000 - ₹ 2,00,00,000About the RoleWe are seeking a highly skilled Scala developer to join our team and take part in designing, developing, and maintaining scalable, high-performance, and distributed applications.The ideal candidate will be responsible for building resilient back-end systems while ensuring clean, efficient, and well-tested code. They will work closely with...