Spark Scala Developer
2 hours ago
Design, develop, and optimize scalable, high performance Spark applications using Scala. Work on mission critical projects, ensuring high availability, reliability, and performance. Analyze and optimize Spark jobs for efficient data processing and resource utilization.
Collaborate with cross functional teams to deliver robust, production ready solutions. Troubleshoot and resolve complex issues related to Spark applications and data pipelines. Integrate Spark applications with Kafka for real time data streaming and MongoDB for data storage and retrieval.
Follow best practices in coding, testing, and deployment to ensure high quality deliverables. Mentor junior team members and provide technical leadership.
Mandatory Skills and Qualifications: 7+ years of hands on experience in Scala programming and Apache Spark. Strong expertise in Spark architecture, including RDDs, DataFrames, and Spark SQL.
Proven experience in performance tuning and optimization of Spark applications. Must have hands on experience with Spark Streaming for real time data processing. Solid understanding of distributed computing and big data processing concepts. Proficient in Linux with the ability to work in a Linux environment.
Strong knowledge of data structures and algorithms, with a focus on space and time complexity analysis. Ability to work independently and deliver results in a fast paced, high pressure environment. Excellent problem solving, debugging, and analytical skills.
Good to Have Skills: Experience with Apache Kafka for real time data streaming. Knowledge of MongoDB or other NoSQL databases.
Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and containerization (e.g., Docker, Kubernetes). Understanding of DevOps practices and CI/CD pipelines.
Interview Focus Areas: Coding Exercise in Scala: A hands on coding assessment to evaluate your problem solving and coding skills.
Spark Integration with Other Technologies: Practical understanding of how Spark integrates with tools like Kafka, MongoDB, etc. Spark Streaming: Demonstrated experience with real time data processing using Spark Streaming. Best Practices and Optimization in Spark: In depth knowledge of Spark job optimization, resource management, and performance tuning.
Data Structures, Space, and Time Complexity Analysis: Strong grasp of data structures and algorithms, with a focus on optimizing space and time complexity. Shift Requirements: Flexible shift hours with the shift ending by midday US time. Willingness to adapt to dynamic project needs and timelines.
-
Scala Spark Developer
5 days ago
Navi Mumbai, Maharashtra, India Capgemini Full time ₹ 6,00,000 - ₹ 18,00,000 per yearChoosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the value of technology and...
-
Scala Spark Developer
4 days ago
Navi Mumbai, Maharashtra, India Capgemini Full time ₹ 12,00,000 - ₹ 36,00,000 per yearChoosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the value of technology and...
-
Scala Developer
4 hours ago
Mumbai, Maharashtra, India Infotel UK Full time ₹ 12,00,000 - ₹ 24,00,000 per yearPosition: Scala DeveloperCompany: Infotel IndiaInfotel India, a leading technology solutions provider, is on the lookout for a talented Scala Developer to join our innovative team. The ideal candidate will have a strong background in software development using Scala and be passionate about building high-quality applications. As a Scala Developer, you will...
-
Scala Developer
4 weeks ago
Mumbai, Maharashtra, India, Maharashtra Tata Consultancy Services Full timeExperience: 4 to 10 yrsMust-Have Skills1. Minimum 4+ years of experience in development of Spark Scala2. Experience in designing and development of solutions for Big Data using Hadoop ecosystem technologies such as with Hadoop Bigdata components like HDFS, Spark, Hive Parquet File format, YARN, MapReduce, Sqoop 3. Good Experience in writing and optimizing...
-
Senior Spark Developer
6 days ago
Mumbai, Maharashtra, India BNP Paribas Full time ₹ 12,00,000 - ₹ 36,00,000 per yearThe Senior Spark Tech Lead will be responsible for integrating and maintaining the Quantexa platform, a spark based software provided by a UK fintech, into our existing systems to enhance our anti-money laundering capabilities. This role requires a deep expertise in Spark development, as well as an ability to analyze and understand underlying data....
-
Java Scala Developer
6 days ago
Mumbai, Maharashtra, India Xoriant Full time ₹ 15,00,000 - ₹ 25,00,000 per yearRole & responsibilitiesKey Responsibilities:Design, develop, and maintain scalable backend systems using Java and Scala.Build and optimize distributed computing platforms for financial risk and surveillance models.Collaborate with cross-functional teams including business analysts, traders, and other developers.Write clean, efficient, and well-documented...
-
Navi Mumbai, Maharashtra, India Coders Brain Technology Full time ₹ 12,00,000 - ₹ 36,00,000 per yearMust have 4 to 7 years of experience in development and relevant 2 years of experience . Primary Skills: Java/Scala, Spark, Hadoop, HDFS, Spark Streaming . Secondary Skills: Cassandra/Nosql Database, Kafka, Airflow
-
Sr Data Engineer
1 day ago
Mumbai, Maharashtra, India Photon Group Full time ₹ 12,00,000 - ₹ 36,00,000 per yearDescriptionWe need a Senior Data Engineer with 10+ years exp proficient in Spark, Scala/Java, and Hive, with extensive hands-on development experience in the Big Data Ecosystem.Key Responsibilities:Design, implement, and optimize highly performant data pipelines using Spark, Scala/Java, and Hive on platforms like Cloudera Data Platform (CDP) or other Hadoop...
-
Principal Consultant, Java Scala
4 days ago
Mumbai, Maharashtra, India Genpact Full time ₹ 20,00,000 - ₹ 25,00,000 per yearPrincipal Consultant, Java Scala-ITO Ready to build the future with AI? At Genpact, we don't just keep up with technology—we set the pace. AI and digital innovation are redefining industries, and we're leading the charge. Genpact's AI Gigafactory, our industry-first accelerator, is an example of how we're scaling advanced technology solutions to...
-
Data Bricks Developer
2 weeks ago
Mumbai, Maharashtra, India Tata Technologies Full time ₹ 12,00,000 - ₹ 24,00,000 per yearPurpose of the Role:We are seeking a skilled Databricks with 4 to 6 years of experience in data engineering and cloud platforms. Designs and implements scalable data architectures and solutions. The jobholder has expertise in Databricks Lakehouse, data modelling, and cloud integration, ensuring high performance, security, and reliability.Job...