Spark/Scala
6 days ago
Role:Senior Developer
Required Technical Skill Set: Spark/Scala/Unix
Experience Range: 5-8 years
Location of Requirement : Pune
Must-Have
Minimum 4+ years of experience in development of Spark Scala
Experience in designing and development of solutions for Big Data using Hadoop ecosystem technologies such as with Hadoop Bigdata components like HDFS, Spark, Hive Parquet File format, YARN, MapReduce, Sqoop
Good Experience in writing and optimizing Spark Jobs, Spark SQL etc. Should have worked on both batch and streaming data processing.
Experience in writing and optimizing complex Hive and SQL queries to process huge data. good with UDFs, tables, joins, Views etc
Experience in debugging the Spark code
Working knowledge of basic UNIX commands and shell script
Experience of Autosys, Gradle
Good-to-Have 1. Good analytical and debugging skills
Ability to coordinate with SMEs, stakeholders, manage timelines, escalation & provide on time status
Write clear and precise documentation / specification
Work in an agile environment
Create documentation and document all developed mappings
SN Responsibility of / Expectations from the Role
1 Create Scala/Spark jobs for data transformation and aggregation
2 Produce unit tests for Spark transformations and helper methods
3 Write Scaladoc-style documentation with all code
4 Design data processing pipelines
Location
Pune
Job Function
TECHNOLOGY
Role
Engineer
Job Id
381936
Desired Skills
Scala | Spark
Desired Candidate Profile
Qualifications : BACHELOR OF ENGINEERING
-
Scala Developer
7 hours ago
Pune, Maharashtra, India ID4 Consultancy Full time ₹ 15,00,000 - ₹ 25,00,000 per yearJD: Experience and Expertise in any of the following Languages at least 1 of them : Scala, Python, Java Experience and expertise in SPARK Architecture Experience in the range of 5-10 yrs plus Good Problem Solving and Analytical Skills Ability to Comprehend the Business requirement and translate to the Technical requirements Good communication...
-
Hadoop,Spark Data Engineer
2 weeks ago
Pune, Maharashtra, India HSBC Full time ₹ 12,00,000 - ₹ 24,00,000 per yearSome careers shine brighter than others.If you're looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.HSBC is one of the largest banking and...
-
Data Engineer/Spark Engineer
6 days ago
Pune, Maharashtra, India OPUS Technologies Full time ₹ 8,00,000 - ₹ 12,00,000 per yearWho are we?Opus Technologies is a technology company with a focus on shaping the future of payment technology. With experience building highly innovative solutions and products, we combine our deep technology proficiency with unmatched domain expertise in payments and fintech, enabling us to deliver unparalleled quality and value in everything we do. For the...
-
AWS-Scala Data Engineer
2 weeks ago
Pune, Maharashtra, India Coforge Full time ₹ 15,00,000 - ₹ 25,00,000 per yearWe are looking for a passionate and experiencedAWS-Scala Data Engineerto join our growing data engineering team. This role requires a strong foundation in cloud technologies, data processing, and programming, with a focus on building scalable and efficient data solutions.Key Responsibilities:Design, develop, and maintain scalable data pipelines on...
-
Scala Lead
6 days ago
Pune, Maharashtra, India Wipro Full time ₹ 6,00,000 - ₹ 18,00,000 per yearJob DescriptionJob Title: Scala LeadReq Id: 72417City: PuneState/Province: MaharashtraPosting Start Date: 7/1/25Wipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) is a leading technology services and consulting company focused on building innovative solutions that address clients' most complex digital transformation needs. Leveraging our holistic portfolio...
-
Scala Lead
1 week ago
Pune, Maharashtra, India Wipro Full time ₹ 6,00,000 - ₹ 18,00,000 per yearWipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) is a leading technology services and consulting company focused on building innovative solutions that address clients' most complex digital transformation needs. Leveraging our holistic portfolio of capabilities in consulting, design, engineering, and operations, we help clients realize their boldest...
-
Pune, Maharashtra, India RM Technologies Full time ₹ 25 - ₹ 33 per yearHiring: Data Engineer (Scala) – High Priority Experience: 6+ years only Location: Hybrid (3 days/week from office) Pune Client: MNC Budget: 25-33 LPA Availability: Immediate Joiners only(max 30 days)We are looking for a skilled Data Engineer (Scala) to design, build, and optimize large-scale data pipelines and platforms. This role involves utilizing...
-
Senior Big Data Engineer
7 days ago
Pune, Maharashtra, India LTIMindtree Full time ₹ 6,00,000 - ₹ 18,00,000 per yearJob description:Mandate Skills: Scala, Spark, SQLResponsibility:Overall, more than 5 Yrs of experience in Big Data projects.Experience in Scala programming languagesExperience in Big Data technologies including Spark Scala and KafkaWho have a good understanding of data structures and algorithmsHas worked in Implementation projects building data pipelines...
-
Lead Data Engineer
1 week ago
Pune, Maharashtra, India CG-VAK Software & Exports Ltd. Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob Title:Data Engineer (Scala, Spark, Pyspark, Databricks)Remark - final round will be the F2FExperience: 10+ Years (Lead Role)ResponsibilitiesDesign, develop, and maintain robust and scalable data pipelines using Apache Spark and Scala on the Databricks platform.Implement ETL (Extract, Transform, Load) processes for various data sources, ensuring data...
-
Data Engineer
7 days ago
Pune, Maharashtra, India Opus Technologies Full time ₹ 4,00,000 - ₹ 12,00,000 per yearJob Title: Data Engineer/Spark EngineerLocation: India(Pune)About the RoleWe are looking for a passionate and experienced Data Engineer to join our growing data team. This is a hands-on role for someone who thrives in building scalable data platforms from the ground up. Youll work with cutting-edge technologies including Apache Spark, Google Cloud Platform...