Scala/Spark Data Engineer
4 days ago
Big Data Orchestration: Airflow, Spark on Kubernetes, Yarn, Oozie Big Data
Processing: Hadoop, Kafka, Spark & Spark Structured Streaming. Experience
on SOLID & DRY principles with Good Software Architecture & Design
implementation experience Advanced Scala experience (e.g. Functional
Programming, using Case classes, Complex Data Structures & Algorithms)
Proficient in developing automated frameworks for unit & integration testing.
- Proficient with Kubernetes, Docker, Helm and related container technologies.
- Proficient in deploying and managing Spark workloads on Kubernetes
clusters.
Job Type: Full-time
Pay: ₹2,500, ₹3,000,000.00 per year
Experience:
- Scala Data Engineer: 10 years (Required)
- Spark Data Engineer: 10 years (Required)
- Data Engineer: 10 years (Required)
- Scala: 10 years (Required)
- Spark: 10 years (Required)
- Big Data Orchestration: 10 years (Required)
- Airflow: 10 years (Required)
- Kubernetes: 10 years (Required)
- Yarn: 10 years (Required)
- oozie: 10 years (Required)
- Big Data: 10 years (Required)
- Hadoop: 10 years (Required)
- Kafka: 10 years (Required)
- Architecture & Design Implementation: 10 years (Required)
- Unit testing: 10 years (Required)
Work Location: In person
-
SPARK/SCALA and Pythin
1 week ago
Bengaluru, Karnataka, India Nilasu Consulting Services Full time ₹ 4,00,000 - ₹ 6,00,000 per yearCompany Overview:Nilasu Consulting Services Pvt Ltd specializes in the human-resources industry. We partner with organizations to provide comprehensive HR solutions, including recruitment, talent management, and HR consulting. Role and Responsibilities:We are currently seeking a qualified candidate with expertise in Spark/Scala and Python. The successful...
-
Spark-Scala Developer
1 week ago
Bengaluru, Karnataka, India Tata Consultancy Services (TCS) Full time ₹ 15,00,000 - ₹ 20,00,000 per yearMust have 5+ years of IT experienceMust have good experience in Spark and ScalaGood to have experience instreaming systems like Spark streaming and StormExpereicne with Spark Data processing, Performance Tuning, Memory Management, Fault Tolerance, ScalabilityGood knowledge of Hive,Sqoop,Spark, data warehousing and information management best...
-
SPARK/SCALA and Python Consultant
1 week ago
Bengaluru, Karnataka, India Nilasu Consulting Services Full time ₹ 5,00,000 - ₹ 15,00,000 per yearJob Title: SPARK/SCALA and Python Consultant Company Overview: Nilasu Consulting Services Pvt Ltd is a leading human-resources company in India. We specialize in providing consulting services for industries across various sectors. Role and Responsibilities: 1. Develop and maintain Spark Scala applications with a focus on functional programming. 2. Work on...
-
Senior Scala/Spark Developer
6 days ago
Bengaluru, Karnataka, India Cyanous Software Full time ₹ 12,00,000 - ₹ 36,00,000 per yearKey Responsibilities : - Design, develop, and maintain data processing applications using Scala and Apache Spark. - Collaborate with cross-functional teams to gather requirements and deliver scalable, efficient solutions. - Implement test-driven development practices to improve reliability and maintainability. - Manage deployment of artifacts from lower...
-
Big Data Hadoop, Spark and Scala
1 week ago
Bengaluru, Karnataka, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 25,00,000 per yearTCS is looking for Big Data and Hadoop EcosystemsExperience: years OnlyEducation: Minimum 15 years of full time education (10th, 12th and Graduation)Location: BangaloreNotice Period: 0 to 30 DaysRole & responsibilities1 Develop Spark and SCALA code as per requirement.2 Build efficient and optimized ETLs for data ingestion/transformations.3 Should be able to...
-
Senior Spark + Scala Developer
1 week ago
Bengaluru, Karnataka, India IQVIA Full time ₹ 20,00,000 - ₹ 25,00,000 per yearProficiency in both Scala and Python Profile:- Scala with Functional Programming, python [ Java is second option]Exp.:- 4+ Years of Experience Scala [ 2+ years experienced in data engineering, python, scala]Skills :-Mandatory:- Scala, Play Framework, Slick, PostgreSQL, python, Spark (Basic), Akka (Basic), REST API, MicroservicesGood to have:- AWS,...
-
Senior Spark + Scala Developer
1 week ago
Bengaluru, Karnataka, India IQVIA Full time ₹ 12,00,000 - ₹ 24,00,000 per yearProficiency in both Scala and PythonProfile:- Scala with Functional Programming, python [ Java is second option]Exp.:- 4+ Years of Experience Scala [ 2+ years experienced in data engineering, python, scala]Skills :-Mandatory:- Scala, Play Framework, Slick, PostgreSQL, python, Spark (Basic), Akka (Basic), REST API, MicroservicesGood to have:- AWS, Kubernetes...
-
Scala Developer
1 week ago
Bengaluru, Karnataka, India Vega Intellisoft Full time ₹ 15,00,000 - ₹ 25,00,000 per yearKey Skills: Scala, Spark, PythonJob Description: Looking for a Data Engineer with expertise in Scala, Spark, and Python. Responsibilities include developing scalable data pipelines, optimizing performance, and ensuring seamless data processing in a distributed environment.At high level Spark, Scala, Python is required.
-
Data Engineer with Spark/Scala
1 week ago
Bengaluru, Karnataka, India Guidewire Software Full time ₹ 12,00,000 - ₹ 24,00,000 per yearSummaryAs a Data Engineering specialist in the Guidewire Data and Analytics team, you will work with our customers who are adopting our Guidewire Data Platform as the centerpiece of their data foundation.One of our principles is to have fun while we deliver, so this role will need to keep the delivery process fun and engaging for the team in collaboration...
-
Scala Developer
1 week ago
Bengaluru, Karnataka, India SWITS DIGITAL Private Limited Full time ₹ 15,00,000 - ₹ 25,00,000 per yearJob Title: Scala DeveloperExperience Required:6–9 YearsLocation:Bangalore / HyderabadJob DescriptionWe are seeking an experiencedBig Data Engineerwith strong expertise inScala and Sparkto design, develop, and optimize large-scale data processing applications. The role involves working in an agile environment, collaborating with cross-functional teams, and...