Scala/Spark Data Engineer

4 days ago


Bengaluru, Karnataka, India JP Techno Park Full time ₹ 25,00,000 - ₹ 30,00,000 per year

Big Data Orchestration: Airflow, Spark on Kubernetes, Yarn, Oozie Big Data

Processing: Hadoop, Kafka, Spark & Spark Structured Streaming. Experience

on SOLID & DRY principles with Good Software Architecture & Design

implementation experience Advanced Scala experience (e.g. Functional

Programming, using Case classes, Complex Data Structures & Algorithms)

Proficient in developing automated frameworks for unit & integration testing.

  • Proficient with Kubernetes, Docker, Helm and related container technologies.
  • Proficient in deploying and managing Spark workloads on Kubernetes

clusters.

Job Type: Full-time

Pay: ₹2,500, ₹3,000,000.00 per year

Experience:

  • Scala Data Engineer: 10 years (Required)
  • Spark Data Engineer: 10 years (Required)
  • Data Engineer: 10 years (Required)
  • Scala: 10 years (Required)
  • Spark: 10 years (Required)
  • Big Data Orchestration: 10 years (Required)
  • Airflow: 10 years (Required)
  • Kubernetes: 10 years (Required)
  • Yarn: 10 years (Required)
  • oozie: 10 years (Required)
  • Big Data: 10 years (Required)
  • Hadoop: 10 years (Required)
  • Kafka: 10 years (Required)
  • Architecture & Design Implementation: 10 years (Required)
  • Unit testing: 10 years (Required)

Work Location: In person



  • Bengaluru, Karnataka, India Nilasu Consulting Services Full time ₹ 4,00,000 - ₹ 6,00,000 per year

    Company Overview:Nilasu Consulting Services Pvt Ltd specializes in the human-resources industry. We partner with organizations to provide comprehensive HR solutions, including recruitment, talent management, and HR consulting. Role and Responsibilities:We are currently seeking a qualified candidate with expertise in Spark/Scala and Python. The successful...


  • Bengaluru, Karnataka, India Tata Consultancy Services (TCS) Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Must have 5+ years of IT experienceMust have good experience in Spark and ScalaGood to have experience instreaming systems like Spark streaming and StormExpereicne with Spark Data processing, Performance Tuning, Memory Management, Fault Tolerance, ScalabilityGood knowledge of Hive,Sqoop,Spark, data warehousing and information management best...


  • Bengaluru, Karnataka, India Nilasu Consulting Services Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Job Title: SPARK/SCALA and Python Consultant Company Overview: Nilasu Consulting Services Pvt Ltd is a leading human-resources company in India. We specialize in providing consulting services for industries across various sectors. Role and Responsibilities: 1. Develop and maintain Spark Scala applications with a focus on functional programming. 2. Work on...


  • Bengaluru, Karnataka, India Cyanous Software Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Key Responsibilities : - Design, develop, and maintain data processing applications using Scala and Apache Spark. - Collaborate with cross-functional teams to gather requirements and deliver scalable, efficient solutions. - Implement test-driven development practices to improve reliability and maintainability. - Manage deployment of artifacts from lower...


  • Bengaluru, Karnataka, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    TCS is looking for Big Data and Hadoop EcosystemsExperience: years OnlyEducation: Minimum 15 years of full time education (10th, 12th and Graduation)Location: BangaloreNotice Period: 0 to 30 DaysRole & responsibilities1 Develop Spark and SCALA code as per requirement.2 Build efficient and optimized ETLs for data ingestion/transformations.3 Should be able to...


  • Bengaluru, Karnataka, India IQVIA Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Proficiency in both Scala and Python Profile:- Scala with Functional Programming, python [ Java is second option]Exp.:-  4+ Years of Experience Scala [ 2+ years experienced in data engineering, python, scala]Skills :-Mandatory:- Scala, Play Framework, Slick, PostgreSQL, python, Spark (Basic), Akka (Basic), REST API, MicroservicesGood to have:- AWS,...


  • Bengaluru, Karnataka, India IQVIA Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Proficiency in both Scala and PythonProfile:- Scala with Functional Programming, python [ Java is second option]Exp.:- 4+ Years of Experience Scala [ 2+ years experienced in data engineering, python, scala]Skills :-Mandatory:- Scala, Play Framework, Slick, PostgreSQL, python, Spark (Basic), Akka (Basic), REST API, MicroservicesGood to have:- AWS, Kubernetes...

  • Scala Developer

    1 week ago


    Bengaluru, Karnataka, India Vega Intellisoft Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Key Skills: Scala, Spark, PythonJob Description: Looking for a Data Engineer with expertise in Scala, Spark, and Python. Responsibilities include developing scalable data pipelines, optimizing performance, and ensuring seamless data processing in a distributed environment.At high level Spark, Scala, Python is required.


  • Bengaluru, Karnataka, India Guidewire Software Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    SummaryAs a Data Engineering specialist in the Guidewire Data and Analytics team, you will work with our customers who are adopting our Guidewire Data Platform as the centerpiece of their data foundation.One of our principles is to have fun while we deliver, so this role will need to keep the delivery process fun and engaging for the team in collaboration...

  • Scala Developer

    1 week ago


    Bengaluru, Karnataka, India SWITS DIGITAL Private Limited Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Title: Scala DeveloperExperience Required:6–9 YearsLocation:Bangalore / HyderabadJob DescriptionWe are seeking an experiencedBig Data Engineerwith strong expertise inScala and Sparkto design, develop, and optimize large-scale data processing applications. The role involves working in an agile environment, collaborating with cross-functional teams, and...