Spark & Scala Developer (AWS EKS / AWS Kubernetes)-Bangalore

3 days ago

Bengaluru Chennai Hyderabad, India Infosys Full time ₹ 15,00,000 - ₹ 25,00,000 per year

We are seeking an experienced Spark & Scala Developer with strong expertise in big data processing, functional programming, and cloud-native deployments using AWS EKS/Kubernetes.

The ideal candidate will design and develop scalable data pipelines and distributed applications, ensuring high performance and reliability in cloud environments.

Key Responsibilities:

  • Develop and maintain data processing pipelines using Apache Spark and Scala.
  • Apply functional programming principles for clean and efficient code.
  • Deploy and manage Spark applications on AWS EKS/Kubernetes clusters.
  • Optimize Spark jobs for performance, cost efficiency, and scalability.
  • Collaborate with data engineers, cloud architects, and DevOps teams to deliver robust solutions.
  • Implement CI/CD pipelines for Spark applications and containerized deployments.
  • Ensure security, monitoring, and logging for cloud-based Spark workloads.

Required Skills:

  • Strong proficiency in Scala and functional programming concepts.
  • Hands-on experience with Apache Spark (Core, SQL, Streaming).
  • Expertise in AWS services (EKS, S3, EMR, IAM) and Kubernetes orchestration.
  • Knowledge of Docker, Helm charts, and containerization best practices.
  • Familiarity with CI/CD tools (Jenkins, GitHub Actions) and infrastructure as code (Terraform).

Preferred Skills:

  • Experience with Akka, Play Framework, or reactive programming.
  • Knowledge of Kafka, Airflow, or other orchestration tools.
  • Exposure to Databricks and Delta Lake.

EXPERIENCE: 3-20 YEARS

LOCATION: BANGALORE

  • Scala-Spark-AWS EKS/AWS Kubernetes(2-15 Years)

    7 days ago

    Bengaluru, Chennai, Hyderabad, India Infosys Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Roles and ResponsibilitiesDesign, develop, test, deploy, and maintain large-scale data processing pipelines using Scala and Spark on AWS EKS/AWS Kubernetes.Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs.Develop high-quality code that is efficient, scalable, and easy to...

  • Data Engineer

    2 weeks ago

    Hyderabad, India MANOJAVAM TECHNOLOGIES PRIVATE LIMITED Full time

    Job Title : Data Engineer Scala with Play OR SparkLocation : HyderabadExperience : 4 to 7 YearsEmployment Type : Full-TimeAbout the Role :We are looking for an exceptional Backend Engineer who thrives in solving complex challenges and building scalable, distributed, and high-performance systems. If you are passionate about functional programming,...

  • AWS- Scala Developer

    2 weeks ago

    Greater Noida, Hyderabad, Noida, India Coforge Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Streaming data Technical skills requirements :-Experience- 5+ Years Solid hands-on and Solution Architecting experience in Big-Data Technologies (AWS preferred)Hands on experience in: AWS Dynamo DB, EKS, Kafka, Kinesis, Glue, EMRHands-on experience of programming language like Scala with Spark.Good command and working experience on Hadoop Map Reduce, HDFS,...

  • Spark developer

    2 weeks ago

    Hyderabad, India Tata Consultancy Services Full time

    Greetings from TCS !!! TCS presents an excellent opportunity for Java developer (Java,spark,AWS) Relevant Experience (Yrs) Need : 7 to 11 years Role: Java developer (Java,spark,AWS) Preferred Location Only for -Hyderabad/Bangalore Must-Have** (Ideally should not be more than 3-5) - Spark programming, Java / J2EE, AWS Responsibility of / Expectations from the...

  • Spark developer

    2 weeks ago

    hyderabad, India Tata Consultancy Services Full time

    Greetings from TCS !!! TCS presents an excellent opportunity for Java developer (Java,spark,AWS) Relevant Experience (Yrs) Need : 7 to 11 years Role: Java developer (Java,spark,AWS) Preferred Location Only for -Hyderabad/Bangalore Must-Have** (Ideally should not be more than 3-5) - Spark programming, Java / J2EE, AWS Responsibility of / Expectations from the...

  • Spark developer

    1 week ago

    Hyderabad, India Tata Consultancy Services Full time

    Greetings from TCS !!! TCS presents an excellent opportunity for Java developer (Java,spark,AWS) Relevant Experience (Yrs) Need : 7 to 11 years Role: Java developer (Java,spark,AWS) Preferred Location Only for -Hyderabad/Bangalore Must-Have** (Ideally should not be more than 3-5) - Spark programming, Java / J2EE, AWS Responsibility of / Expectations from the...

  • Spark developer

    1 week ago

    Hyderabad, India Tata Consultancy Services Full time

    Greetings from TCS !!! TCS presents an excellent opportunity for Java developer (Java,spark,AWS) Relevant Experience (Yrs) Need : 7 to 11 years Role: Java developer (Java,spark,AWS) Preferred Location Only for -Hyderabad/Bangalore Must-Have** (Ideally should not be more than 3-5) - Spark programming, Java / J2EE, AWS Responsibility of / Expectations from the...

  • Spark developer

    7 days ago

    hyderabad, India Tata Consultancy Services Full time

    Greetings from TCS !!! TCS presents an excellent opportunity for Java developer (Java,spark,AWS) Relevant Experience (Yrs) Need : 7 to 11 years Role: Java developer (Java,spark,AWS) Preferred Location Only for -Hyderabad/Bangalore Must-Have** (Ideally should not be more than 3-5) - Spark programming, Java / J2EE, AWS Responsibility of / Expectations from the...

  • Big Data Engineer

    4 weeks ago

    Hyderabad, India Sky Systems, Inc. (SkySys) Full time

    Role: Big Data EngineerPosition Type: Full-Time Contract (40hrs/week)Contract Duration: Long TermWork Schedule : 8 hours/day (Mon-Fri)Location : Hybrid - Hyderabad, India (3x days onsite/week)We are looking for a skilled Big Data Engineer (5+ years’ experience) to join Experian’s dynamic data engineering team. You will design and optimize scalable data...

  • Big Data Engineer

    3 weeks ago

    Hyderabad, India Sky Systems, Inc. (SkySys) Full time

    Role: Big Data Engineer Position Type: Full-Time Contract (40hrs/week)Contract Duration: Long TermWork Schedule : 8 hours/day (Mon-Fri)Location : Hybrid - Hyderabad, India (3x days onsite/week)We are looking for a skilled Big Data Engineer (5+ years’ experience) to join Experian’s dynamic data engineering team. You will design and optimize scalable data...