Spark, Scala Developer

2 weeks ago

Bengaluru, Karnataka, India SRS Infoway Full time

Role & responsibilities

  • At least 5+ years of experience and strong knowledge in Scala programming language.
  • Able to write clean, maintainable and efficient Scala code following best practices.
  • Good knowledge on the fundamental Data Structures and their usage
  • At least 5+ years of experience in designing and developing large scale, distributed data processing pipelines using Apache Spark and related technologies.
  • Having expertise in Spark Core, Spark SQL and Spark Streaming.
  • Experience with Hadoop, HDFS, Hive and other BigData technologies.
  • Familiarity with Data warehousing and ETL concepts and techniques
  • Having expertise in Database concepts and SQL/NoSQL operations.
  • UNIX shell scripting will be an added advantage in scheduling/running application jobs.
  • At least 8 years of experience in Project development life cycle activities and maintenance/support projects.
  • Work in an Agile environment and participation in scrum daily standups, sprint planning reviews and retrospectives.
  • Understand project requirements and translate them into technical solutions which meets the project quality standards
  • Ability to work in team in diverse/multiple stakeholder environment  and collaborate with upstream/downstream functional teams to identify, troubleshoot and resolve data issues.
  • Strong problem solving and Good Analytical skills.
  • Excellent verbal and written communication skills.
  • Experience and desire to work in a Global delivery environment.
  • Stay up to date with new technologies and industry trends in Development.

  • Scala(Spark) Development Engineer

    2 weeks ago

    Bengaluru, Karnataka, India IQVIA Full time

    Job Description SummaryWe are seeking anexperienced Scala Engineerto actively contribute to the development of existing data standardisation tools and, over time, design and productionise new iteration by leveraging internal expertise and AI-driven capabilities.You will work as part of a globally distributed team, building new microservices and improving...

  • Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full time

    Job Title: Data Engineer (Spark & Scala)Experience: 5 to 12 YearsLocation: Bangalore/Pune/Chennai/GurugramKey Skills- Knowledge of Data Lakes environment, Spark/ Scala, Data pipelines, SQL, AWS.- ‎ Have at least 5+ Years of Experience on Devops activities- Spark /Scala experience should be 3+- Shell Scripting experience for 3+ years.- CI/CD with Github...

  • Lead Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India, Karnataka Xebia Full time

    Job Title : Lead Data Engineer - Spark/ScalaJob Location : BengaluruExp : 6-12 yearsPosition Overview : We are hiring Data Engineer with hands on experience on Spark/Scala and other Big Data Technologies .Big Data Orchestration: Airflow, Spark on Kubernetes, Yarn, Oozie • Big Data Processing: Hadoop, Kafka, Spark & Spark Structured Streaming. •...

  • spark developer

    1 week ago

    Bengaluru, Karnataka, India Coders Brain Technology Full time

    JD for Spark developer Experience:3 to 5 Years Work Location: Bangalore     Responsibilities   .   As a Spark developer you will manage the development of scalable distributed Architecture defined by the Architect or tech Lead in our team.   .   Analyse, assemble large data sets to designed for the functional and...

  • Scala Developer

    5 days ago

    Bengaluru, Karnataka, India Tata Consultancy Services (TCS) Full time

    Key Skills- Knowledge of Data Lakes environment, Spark/ Scala, Data pipelines, SQL, AWS.Have at least 5+ Years of Experience on Devops activitiesSpark /Scala experience should be 3+Shell Scripting experience for 3+ years.CI/CD with Github Workflow & FluxCD/Helm experience.Aws Data Related service experience would be plus.LocationBengaluruJob...

  • Scala Developer

    5 days ago

    Bengaluru, Karnataka, India Waayslive solution Full time

    Location- Bangalore, WhitefieldMandatory Skills:5+ Maintaining big data platforms using Spark and Scala( Don't share any Pypark profile .)Note- Resource should have experience in Scala Experience .Job Description:· Must have6+ years of experience in building and maintaining big data platforms using Spark and Scala.Strong knowledge of distributed computing...

  • GCP + Spark

    7 days ago

    Bengaluru, Karnataka, India Cognizant Technology Solutions Full time

    Skill: GCP, SparkExperience: 6 to 13 YearsLocation : AIA – ChennaiJob DescriptionWe are seeking an experienced Engineer with strong expertise in Spark, Scala, GCP, Python/PySpark, Shell Scripting and SQL to build and optimize large-scale data solutions in a cloud environment.4+ years of experience in Big Data and Data Engineering.Strong hands-on expertise...

  • Data Engineer- Spark

    7 days ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Responsibilities:* Design, develop, and maintain data pipelines using Spark, Python, Scala, and Java.* Write efficient and optimized SQL queries for data extraction, transformation, and loading (ETL) processes.* Work with DataFrames to manipulate and analyze large datasets.* Implement data storage and processing solutions using cloud technologies (preferably...

  • Scala Developer

    3 weeks ago

    Bengaluru, Karnataka, India, Karnataka Integrated Personnel Services Limited Full time

    Looking for the Latest Hiring Updates?Follow Integrated Personnel Services Limited (IPS Group) on LinkedInRole: Scala DeveloperLocation: Bangalore, MumbaiRequired Skill Sets:Minimum 4 Years of strong experience in Scala with Java back end development or HIVE.Code using correct, concise, and clean Scala programming languageStrong skill in Database SQL/...

  • Software Engineer III Java, Scala, Spark, AWS

    2 weeks ago

    Bengaluru, Karnataka, India JPMorgan Chase Full time

    Push the limits of what's possible with us as an experienced member of our Software Engineering team.As a Software Engineer III- Big Data/Java/Scala at JPMorgan Chase as a part of the Liquidity Risk (LRI) team, you will be instrumental in designing and implementing the next generation of a cloud-native liquidity risk management platform for JPMC. The...