Scala Spark Developer

3 weeks ago


Bengaluru, India RiskInsight Consulting Pvt Ltd. Full time
  • Design, develop, and maintain data processing pipelines using Apache Spark and Scala
  • Optimize Spark jobs for performance, scalability, and reliability
  • Work closely with data engineers and data scientists to implement data-driven solutions
  • Develop and maintain ETL processes to ingest, transform, and load large volumes of data
  • Perform data analysis and troubleshooting to ensure data quality and integrity
  • Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions
  • Participate in code reviews, unit testing, and documentation

Requirements

  • Bachelor's degree in Computer Science, Engineering, or related field
  • Strong proficiency in Scala programming language
  • Hands-on experience with Apache Spark, including Spark Core, Spark SQL, and Spark Streaming
  • Experience with big data technologies such as Hadoop, Hive, and Kafka
  • Proficiency in SQL for data querying and manipulation
  • Familiarity with distributed computing principles and parallel processing techniques
  • Experience with data modeling, data warehousing, and database design
  • Strong analytical and problem-solving skills

  • Spark+ Scala+ SQL

    4 weeks ago


    Bengaluru, India RARR Technologies Full time

    **Job Details - Spark+ Scala+ SQL**: **Job ID**: - RARR Job 2943**Job Title**: - Spark+ Scala+ SQL**Job Type**: - Permanent**Job Location**: - BENGALURU / BANGALORE, CHENNAI, HYDERABAD, MUMBAI, PUNE**Total Experience**: - 6 - 12 Years**Skills**: - SCALA, SPARK**Posted - **01/02/2023 **Job Description**: **JD Details**: - Should have at least 6 to 12...


  • Bengaluru, India RARR Technologies Full time

    **Job Details - Bigdata, Spark, Scala, SQL**: **Job ID**: - RARR Job 2937**Job Title**: - Bigdata, Spark, Scala, SQL**Job Type**: - Permanent**Job Location**: - BENGALURU / BANGALORE, CHENNAI, HYDERABAD, KOLKATA, MUMBAI, PUNE**Total Experience**: - 3 - 12 Years**Skills**: - BIGDATA, SCALA, SPARK, SQL**Posted - **31/01/2023 **Job...

  • Scala/Spark Developer

    3 weeks ago


    Bengaluru, India Edge In Asia Recruitment Private Limited Full time

    Our client is a global investment banking company having its headquarters in the US with 75000+ employees globally and is looking for a Scala / Spark to join their Bangalore regional team.Note : Looking for candidates who can join within 30daysWork Mode : Hybrid Experience : 5 to 8 yearsSome of the key responsibilities will include :- Understand and...

  • Big Data Consultant

    3 weeks ago


    Bengaluru, India Nilasu consulting Full time

    Summary :We are seeking a highly skilled consultant with expertise in Spark/Scala and Python to join our team. You will play a key role in developing and maintaining big data applications using Spark and Scala with a focus on functional programming principles. Additionally, your experience in Python and microservices architecture will be valuable in building...

  • Spark Scala

    1 month ago


    Bengaluru, India Cognizant Full time

    **Technical Lead** **Qualification**: Bachelors in science, engineering or equivalent **Responsibility**: **Project Planning and Setup**: - Understand the project scope, identify activities/ tasks, task level estimates, schedule, dependencies, risks and provide inputs to Module Lead for review. - Provide inputs to testing strategy, configuration,...

  • Big Data

    4 weeks ago


    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Good work experience & Proven experience working on Python (Data Engineering), Spark/Scala. Qualifications :Undergraduate

  • Quantexa Developer

    3 weeks ago


    Bengaluru, India IBU Consulting Full time

    Roles And Responsibilities :- Quantexa ETL and Scoring Development, configuration, and enhancements.- Technical delivery of Quantexa implementation utilizing the below support tools and methods.- Agile / DevOps delivery mode.- CI/CD pipelines.- Work with Kubernetes.- Basic understanding of MS Azure and Azure DevOps is a plus .- Hands-on experience with Scala...

  • Data Streaming

    1 month ago


    Bengaluru, India ACE Talent Consulting Full time

    Job Description: Spark/Scala/PySpark developer who knows how to fully exploit the potential of our Spark cluster. Should have ability to clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data. **Responsibilities**: Create Scala/Spark/Pyspark jobs for data transformation and aggregation Produce...

  • Data Streaming

    1 month ago


    Bengaluru, India ACE Talent Consulting Full time

    ob Description: Spark/Scala/PySpark developer who knows how to fully exploit the potential of our Spark cluster. Should have ability to clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data. **Responsibilities**: Create Scala/Spark/Pyspark jobs for data transformation and aggregation Produce...

  • Principal Consultant

    2 weeks ago


    Bengaluru, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...


  • Bengaluru, India Triangle Global Full time

    Mandatory -Spark, Scala, Hadoop ,Kafka, Streaming with minimum 6yrs exp,

  • Data Engineer III

    3 weeks ago


    Bengaluru, India Freelance Full time

    Job Description :Key Responsibilities :- Develop, construct, test, and maintain data architectures (e.g., databases, large-scale processing systems)- Build high-quality data pipelines using Spark/Scala- Implement best software engineering practices, including Git version control, code reviews, and unit testing- Collaborate with data scientists and architects...

  • Data Engineer

    3 weeks ago


    Bengaluru, India Squareroot Consulting Pvt Ltd Full time

    Role : Data EngineerLocation : BangaloreExperience : 3+ Yrs.Responsibilities :- Develop and maintain scalable data pipelines for batch processing using Apache Spark in Big Data projects.- Utilize Scala programming language to implement efficient data processing solutions.- Collaborate with cross-functional teams to understand data requirements and design...

  • Data Lead Engineer

    3 weeks ago


    Bengaluru, India Squareroot Consulting Pvt Ltd Full time

    Job Description :We are seeking a highly skilled and motivated Data Lead with expertise in Spark, Scala, Kafka, Big Data, and Batch Processing. As a Data Lead, you will play a key role in leading and managing the end-to-end data processing pipeline, ensuring the reliability, scalability, and efficiency of our data systems.Experience : 6+ YearsLocation :...

  • Principal Consultant

    2 weeks ago


    Bengaluru, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people –...

  • Big Data

    4 weeks ago


    Bengaluru, India Riverforest Connections Full time

    **Job Description**: **Strong proficiency Scala + Spark (Hadoop) with Java (mandatory)** Database experience preferably with DB2, Sybase, or Oracle - Complete SDLC process and Agile Methodology (Scrum) - Version control - Git - Spring Skill Desired: - Previous experience in Trade Surveillance or working with data from the order lifecycle - High quality...

  • Scala Developer

    3 weeks ago


    Bengaluru, India NUSTAR TECHNOLOGIES INDIA PRIVATE LIMITED Full time

    Job Description- Must have 4+ years of IT experience- Must have good experience in Spark and Scala- Develop and maintain big data applications using Spark and Scala, ensuring high performance, reliability, and scalability.- Implement Spark data processing techniques, performance tuning, memory management, fault tolerance mechanisms, and scalability...


  • Bengaluru, India Emids Full time

    Hi All,Greetings for the day!!We are currently hiring forTechnical lead(Spark/Scala) for Emids(MNC)at Bangalore location.Role: Technical lead(Spark/Scala)Location: Bangalore/Nodia/Hyderabad(Hybrid model)Experience : 9- 16YrsJob Type : Permanent .Notice Period: Immediate to 15 days OnlyJob Description:Job Description:Minimum 10+ years in the field of Data &...


  • Bengaluru, India Emids Full time

    Hi All,Greetings for the day!!We are currently hiring for Technical lead(Spark/Scala) for Emids(MNC) at Bangalore location.Role: Technical lead(Spark/Scala)Location: Bangalore/Nodia/Hyderabad(Hybrid model)Experience : 9- 16YrsJob Type : Permanent .Notice Period: Immediate to 15 days OnlyJob Description:Job Description:- Minimum 10+ years in the field of Data...

  • Scala

    1 month ago


    Bengaluru, Karnataka, India Capgemini Full time

    **Job Description**: - **Data Engineer with minimum 6-8 years of relevant IT experience**: - **Experience with Scala object-oriented/object function**: - **Strong SQL background, especially, with Spark SQL, Hive SQL**: - **Experience with data pipelines & Data Lake**: - **Strong background in distributed computing**: - **Experience building complex...