Spark+ Scala+ SQL

2 months ago


Bengaluru, India RARR Technologies Full time

**Job Details - Spark+ Scala+ SQL**:
**Job ID**:

- RARR Job 2943**Job Title**:

- Spark+ Scala+ SQL**Job Type**:

- Permanent**Job Location**:

- BENGALURU / BANGALORE, CHENNAI, HYDERABAD, MUMBAI, PUNE**Total Experience**:

- 6 - 12 Years**Skills**:

- SCALA, SPARK**Posted - **01/02/2023

**Job Description**:
**JD Details**:

- Should have at least 6 to 12 years of experience in developing end to end ETL and Data Engineering solutions.
- Fluent in Azure, Spark, Scala and SQL with ability to migrate data from Azure gen1 to gen2, ingest, design, development and testing of ETL Pipelines
- Build and maintain scheduled tasks with Airflow and Python
- Understand the current architecture, data flow and code.
- Coordinate with Onsite and own the code deployment to higher environments.
- Create comprehensive documentation in the context of changes being done to ETL pipelines.
- Operate in an environment following agile scrum methodology.
- Provide support during SIT/UAT, Cut-Over, Implementation and Hypercare



  • Bengaluru, India RARR Technologies Full time

    **Job Details - Bigdata, Spark, Scala, SQL**: **Job ID**: - RARR Job 2937**Job Title**: - Bigdata, Spark, Scala, SQL**Job Type**: - Permanent**Job Location**: - BENGALURU / BANGALORE, CHENNAI, HYDERABAD, KOLKATA, MUMBAI, PUNE**Total Experience**: - 3 - 12 Years**Skills**: - BIGDATA, SCALA, SPARK, SQL**Posted - **31/01/2023 **Job...

  • Data Engineer

    2 weeks ago


    Bengaluru, India VDart Software Services Pvt. Ltd. Full time

    Job Description:Mandatory - Hands on spark scala programming, experience in working in data lakes, data migration project, AWS cloudStrong proficiency in Scala, with a minimum of 2 years' experience in a data lake environment -- MUSTExpertise in technologies such as Impala, Spark, Python, Java, and SQL.Cloud migration experience, particularly with AWS...

  • Data Engineer

    1 week ago


    Bengaluru, India VDart Software Services Pvt. Ltd. Full time

    Job Description:Mandatory - Hands on spark scala programming, experience in working in data lakes, data migration project, AWS cloudStrong proficiency in Scala, with a minimum of 2 years' experience in a data lake environment -- MUSTExpertise in technologies such as Impala, Spark, Python, Java, and SQL.Cloud migration experience, particularly with AWS...

  • Data Streaming

    2 days ago


    Bengaluru, India ACE Talent Consulting Full time

    Job Description: Spark/Scala/PySpark developer who knows how to fully exploit the potential of our Spark cluster. Should have ability to clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data. **Responsibilities**: Create Scala/Spark/Pyspark jobs for data transformation and aggregation Produce...

  • Data Streaming

    2 days ago


    Bengaluru, India ACE Talent Consulting Full time

    ob Description: Spark/Scala/PySpark developer who knows how to fully exploit the potential of our Spark cluster. Should have ability to clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data. **Responsibilities**: Create Scala/Spark/Pyspark jobs for data transformation and aggregation Produce...

  • Scala/Spark Developer

    1 month ago


    Bengaluru, India Edge In Asia Recruitment Private Limited Full time

    Our client is a global investment banking company having its headquarters in the US with 75000+ employees globally and is looking for a Scala / Spark to join their Bangalore regional team.Note : Looking for candidates who can join within 30daysWork Mode : Hybrid Experience : 5 to 8 yearsSome of the key responsibilities will include :- Understand and...


  • Bengaluru, India Edge In Asia Recruitment Private Limited Full time

    Our client is a global investment banking company having its headquarters in the US with 75000+ employees globally and is looking for a Scala / Spark to join their Bangalore regional team.Note : Looking for candidates who can join within 30daysWork Mode : Hybrid Experience : 5 to 8 yearsSome of the key responsibilities will include :- Understand and...

  • Big Data Consultant

    2 months ago


    Bengaluru, India Nilasu consulting Full time

    Summary :We are seeking a highly skilled consultant with expertise in Spark/Scala and Python to join our team. You will play a key role in developing and maintaining big data applications using Spark and Scala with a focus on functional programming principles. Additionally, your experience in Python and microservices architecture will be valuable in building...

  • Big Data Consultant

    1 week ago


    Bengaluru, India Nilasu consulting Full time

    Summary :We are seeking a highly skilled consultant with expertise in Spark/Scala and Python to join our team. You will play a key role in developing and maintaining big data applications using Spark and Scala with a focus on functional programming principles. Additionally, your experience in Python and microservices architecture will be valuable in building...

  • Big Data

    2 months ago


    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Good work experience & Proven experience working on Python (Data Engineering), Spark/Scala. Qualifications :Undergraduate

  • Senior Data Engineers

    2 months ago


    Bengaluru, India NodeFlair Full time

    JD - primarily experts of Spark 3.X, SCALA, Delta lake implementation, streaming solution implementation for IOT in Spark streaming. Kafka expertise.Any experience with MFG BI, DWH and Datalake implementation would be a bonus.Location: WFH from India1x headcount in 7-10 yrs band (should be flexible for either Malaysia Time Zone or Europe Time Zone)1x...

  • Scala

    4 days ago


    Bengaluru, Karnataka, India Capgemini Full time

    **Job Description**: - **Data Engineer with minimum 6-8 years of relevant IT experience**: - **Experience with Scala object-oriented/object function**: - **Strong SQL background, especially, with Spark SQL, Hive SQL**: - **Experience with data pipelines & Data Lake**: - **Strong background in distributed computing**: - **Experience building complex...

  • Senior Data Engineers

    2 months ago


    Bengaluru, India NodeFlair Full time

    JD - primarily experts of Spark 3.X, SCALA, Delta lake implementation, streaming solution implementation for IOT in Spark streaming. Kafka expertise.Any experience with MFG BI, DWH and Datalake implementation would be a bonus. Location: WFH from India1x headcount in 7-10 yrs band (should be flexible for either Malaysia Time Zone or Europe Time Zone)1x...


  • Bengaluru, India NodeFlair Full time

    JD - primarily experts of Spark 3.X, SCALA, Delta lake implementation, streaming solution implementation for IOT in Spark streaming. Kafka expertise.Any experience with MFG BI, DWH and Datalake implementation would be a bonus. Location: WFH from India1x headcount in 7-10 yrs band (should be flexible for either Malaysia Time Zone or Europe Time Zone)1x...

  • Data Lead Engineer

    2 months ago


    Bengaluru, India Squareroot Consulting Pvt Ltd Full time

    Job Description :We are seeking a highly skilled and motivated Data Lead with expertise in Spark, Scala, Kafka, Big Data, and Batch Processing. As a Data Lead, you will play a key role in leading and managing the end-to-end data processing pipeline, ensuring the reliability, scalability, and efficiency of our data systems.Experience : 6+ YearsLocation :...

  • Data Lead Engineer

    1 week ago


    Bengaluru, India Squareroot Consulting Pvt Ltd Full time

    Job Description :We are seeking a highly skilled and motivated Data Lead with expertise in Spark, Scala, Kafka, Big Data, and Batch Processing. As a Data Lead, you will play a key role in leading and managing the end-to-end data processing pipeline, ensuring the reliability, scalability, and efficiency of our data systems.Experience : 6+ YearsLocation :...

  • Principal Consultant

    1 month ago


    Bengaluru, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...


  • Bengaluru, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...

  • Data Engineer III

    2 months ago


    Bengaluru, India Freelance Full time

    Job Description :Key Responsibilities :- Develop, construct, test, and maintain data architectures (e.g., databases, large-scale processing systems)- Build high-quality data pipelines using Spark/Scala- Implement best software engineering practices, including Git version control, code reviews, and unit testing- Collaborate with data scientists and architects...

  • Data Engineer III

    1 week ago


    Bengaluru, India Freelance Full time

    Job Description :Key Responsibilities :- Develop, construct, test, and maintain data architectures (e.g., databases, large-scale processing systems)- Build high-quality data pipelines using Spark/Scala- Implement best software engineering practices, including Git version control, code reviews, and unit testing- Collaborate with data scientists and architects...