Spark+ Scala+ SQL
2 months ago
**Job Details - Spark+ Scala+ SQL**:
**Job ID**:
- RARR Job 2943**Job Title**:
- Spark+ Scala+ SQL**Job Type**:
- Permanent**Job Location**:
- BENGALURU / BANGALORE, CHENNAI, HYDERABAD, MUMBAI, PUNE**Total Experience**:
- 6 - 12 Years**Skills**:
- SCALA, SPARK**Posted - **01/02/2023
**Job Description**:
**JD Details**:
- Should have at least 6 to 12 years of experience in developing end to end ETL and Data Engineering solutions.
- Fluent in Azure, Spark, Scala and SQL with ability to migrate data from Azure gen1 to gen2, ingest, design, development and testing of ETL Pipelines
- Build and maintain scheduled tasks with Airflow and Python
- Understand the current architecture, data flow and code.
- Coordinate with Onsite and own the code deployment to higher environments.
- Create comprehensive documentation in the context of changes being done to ETL pipelines.
- Operate in an environment following agile scrum methodology.
- Provide support during SIT/UAT, Cut-Over, Implementation and Hypercare
-
Bigdata, Spark, Scala, SQL
2 months ago
Bengaluru, India RARR Technologies Full time**Job Details - Bigdata, Spark, Scala, SQL**: **Job ID**: - RARR Job 2937**Job Title**: - Bigdata, Spark, Scala, SQL**Job Type**: - Permanent**Job Location**: - BENGALURU / BANGALORE, CHENNAI, HYDERABAD, KOLKATA, MUMBAI, PUNE**Total Experience**: - 3 - 12 Years**Skills**: - BIGDATA, SCALA, SPARK, SQL**Posted - **31/01/2023 **Job...
-
Data Engineer
2 weeks ago
Bengaluru, India VDart Software Services Pvt. Ltd. Full timeJob Description:Mandatory - Hands on spark scala programming, experience in working in data lakes, data migration project, AWS cloudStrong proficiency in Scala, with a minimum of 2 years' experience in a data lake environment -- MUSTExpertise in technologies such as Impala, Spark, Python, Java, and SQL.Cloud migration experience, particularly with AWS...
-
Data Engineer
1 week ago
Bengaluru, India VDart Software Services Pvt. Ltd. Full timeJob Description:Mandatory - Hands on spark scala programming, experience in working in data lakes, data migration project, AWS cloudStrong proficiency in Scala, with a minimum of 2 years' experience in a data lake environment -- MUSTExpertise in technologies such as Impala, Spark, Python, Java, and SQL.Cloud migration experience, particularly with AWS...
-
Data Streaming
2 days ago
Bengaluru, India ACE Talent Consulting Full timeJob Description: Spark/Scala/PySpark developer who knows how to fully exploit the potential of our Spark cluster. Should have ability to clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data. **Responsibilities**: Create Scala/Spark/Pyspark jobs for data transformation and aggregation Produce...
-
Data Streaming
2 days ago
Bengaluru, India ACE Talent Consulting Full timeob Description: Spark/Scala/PySpark developer who knows how to fully exploit the potential of our Spark cluster. Should have ability to clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data. **Responsibilities**: Create Scala/Spark/Pyspark jobs for data transformation and aggregation Produce...
-
Scala/Spark Developer
1 month ago
Bengaluru, India Edge In Asia Recruitment Private Limited Full timeOur client is a global investment banking company having its headquarters in the US with 75000+ employees globally and is looking for a Scala / Spark to join their Bangalore regional team.Note : Looking for candidates who can join within 30daysWork Mode : Hybrid Experience : 5 to 8 yearsSome of the key responsibilities will include :- Understand and...
-
Scala/Spark Developer
1 week ago
Bengaluru, India Edge In Asia Recruitment Private Limited Full timeOur client is a global investment banking company having its headquarters in the US with 75000+ employees globally and is looking for a Scala / Spark to join their Bangalore regional team.Note : Looking for candidates who can join within 30daysWork Mode : Hybrid Experience : 5 to 8 yearsSome of the key responsibilities will include :- Understand and...
-
Big Data Consultant
2 months ago
Bengaluru, India Nilasu consulting Full timeSummary :We are seeking a highly skilled consultant with expertise in Spark/Scala and Python to join our team. You will play a key role in developing and maintaining big data applications using Spark and Scala with a focus on functional programming principles. Additionally, your experience in Python and microservices architecture will be valuable in building...
-
Big Data Consultant
1 week ago
Bengaluru, India Nilasu consulting Full timeSummary :We are seeking a highly skilled consultant with expertise in Spark/Scala and Python to join our team. You will play a key role in developing and maintaining big data applications using Spark and Scala with a focus on functional programming principles. Additionally, your experience in Python and microservices architecture will be valuable in building...
-
Big Data
2 months ago
Bengaluru, Karnataka, India Tata Consultancy Services Full timeGood work experience & Proven experience working on Python (Data Engineering), Spark/Scala. Qualifications :Undergraduate
-
Senior Data Engineers
2 months ago
Bengaluru, India NodeFlair Full timeJD - primarily experts of Spark 3.X, SCALA, Delta lake implementation, streaming solution implementation for IOT in Spark streaming. Kafka expertise.Any experience with MFG BI, DWH and Datalake implementation would be a bonus.Location: WFH from India1x headcount in 7-10 yrs band (should be flexible for either Malaysia Time Zone or Europe Time Zone)1x...
-
Scala
4 days ago
Bengaluru, Karnataka, India Capgemini Full time**Job Description**: - **Data Engineer with minimum 6-8 years of relevant IT experience**: - **Experience with Scala object-oriented/object function**: - **Strong SQL background, especially, with Spark SQL, Hive SQL**: - **Experience with data pipelines & Data Lake**: - **Strong background in distributed computing**: - **Experience building complex...
-
Senior Data Engineers
2 months ago
Bengaluru, India NodeFlair Full timeJD - primarily experts of Spark 3.X, SCALA, Delta lake implementation, streaming solution implementation for IOT in Spark streaming. Kafka expertise.Any experience with MFG BI, DWH and Datalake implementation would be a bonus. Location: WFH from India1x headcount in 7-10 yrs band (should be flexible for either Malaysia Time Zone or Europe Time Zone)1x...
-
Senior Data Engineers
1 week ago
Bengaluru, India NodeFlair Full timeJD - primarily experts of Spark 3.X, SCALA, Delta lake implementation, streaming solution implementation for IOT in Spark streaming. Kafka expertise.Any experience with MFG BI, DWH and Datalake implementation would be a bonus. Location: WFH from India1x headcount in 7-10 yrs band (should be flexible for either Malaysia Time Zone or Europe Time Zone)1x...
-
Data Lead Engineer
2 months ago
Bengaluru, India Squareroot Consulting Pvt Ltd Full timeJob Description :We are seeking a highly skilled and motivated Data Lead with expertise in Spark, Scala, Kafka, Big Data, and Batch Processing. As a Data Lead, you will play a key role in leading and managing the end-to-end data processing pipeline, ensuring the reliability, scalability, and efficiency of our data systems.Experience : 6+ YearsLocation :...
-
Data Lead Engineer
1 week ago
Bengaluru, India Squareroot Consulting Pvt Ltd Full timeJob Description :We are seeking a highly skilled and motivated Data Lead with expertise in Spark, Scala, Kafka, Big Data, and Batch Processing. As a Data Lead, you will play a key role in leading and managing the end-to-end data processing pipeline, ensuring the reliability, scalability, and efficiency of our data systems.Experience : 6+ YearsLocation :...
-
Principal Consultant
1 month ago
Bengaluru, India Genpact Full timeGenpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...
-
Principal Consultant
1 week ago
Bengaluru, India Genpact Full timeGenpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...
-
Data Engineer III
2 months ago
Bengaluru, India Freelance Full timeJob Description :Key Responsibilities :- Develop, construct, test, and maintain data architectures (e.g., databases, large-scale processing systems)- Build high-quality data pipelines using Spark/Scala- Implement best software engineering practices, including Git version control, code reviews, and unit testing- Collaborate with data scientists and architects...
-
Data Engineer III
1 week ago
Bengaluru, India Freelance Full timeJob Description :Key Responsibilities :- Develop, construct, test, and maintain data architectures (e.g., databases, large-scale processing systems)- Build high-quality data pipelines using Spark/Scala- Implement best software engineering practices, including Git version control, code reviews, and unit testing- Collaborate with data scientists and architects...