Scala Spark Developer
3 weeks ago
- Design, develop, and maintain data processing pipelines using Apache Spark and Scala
- Optimize Spark jobs for performance, scalability, and reliability
- Work closely with data engineers and data scientists to implement data-driven solutions
- Develop and maintain ETL processes to ingest, transform, and load large volumes of data
- Perform data analysis and troubleshooting to ensure data quality and integrity
- Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions
- Participate in code reviews, unit testing, and documentation
- Bachelor's degree in Computer Science, Engineering, or related field
- Strong proficiency in Scala programming language
- Hands-on experience with Apache Spark, including Spark Core, Spark SQL, and Spark Streaming
- Experience with big data technologies such as Hadoop, Hive, and Kafka
- Proficiency in SQL for data querying and manipulation
- Familiarity with distributed computing principles and parallel processing techniques
- Experience with data modeling, data warehousing, and database design
- Strong analytical and problem-solving skills
-
Spark+ Scala+ SQL
4 weeks ago
Bengaluru, India RARR Technologies Full time**Job Details - Spark+ Scala+ SQL**: **Job ID**: - RARR Job 2943**Job Title**: - Spark+ Scala+ SQL**Job Type**: - Permanent**Job Location**: - BENGALURU / BANGALORE, CHENNAI, HYDERABAD, MUMBAI, PUNE**Total Experience**: - 6 - 12 Years**Skills**: - SCALA, SPARK**Posted - **01/02/2023 **Job Description**: **JD Details**: - Should have at least 6 to 12...
-
Bigdata, Spark, Scala, SQL
4 weeks ago
Bengaluru, India RARR Technologies Full time**Job Details - Bigdata, Spark, Scala, SQL**: **Job ID**: - RARR Job 2937**Job Title**: - Bigdata, Spark, Scala, SQL**Job Type**: - Permanent**Job Location**: - BENGALURU / BANGALORE, CHENNAI, HYDERABAD, KOLKATA, MUMBAI, PUNE**Total Experience**: - 3 - 12 Years**Skills**: - BIGDATA, SCALA, SPARK, SQL**Posted - **31/01/2023 **Job...
-
Scala/Spark Developer
3 weeks ago
Bengaluru, India Edge In Asia Recruitment Private Limited Full timeOur client is a global investment banking company having its headquarters in the US with 75000+ employees globally and is looking for a Scala / Spark to join their Bangalore regional team.Note : Looking for candidates who can join within 30daysWork Mode : Hybrid Experience : 5 to 8 yearsSome of the key responsibilities will include :- Understand and...
-
Big Data Consultant
3 weeks ago
Bengaluru, India Nilasu consulting Full timeSummary :We are seeking a highly skilled consultant with expertise in Spark/Scala and Python to join our team. You will play a key role in developing and maintaining big data applications using Spark and Scala with a focus on functional programming principles. Additionally, your experience in Python and microservices architecture will be valuable in building...
-
Spark Scala
1 month ago
Bengaluru, India Cognizant Full time**Technical Lead** **Qualification**: Bachelors in science, engineering or equivalent **Responsibility**: **Project Planning and Setup**: - Understand the project scope, identify activities/ tasks, task level estimates, schedule, dependencies, risks and provide inputs to Module Lead for review. - Provide inputs to testing strategy, configuration,...
-
Big Data
4 weeks ago
Bengaluru, Karnataka, India Tata Consultancy Services Full timeGood work experience & Proven experience working on Python (Data Engineering), Spark/Scala. Qualifications :Undergraduate
-
Quantexa Developer
3 weeks ago
Bengaluru, India IBU Consulting Full timeRoles And Responsibilities :- Quantexa ETL and Scoring Development, configuration, and enhancements.- Technical delivery of Quantexa implementation utilizing the below support tools and methods.- Agile / DevOps delivery mode.- CI/CD pipelines.- Work with Kubernetes.- Basic understanding of MS Azure and Azure DevOps is a plus .- Hands-on experience with Scala...
-
Data Streaming
1 month ago
Bengaluru, India ACE Talent Consulting Full timeJob Description: Spark/Scala/PySpark developer who knows how to fully exploit the potential of our Spark cluster. Should have ability to clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data. **Responsibilities**: Create Scala/Spark/Pyspark jobs for data transformation and aggregation Produce...
-
Data Streaming
1 month ago
Bengaluru, India ACE Talent Consulting Full timeob Description: Spark/Scala/PySpark developer who knows how to fully exploit the potential of our Spark cluster. Should have ability to clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data. **Responsibilities**: Create Scala/Spark/Pyspark jobs for data transformation and aggregation Produce...
-
Principal Consultant
2 weeks ago
Bengaluru, India Genpact Full timeGenpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...
-
Big Data- Spark Scala Tesco
1 month ago
Bengaluru, India Triangle Global Full timeMandatory -Spark, Scala, Hadoop ,Kafka, Streaming with minimum 6yrs exp,
-
Data Engineer III
3 weeks ago
Bengaluru, India Freelance Full timeJob Description :Key Responsibilities :- Develop, construct, test, and maintain data architectures (e.g., databases, large-scale processing systems)- Build high-quality data pipelines using Spark/Scala- Implement best software engineering practices, including Git version control, code reviews, and unit testing- Collaborate with data scientists and architects...
-
Data Engineer
3 weeks ago
Bengaluru, India Squareroot Consulting Pvt Ltd Full timeRole : Data EngineerLocation : BangaloreExperience : 3+ Yrs.Responsibilities :- Develop and maintain scalable data pipelines for batch processing using Apache Spark in Big Data projects.- Utilize Scala programming language to implement efficient data processing solutions.- Collaborate with cross-functional teams to understand data requirements and design...
-
Data Lead Engineer
3 weeks ago
Bengaluru, India Squareroot Consulting Pvt Ltd Full timeJob Description :We are seeking a highly skilled and motivated Data Lead with expertise in Spark, Scala, Kafka, Big Data, and Batch Processing. As a Data Lead, you will play a key role in leading and managing the end-to-end data processing pipeline, ensuring the reliability, scalability, and efficiency of our data systems.Experience : 6+ YearsLocation :...
-
Principal Consultant
2 weeks ago
Bengaluru, India Genpact Full timeGenpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people –...
-
Big Data
4 weeks ago
Bengaluru, India Riverforest Connections Full time**Job Description**: **Strong proficiency Scala + Spark (Hadoop) with Java (mandatory)** Database experience preferably with DB2, Sybase, or Oracle - Complete SDLC process and Agile Methodology (Scrum) - Version control - Git - Spring Skill Desired: - Previous experience in Trade Surveillance or working with data from the order lifecycle - High quality...
-
Scala Developer
3 weeks ago
Bengaluru, India NUSTAR TECHNOLOGIES INDIA PRIVATE LIMITED Full timeJob Description- Must have 4+ years of IT experience- Must have good experience in Spark and Scala- Develop and maintain big data applications using Spark and Scala, ensuring high performance, reliability, and scalability.- Implement Spark data processing techniques, performance tuning, memory management, fault tolerance mechanisms, and scalability...
-
Technical Lead(Spark/Scala) || 9
1 month ago
Bengaluru, India Emids Full timeHi All,Greetings for the day!!We are currently hiring forTechnical lead(Spark/Scala) for Emids(MNC)at Bangalore location.Role: Technical lead(Spark/Scala)Location: Bangalore/Nodia/Hyderabad(Hybrid model)Experience : 9- 16YrsJob Type : Permanent .Notice Period: Immediate to 15 days OnlyJob Description:Job Description:Minimum 10+ years in the field of Data &...
-
Technical Lead(Spark/Scala) || 9
4 weeks ago
Bengaluru, India Emids Full timeHi All,Greetings for the day!!We are currently hiring for Technical lead(Spark/Scala) for Emids(MNC) at Bangalore location.Role: Technical lead(Spark/Scala)Location: Bangalore/Nodia/Hyderabad(Hybrid model)Experience : 9- 16YrsJob Type : Permanent .Notice Period: Immediate to 15 days OnlyJob Description:Job Description:- Minimum 10+ years in the field of Data...
-
Scala
1 month ago
Bengaluru, Karnataka, India Capgemini Full time**Job Description**: - **Data Engineer with minimum 6-8 years of relevant IT experience**: - **Experience with Scala object-oriented/object function**: - **Strong SQL background, especially, with Spark SQL, Hive SQL**: - **Experience with data pipelines & Data Lake**: - **Strong background in distributed computing**: - **Experience building complex...