Scala Spark Developer
2 weeks ago
- Design, develop, and maintain data processing pipelines using Apache Spark and Scala
- Optimize Spark jobs for performance, scalability, and reliability
- Work closely with data engineers and data scientists to implement data-driven solutions
- Develop and maintain ETL processes to ingest, transform, and load large volumes of data
- Perform data analysis and troubleshooting to ensure data quality and integrity
- Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions
- Participate in code reviews, unit testing, and documentation
- Bachelor's degree in Computer Science, Engineering, or related field
- Strong proficiency in Scala programming language
- Hands-on experience with Apache Spark, including Spark Core, Spark SQL, and Spark Streaming
- Experience with big data technologies such as Hadoop, Hive, and Kafka
- Proficiency in SQL for data querying and manipulation
- Familiarity with distributed computing principles and parallel processing techniques
- Experience with data modeling, data warehousing, and database design
- Strong analytical and problem-solving skills
-
Scala /spark
7 days ago
Bengaluru, India eTeam India Full timeKey Qualifications " Expertise with functional programming, preferably Scala " Fluency in Hadoop technologies and big data processing technologies, e.g. Spark, YARN, HDFS, Oozie, Hive " Experience implementing RESTful web services in Java, Scala, Python, or similar languages. " Experience with NoSQL and SQL databases " Experience in information...
-
Scala/Spark Developer
2 weeks ago
Bengaluru, India Edge In Asia Recruitment Private Limited Full timeOur client is a global investment banking company having its headquarters in the US with 75000+ employees globally and is looking for a Scala / Spark to join their Bangalore regional team.Note : Looking for candidates who can join within 30daysWork Mode : Hybrid Experience : 5 to 8 yearsSome of the key responsibilities will include :- Understand and...
-
Big Data Consultant
2 weeks ago
Bengaluru, India Nilasu consulting Full timeSummary :We are seeking a highly skilled consultant with expertise in Spark/Scala and Python to join our team. You will play a key role in developing and maintaining big data applications using Spark and Scala with a focus on functional programming principles. Additionally, your experience in Python and microservices architecture will be valuable in building...
-
Spark Scala
4 weeks ago
Bengaluru, India Cognizant Full time**Technical Lead** **Qualification**: Bachelors in science, engineering or equivalent **Responsibility**: **Project Planning and Setup**: - Understand the project scope, identify activities/ tasks, task level estimates, schedule, dependencies, risks and provide inputs to Module Lead for review. - Provide inputs to testing strategy, configuration,...
-
Quantexa Developer
2 weeks ago
Bengaluru, India IBU Consulting Full timeRoles And Responsibilities :- Quantexa ETL and Scoring Development, configuration, and enhancements.- Technical delivery of Quantexa implementation utilizing the below support tools and methods.- Agile / DevOps delivery mode.- CI/CD pipelines.- Work with Kubernetes.- Basic understanding of MS Azure and Azure DevOps is a plus .- Hands-on experience with Scala...
-
Data Streaming
4 weeks ago
Bengaluru, India ACE Talent Consulting Full timeJob Description: Spark/Scala/PySpark developer who knows how to fully exploit the potential of our Spark cluster. Should have ability to clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data. **Responsibilities**: Create Scala/Spark/Pyspark jobs for data transformation and aggregation Produce...
-
Data Streaming
4 weeks ago
Bengaluru, India ACE Talent Consulting Full timeob Description: Spark/Scala/PySpark developer who knows how to fully exploit the potential of our Spark cluster. Should have ability to clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data. **Responsibilities**: Create Scala/Spark/Pyspark jobs for data transformation and aggregation Produce...
-
Principal Consultant
5 days ago
Bengaluru, India Genpact Full timeGenpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...
-
Big Data- Spark Scala Tesco
4 weeks ago
Bengaluru, India Triangle Global Full timeMandatory -Spark, Scala, Hadoop ,Kafka, Streaming with minimum 6yrs exp,
-
Data Engineer III
2 weeks ago
Bengaluru, India Freelance Full timeJob Description :Key Responsibilities :- Develop, construct, test, and maintain data architectures (e.g., databases, large-scale processing systems)- Build high-quality data pipelines using Spark/Scala- Implement best software engineering practices, including Git version control, code reviews, and unit testing- Collaborate with data scientists and architects...
-
Data Engineer
2 weeks ago
Bengaluru, India Squareroot Consulting Pvt Ltd Full timeRole : Data EngineerLocation : BangaloreExperience : 3+ Yrs.Responsibilities :- Develop and maintain scalable data pipelines for batch processing using Apache Spark in Big Data projects.- Utilize Scala programming language to implement efficient data processing solutions.- Collaborate with cross-functional teams to understand data requirements and design...
-
Principal Consultant
1 week ago
Bengaluru, India Genpact Full timeGenpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people –...
-
Data Lead Engineer
2 weeks ago
Bengaluru, India Squareroot Consulting Pvt Ltd Full timeJob Description :We are seeking a highly skilled and motivated Data Lead with expertise in Spark, Scala, Kafka, Big Data, and Batch Processing. As a Data Lead, you will play a key role in leading and managing the end-to-end data processing pipeline, ensuring the reliability, scalability, and efficiency of our data systems.Experience : 6+ YearsLocation :...
-
Scala Developer
2 weeks ago
Bengaluru, India NUSTAR TECHNOLOGIES INDIA PRIVATE LIMITED Full timeJob Description- Must have 4+ years of IT experience- Must have good experience in Spark and Scala- Develop and maintain big data applications using Spark and Scala, ensuring high performance, reliability, and scalability.- Implement Spark data processing techniques, performance tuning, memory management, fault tolerance mechanisms, and scalability...
-
Technical Lead(Spark/Scala) || 9
4 weeks ago
Bengaluru, India Emids Full timeHi All,Greetings for the day!!We are currently hiring forTechnical lead(Spark/Scala) for Emids(MNC)at Bangalore location.Role: Technical lead(Spark/Scala)Location: Bangalore/Nodia/Hyderabad(Hybrid model)Experience : 9- 16YrsJob Type : Permanent .Notice Period: Immediate to 15 days OnlyJob Description:Job Description:Minimum 10+ years in the field of Data &...
-
Technical Lead(Spark/Scala) || 9
4 weeks ago
Bengaluru, India Emids Full timeHi All,Greetings for the day!!We are currently hiring for Technical lead(Spark/Scala) for Emids(MNC) at Bangalore location.Role: Technical lead(Spark/Scala)Location: Bangalore/Nodia/Hyderabad(Hybrid model)Experience : 9- 16YrsJob Type : Permanent .Notice Period: Immediate to 15 days OnlyJob Description:Job Description:- Minimum 10+ years in the field of Data...
-
Scala Develoepr
4 weeks ago
Bengaluru, India Power IT Services Pvt Ltd Full timeExperience: 4-15 years Work Location: Bangalore Notice Period: Immediate to 30 days **Job Description**: Total Yrs. of Experience* 3 to 15 years Relevant Yrs. of experience* 2 years Roles and Responsibilities: Scala Developer Mandatory skills* Scala Programming, JUnit, Mockito, Scalatest (Embedded Cassandra) Knowledge in Object-oriented programming...
-
Scala
4 weeks ago
Bengaluru, Karnataka, India Capgemini Full time**Job Description**: - **Data Engineer with minimum 6-8 years of relevant IT experience**: - **Experience with Scala object-oriented/object function**: - **Strong SQL background, especially, with Spark SQL, Hive SQL**: - **Experience with data pipelines & Data Lake**: - **Strong background in distributed computing**: - **Experience building complex...
-
Senior Bigdata Engineer with Scala
1 day ago
Bengaluru, India HTC Global Services Full timeJob Details:• Should have hands on experience in Software development • Responsible for designing, deploying, and managing high quality data • Create and maintain optimal data architecture pipeline. • Collaborate with various onsite and client stakeholders in Agile environment to identify data engineering requirements and implement data solutions....
-
Senior Data Engineers
3 weeks ago
Bengaluru, India NodeFlair Full timeJD - primarily experts of Spark 3.X, SCALA, Delta lake implementation, streaming solution implementation for IOT in Spark streaming. Kafka expertise.Any experience with MFG BI, DWH and Datalake implementation would be a bonus.Location: WFH from India1x headcount in 7-10 yrs band (should be flexible for either Malaysia Time Zone or Europe Time Zone)1x...