Java/scala +spark Developer-3
1 week ago
**Responsibilities**: - Bachelor’s degree (in Computer Science, Information Technology). - Must have good programming skills and should be aware of OOPS concept, design principles, data structures. - Good experience in Big Data technologies (A MUST) - HDFS. - Good knowledge of databases: Hive, Hbase. - Good knowledge in Apache Spark, Spark-SQL, UDF, Sqoop. - Knowledge in Kafka. - Advantage: Scala, Neo4j, Gemfire. - Exposure to various file formats - JSON, AVRO, CSV, XML - Flat Text Files - Exposure in Relational Database - Oracle - Exposure to ETL Batch Scheduling & Automation - Autosys - Right attitude to participate and contribute through all phases of Development Lifecycle. - Good team player. - Right sense of ownership. - Eager to learn. Experience with developing software that processes, persists and distributes data via relational and non-relational technologies: - Strong Scala/Java Skills - Experience in design and development of batch/real time Spark processing pipelines. - Knowledge of Spark framework - Core Spark, Spark Data Frames, Spark streaming - Should have a basic understanding of how data is organized in Hbase, Hive and Oracle - Knowledge of Bigdata Cluster and operations. - Experience with CI/CD build pipelines and toolchain - Git, BitBucket, TeamCity, Artifactory, Jira - Person should have worked in Agile/DevOps Environment - Good communication skills, Positive attitude - **Job Family Group**: Technology - **Job Family**: Applications Development - **Time Type**: Full time - Citi is an equal opportunity and affirmative action employer. Qualified applicants will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran. View the "**EEO is the Law**" poster. View the **EEO is the Law Supplement**. View the **EEO Policy Statement**. View the **Pay Transparency Posting
-
Spark + Scala Professional
7 days ago
Chennai, Noida, Pune, India Krazy Mantra HR Solutions Pvt. Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per yearWe are looking for a skilled professional with expertise in Spark and Scala to join our team. The ideal candidate will have 4 to 10 years of experience.Roles and ResponsibilityDesign, develop, and implement scalable data processing pipelines using Spark and Scala.Collaborate with cross-functional teams to identify and prioritize project requirements.Develop...
-
SCALA, SPARK Engineer
1 day ago
Pune, India Virtusa Full timeSCALA, SPARK Engineer - CREQ Description Role GDT WS SCALA, SPARK Engineer Exp 5+ Location Pune/Hyderabad/Bangalore Mandatory Skills Strong knowledge of SCALA along with Spark Unit Testing, CICD, Jenkins, GIT Airflow Primary Location Pune, Maharashtra, India Job Type Experienced Primary Skills Scala Years of Experience 5 Qualification Role GDT WS SCALA,...
-
GDT Scala Spark
1 day ago
Pune, India Virtusa Full timeGDT Scala Spark - CREQ Description Role GDT WS SCALA, SPARK Engineer Exp 5+ Location Pune/Hyderabad/Bangalore Mandatory Skills Strong knowledge of SCALA along with Spark Unit Testing, CICD, Jenkins, GIT Airflow Primary Location Pune, Maharashtra, India Job Type Experienced Primary Skills Scala Years of Experience 5 Qualification Role GDT WS SCALA, SPARK...
-
Big Data Engineer
2 weeks ago
Pune, India Leinex Consulting Full timeRole & responsibilities : - Evaluate domain, financial and technical feasibility of solution ideas with help of all key stakeholders- Design, develop, and maintain highly scalable data processing applications- Write efficient, reusable and well documented code- Deliver big data projects using Spark, Scala , Python, SQL- Maintain and tune existing Spark...
-
Scala/Spark Developer
2 weeks ago
Bengaluru, Chennai, Pune, India Photon Full time ₹ 10,00,000 - ₹ 25,00,000 per yearAbout The Role Develop, test, and deploy data processing applications using Apache Spark and Scala.Optimize and tune Spark applications for better performance on large-scale data sets.Work with the Cloudera Hadoop ecosystem (e.g., HDFS, Hive, Impala, HBase, Kafka) to build data pipelines and storage solutions.Collaborate with data scientists, business...
-
Pune, Maharashtra, India Citi Full time US$ 1,50,000 - US$ 2,00,000 per yearThis position is under ICG TTS Operations Technology (OpsTech) Group , to help the implementation of next generation Digital Automation Platform and Imaging Workflow Technologies. The Candidate is required to possess relevant experience in managing development teams in the distributed systems Eco-System and should be a strong team player.It is expected that...
-
Spark Scala Developer
18 hours ago
Delhi, Hyderabad, NCR, Pune, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 25,00,000 per yearRole - Spark / Scala Data EngineerExperience - 8 to 10 yrsLocation - Bangalore/Chennai/Hyderabad/Delhi/PuneMust Have - Big Data Hadoop - Hive and Spark/Scala solid experience - SQL advance knowledge - Been able to test changes and issues properly, replicating the code functionality into SQL - Worked with Code Repositories as GIT, Maven, ... - DevOps...
-
Pune, Maharashtra, India Citi Full time ₹ 20,00,000 - ₹ 25,00,000 per yearDiscover your future at CitiWorking at Citi is far more than just a job. A career with us means joining a team of more than 230,000 dedicated people from around the globe. At Citi, you'll have the opportunity to grow your career, give back to your community and make a real impact.Job OverviewThis position is under ICG TTS Operations Technology (OpsTech)...
-
Tcs data Streaming
2 weeks ago
Pashan, Pune, Maharashtra, India Response Informatics Full timeJOB DESCRIPTION: Spark/Scala/PySpark developer who knows how to fully exploit the potential of our Spark cluster. Should have ability to clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data. SKILLS: Pyspark Scala (with a focus on the functional programming paradigm) Apache Spark 2.x, 3.x -...
-
Bigdata Scala Developer
7 days ago
Chennai, Hyderabad, Pune, India IDESLABS PRIVATE LIMITED Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob Details:Skill: Scala,hadoop,java,Job type: contract to hireJob Description: -10+ years of software development experience building large scale distributed data processing systems/application, Data Engineering or large scale internet systems.Experience of at least 4 years in Developing/ Leading Big Data solution at enterprise scale with at least one end...