Java/scala +spark Developer-3

6 days ago


Pune, India Citi Full time

**Responsibilities**: - Bachelor’s degree (in Computer Science, Information Technology). - Must have good programming skills and should be aware of OOPS concept, design principles, data structures. - Good experience in Big Data technologies (A MUST) - HDFS. - Good knowledge of databases: Hive, Hbase. - Good knowledge in Apache Spark, Spark-SQL, UDF, Sqoop. - Knowledge in Kafka. - Advantage: Scala, Neo4j, Gemfire. - Exposure to various file formats - JSON, AVRO, CSV, XML - Flat Text Files - Exposure in Relational Database - Oracle - Exposure to ETL Batch Scheduling & Automation - Autosys - Right attitude to participate and contribute through all phases of Development Lifecycle. - Good team player. - Right sense of ownership. - Eager to learn. Experience with developing software that processes, persists and distributes data via relational and non-relational technologies: - Strong Scala/Java Skills - Experience in design and development of batch/real time Spark processing pipelines. - Knowledge of Spark framework - Core Spark, Spark Data Frames, Spark streaming - Should have a basic understanding of how data is organized in Hbase, Hive and Oracle - Knowledge of Bigdata Cluster and operations. - Experience with CI/CD build pipelines and toolchain - Git, BitBucket, TeamCity, Artifactory, Jira - Person should have worked in Agile/DevOps Environment - Good communication skills, Positive attitude - **Job Family Group**: Technology - **Job Family**: Applications Development - **Time Type**: Full time - Citi is an equal opportunity and affirmative action employer. Qualified applicants will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran. View the "**EEO is the Law**" poster. View the **EEO is the Law Supplement**. View the **EEO Policy Statement**. View the **Pay Transparency Posting



  • Pune, India Cyanous Software Private Limited Full time

    Detailed JD (Roles and Responsibilities) :- At least 8+ years of experience and strong knowledge in Scala programming language.- Able to write clean, maintainable and efficient Scala code following best practices.- Good knowledge on the fundamental Data Structures and their usage - At least 8+ years of experience in designing and developing large scale,...

  • SCALA, SPARK Engineer

    2 weeks ago


    Pune, India Virtusa Full time

    SCALA, SPARK Engineer - CREQ Description Role GDT WS SCALA, SPARK Engineer Exp 5+ Location Pune/Hyderabad/Bangalore Mandatory Skills Strong knowledge of SCALA along with Spark Unit Testing, CICD, Jenkins, GIT Airflow Primary Location Pune, Maharashtra, India Job Type Experienced Primary Skills Scala Years of Experience 5 Qualification Role GDT WS...

  • GDT Scala Spark

    2 weeks ago


    Pune, India Virtusa Full time

    GDT Scala Spark - CREQ Description Role GDT WS SCALA, SPARK Engineer Exp 5+ Location Pune/Hyderabad/Bangalore Mandatory Skills Strong knowledge of SCALA along with Spark Unit Testing, CICD, Jenkins, GIT Airflow Primary Location Pune, Maharashtra, India Job Type Experienced Primary Skills Scala Years of Experience 5 Qualification Role GDT WS SCALA,...


  • Bengaluru, Chennai, Pune, India Photon Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    About The Role   Develop, test, and deploy data processing applications using Apache Spark and Scala.Optimize and tune Spark applications for better performance on large-scale data sets.Work with the Cloudera Hadoop ecosystem (e.g., HDFS, Hive, Impala, HBase, Kafka) to build data pipelines and storage solutions.Collaborate with data scientists, business...

  • Big Data Engineer

    3 weeks ago


    Pune, India Leinex Consulting Full time

    Role & responsibilities : - Evaluate domain, financial and technical feasibility of solution ideas with help of all key stakeholders- Design, develop, and maintain highly scalable data processing applications- Write efficient, reusable and well documented code- Deliver big data projects using Spark, Scala , Python, SQL- Maintain and tune existing Spark...


  • Pune, India IDESLABS PRIVATE LIMITED Full time

    skills Spark-Scala Experience 6+ Years Location PAN INDIA Job type Contract to Hire Work Model Hybrid Hands on experience of 4-5 years on Spark-Scala combination Awareness of Hive DB Awareness and experience of working on Hadoop platform Good SQL knowledge NP


  • Pune, Maharashtra, India Citi Full time US$ 1,50,000 - US$ 2,00,000 per year

    This position is under ICG TTS Operations Technology (OpsTech) Group , to help the implementation of next generation Digital Automation Platform and Imaging Workflow Technologies. The Candidate is required to possess relevant experience in managing development teams in the distributed systems Eco-System and should be a strong team player.It is expected that...


  • Pune, Maharashtra, India Consulting Pandits Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Spark Rockstar Wanted Imagine a world where big data is not just a buzzword, but a playground where you get to build innovative solutions that make a real impact. We're on the hunt for a Senior Big Data Engineer who's passionate about Spark and has the skills to prove it. If you're a Spark aficionado with a knack for designing and developing scalable data...

  • Spark Scala Developer

    2 weeks ago


    Delhi, Hyderabad, NCR, Pune, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role - Spark / Scala Data EngineerExperience - 8 to 10 yrsLocation - Bangalore/Chennai/Hyderabad/Delhi/PuneMust Have - Big Data Hadoop - Hive and Spark/Scala solid experience - SQL advance knowledge - Been able to test changes and issues properly, replicating the code functionality into SQL - Worked with Code Repositories as GIT, Maven, ... - DevOps...

  • Scala Developer

    1 day ago


    Pune, India Tata Consultancy Services Full time

    Location: Pune & Powai Must have: 1. Minimum 5+ years of experience in development of Spark Scala 2. Experience in designing and development of solutions for Big Data using Hadoop ecosystem technologies such as with Hadoop Bigdata components like HDFS, Spark, Hive Parquet File format, YARN, MapReduce, Sqoop 3. Good Experience in writing and optimizing Spark...