Java/scala +spark Developer-3

1 week ago


Pune, India Citi Full time

**Responsibilities**: - Bachelor’s degree (in Computer Science, Information Technology). - Must have good programming skills and should be aware of OOPS concept, design principles, data structures. - Good experience in Big Data technologies (A MUST) - HDFS. - Good knowledge of databases: Hive, Hbase. - Good knowledge in Apache Spark, Spark-SQL, UDF, Sqoop. - Knowledge in Kafka. - Advantage: Scala, Neo4j, Gemfire. - Exposure to various file formats - JSON, AVRO, CSV, XML - Flat Text Files - Exposure in Relational Database - Oracle - Exposure to ETL Batch Scheduling & Automation - Autosys - Right attitude to participate and contribute through all phases of Development Lifecycle. - Good team player. - Right sense of ownership. - Eager to learn. Experience with developing software that processes, persists and distributes data via relational and non-relational technologies: - Strong Scala/Java Skills - Experience in design and development of batch/real time Spark processing pipelines. - Knowledge of Spark framework - Core Spark, Spark Data Frames, Spark streaming - Should have a basic understanding of how data is organized in Hbase, Hive and Oracle - Knowledge of Bigdata Cluster and operations. - Experience with CI/CD build pipelines and toolchain - Git, BitBucket, TeamCity, Artifactory, Jira - Person should have worked in Agile/DevOps Environment - Good communication skills, Positive attitude - **Job Family Group**: Technology - **Job Family**: Applications Development - **Time Type**: Full time - Citi is an equal opportunity and affirmative action employer. Qualified applicants will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran. View the "**EEO is the Law**" poster. View the **EEO is the Law Supplement**. View the **EEO Policy Statement**. View the **Pay Transparency Posting



  • Chennai, Noida, Pune, India Krazy Mantra HR Solutions Pvt. Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are looking for a skilled professional with expertise in Spark and Scala to join our team. The ideal candidate will have 4 to 10 years of experience.Roles and ResponsibilityDesign, develop, and implement scalable data processing pipelines using Spark and Scala.Collaborate with cross-functional teams to identify and prioritize project requirements.Develop...


  • Pune, India Virtusa Full time

    SCALA, SPARK Engineer - CREQ Description Role GDT WS SCALA, SPARK Engineer Exp 5+ Location Pune/Hyderabad/Bangalore Mandatory Skills Strong knowledge of SCALA along with Spark Unit Testing, CICD, Jenkins, GIT Airflow Primary Location Pune, Maharashtra, India Job Type Experienced Primary Skills Scala Years of Experience 5 Qualification Role GDT WS SCALA,...

  • GDT Scala Spark

    1 day ago


    Pune, India Virtusa Full time

    GDT Scala Spark - CREQ Description Role GDT WS SCALA, SPARK Engineer Exp 5+ Location Pune/Hyderabad/Bangalore Mandatory Skills Strong knowledge of SCALA along with Spark Unit Testing, CICD, Jenkins, GIT Airflow Primary Location Pune, Maharashtra, India Job Type Experienced Primary Skills Scala Years of Experience 5 Qualification Role GDT WS SCALA, SPARK...

  • Big Data Engineer

    2 weeks ago


    Pune, India Leinex Consulting Full time

    Role & responsibilities : - Evaluate domain, financial and technical feasibility of solution ideas with help of all key stakeholders- Design, develop, and maintain highly scalable data processing applications- Write efficient, reusable and well documented code- Deliver big data projects using Spark, Scala , Python, SQL- Maintain and tune existing Spark...

  • Scala/Spark Developer

    2 weeks ago


    Bengaluru, Chennai, Pune, India Photon Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    About The Role   Develop, test, and deploy data processing applications using Apache Spark and Scala.Optimize and tune Spark applications for better performance on large-scale data sets.Work with the Cloudera Hadoop ecosystem (e.g., HDFS, Hive, Impala, HBase, Kafka) to build data pipelines and storage solutions.Collaborate with data scientists, business...


  • Pune, Maharashtra, India Citi Full time US$ 1,50,000 - US$ 2,00,000 per year

    This position is under ICG TTS Operations Technology (OpsTech) Group , to help the implementation of next generation Digital Automation Platform and Imaging Workflow Technologies. The Candidate is required to possess relevant experience in managing development teams in the distributed systems Eco-System and should be a strong team player.It is expected that...

  • Spark Scala Developer

    18 hours ago


    Delhi, Hyderabad, NCR, Pune, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role - Spark / Scala Data EngineerExperience - 8 to 10 yrsLocation - Bangalore/Chennai/Hyderabad/Delhi/PuneMust Have - Big Data Hadoop - Hive and Spark/Scala solid experience - SQL advance knowledge - Been able to test changes and issues properly, replicating the code functionality into SQL - Worked with Code Repositories as GIT, Maven, ... - DevOps...


  • Pune, Maharashtra, India Citi Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Discover your future at CitiWorking at Citi is far more than just a job. A career with us means joining a team of more than 230,000 dedicated people from around the globe. At Citi, you'll have the opportunity to grow your career, give back to your community and make a real impact.Job OverviewThis position is under ICG TTS Operations Technology (OpsTech)...

  • Tcs data Streaming

    2 weeks ago


    Pashan, Pune, Maharashtra, India Response Informatics Full time

    JOB DESCRIPTION: Spark/Scala/PySpark developer who knows how to fully exploit the potential of our Spark cluster. Should have ability to clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data. SKILLS: Pyspark Scala (with a focus on the functional programming paradigm) Apache Spark 2.x, 3.x -...


  • Chennai, Hyderabad, Pune, India IDESLABS PRIVATE LIMITED Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Details:Skill: Scala,hadoop,java,Job type: contract to hireJob Description: -10+ years of software development experience building large scale distributed data processing systems/application, Data Engineering or large scale internet systems.Experience of at least 4 years in Developing/ Leading Big Data solution at enterprise scale with at least one end...