Spark Scala Applications Development Technology Lead Analyst

2 days ago

Pune, Maharashtra, India Citi Full time US$ 1,50,000 - US$ 2,00,000 per year

This position is under ICG TTS Operations Technology (OpsTech) Group , to help the implementation of next generation Digital Automation Platform and Imaging Workflow Technologies. The Candidate is required to possess relevant experience in managing development teams in the distributed systems Eco-System and should be a strong team player.

It is expected that the candidate will have superior technical knowledge of current programming languages, technologies and other leading edge development tools.The overall objective of this role is to contribute to applications, systems analysis, and programming activities.

Job Description: Lead Spark Scala Engineer


•  Hands on knowledge of SPARK, Py-Spark, scala, Java etc.

•  Hands on knowledge of RDBMS like MS-SQL/Oracle 

•  Knowledge of CI/CD tools like LightSpeed, uDeploy etc

 Responsibilities

Development & Optimization: Develop, test, and deploy production-grade Spark applications in Scala, ensuring optimal performance, scalability, and resource utilization.
Technical Leadership: Provide technical leadership and guidance to a team of data engineers, fostering a culture of technical excellence, collaboration, and continuous improvement.
Code Review & Best Practices: Conduct rigorous code reviews, establish coding standards, and enforce best practices for Spark Scala development, data governance, and data quality.
Performance Tuning: Identify and resolve performance bottlenecks in Spark applications through advanced tuning techniques (e.g., shuffling, partitioning, memory management, caching).
Deep Spark Expertise:
Profound understanding of Spark's architecture (RDDs, DataFrames, Datasets), execution model, and optimization techniques.
Extensive experience with Spark SQL, Spark Streaming, and Spark Core.
Proven ability to design and build complex data pipelines (ETL/ELT).
Scala Proficiency: Expert-level proficiency in Scala programming, including functional programming paradigms and object-oriented design.
Big Data Ecosystem: Strong hands-on experience with the broader Hadoop ecosystem (HDFS, YARN, Hive, Kafka, etc.) and related big data technologies.
Database Knowledge: Solid understanding of relational databases (SQL, schema design) and NoSQL databases.
Communication: Excellent communication, interpersonal, and leadership skills, with the ability to articulate complex technical concepts to diverse audiences.
Problem-Solving: Exceptional analytical and problem-solving abilities, with a meticulous attention to detail.

Education:

Bachelor's degree/University degree or equivalent experience

Job Family Group:

Technology

Job Family:

Applications Development

Time Type:

Full time

Most Relevant Skills

Please see the requirements listed above.

Other Relevant Skills

For complementary skills, please see above and/or contact the recruiter.

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.

View Citi's EEO Policy Statement and the Know Your Rights poster.

  • Spark Developer

    6 days ago

    Pune, Maharashtra, India Infosys Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Spark DeveloperSpark, Scala, Bigdata • Ability to develop value-creating strategies and models that enable clients to innovate, drive growth and increase their business profitability • Good knowledge on software configuration management systems • Awareness of latest technologies and Industry trends • Logical thinking and problem-solving skills along...

  • Spark Developer

    3 hours ago

    Pune, Maharashtra, India Infosys Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Educational RequirementsBachelor of EngineeringService LineData & Analytics UnitResponsibilitiesTeam Management: Lead and manage a team of technical professionals Data Engineer and Application Developers, ensuring effective collaboration and productivity.Client Interaction: Serve as the primary point of contact for clients, understanding their needs and...

  • Scala Developer

    4 days ago

    Pune, Maharashtra, India ID4 Consultancy Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    JD: Experience and Expertise in any of the following Languages at least 1 of them : Scala, Python, Java Experience and expertise in SPARK Architecture Experience in the range of 5-10 yrs plus Good Problem Solving and Analytical Skills Ability to Comprehend the Business requirement and translate to the Technical requirements Good communication...

  • Senior Spark Developer

    1 week ago

    Pune, Maharashtra, India Consulting Pandits Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Spark Rockstar Wanted Imagine a world where big data is not just a buzzword, but a playground where you get to build innovative solutions that make a real impact. We're on the hunt for a Senior Big Data Engineer who's passionate about Spark and has the skills to prove it. If you're a Spark aficionado with a knack for designing and developing scalable data...

  • Scala Developer

    1 day ago

    Pune, Maharashtra, India, Maharashtra Tata Consultancy Services Full time

    Location: Pune & Powai Must have:Minimum 5+ years of experience in development of Spark ScalaExperience in designing and development of solutions for Big Data using Hadoop ecosystem technologies such as with Hadoop Bigdata components like HDFS, Spark, Hive Parquet File format, YARN, MapReduce, SqoopGood Experience in writing and optimizing Spark Jobs, Spark...

  • scala data engineer

    2 days ago

    Pune, Maharashtra, India RM Technologies Full time ₹ 2,50,000 - ₹ 16,50,000 per year

    Exciting Opportunity: Data Engineer SCALA Position Available at a Leading MNC Hiring: Data Engineer (Scala) – High Priority Experience: 8+ years only Location: Hybrid (3 days/week from office) Client: MNC Budget: 25-33 LPA Availability: Immediate Joiners only(max 30 days)We are looking for a skilled Data Engineer (Scala) to design, build, and optimize...

  • Bigdata/Scala Lead

    1 week ago

    Pune, Maharashtra, India Citi Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    The Applications Development Intermediate Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming...

  • Senior Scala Developer

    4 days ago

    Pune, Maharashtra, India Luxoft Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Project description Are you an enthusiastic technology professional? Are you excited about seeking an enriching career; working for a large Tier One Bank? We are seeking for Scala engineer to join our development team within the bank for an exciting opportunity, building on top of existing technology to be implemented across other APAC regions. You will...

  • Fullstack Scala Developer

    2 days ago

    Pune, Maharashtra, India Luxoft Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Project descriptionAre you an enthusiastic technology professional? Are you excited about seeking an enriching career; working for a large Tier One Bank? We are seeking for Scala engineer to join our development team within the bank for an exciting opportunity, building on top of existing technology to be implemented across other APAC regions. You will work...

  • Senior Big Data Developer

    2 days ago

    Pune, Maharashtra, India Citi Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    The Applications Development Senior Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming...