AVP - Data engineer Spark & Scala -Pune

2 weeks ago

Pune, India Citi Full time US$ 1,50,000 - US$ 2,00,000 per year
About the job:

At Citi we're not just building technology, we're building the future of banking. Encompassing a broad range of specialties, roles, and cultures, our teams are creating innovations used across the globe. Citi is constantly growing and progressing through our technology, with laser focused on evolving the ways of doing things. As one of the world's most global banks we're changing how the world does business.

Shape your Career with Citi

We're currently looking for a high caliber professional to join our team as AVP- Data engineer based in pune, India. Being part of our team means that we'll provide you with the resources to meet your unique needs, empower you to make healthy decision and manage your financial well-being to help plan for your future. For instance:
 

  • We provide programs and services for your physical and mental well-being including access to telehealth options, health advocates, confidential counseling and more. Coverage varies by country.
  • We empower our employees to manage their financial well-being and help them plan for the future.
  • We provide access to an array of learning and development resources to help broaden and deepen your skills and knowledge as your career progresses.
     
In this role, you're expected to:

Responsibilities:

Knowledge/Experience:

Responsibilities:

Data Pipeline Development, Design & Automation:

  • Design and implement efficient database structures to ensure optimal performance and support analytics.
  • Design, implement, and optimize secure data pipelines to ingest, process, and store large volumes of structured and unstructured data from diverse sources, including vulnerability scans, security tools, and assessments.
  • Work closely with stakeholders to provide clean, structured datasets that enable advanced analytics and insights into cybersecurity risks, trends, and remediation activities.

Technical Competencies:

  • 7+ years of Hands-on experience with Scala & Hands-on experience with Spark.
  • 10 + years of experience on designing and developing Data Pipelines for Data Ingestion or Transformation using Spark with Scala.
  • Good experience in Big Data technologies (HDFS, Hive. Apache Spark, Spark-SQL, Spark Streaming, Spark jobs optimization & Kafka).
  • Good knowledge in Exposure to various file formats ( JSON , AVRO, Parquet..).
  • Knowledge of agile(scrum) development methodology is a plus  .
  • Strong development/automation skills .
  • Right attitude to participate and contribute through all phases of Development Lifecycle.
  • Secondary Skillset: No SQL, Starburst, Python
  • Optional: Java – Spring, Kubernetes, Docker

Competencies (Soft skills )

  • Strong communications skills
  • Candidate should be responsible for reporting to both business and technology senior management
  • Need to work with stakeholders and keep them updated on developments, estimation, delivery and issues.

Job Family Group:

Technology

Job Family:

Applications Development

Time Type:

Full time

Most Relevant Skills

Please see the requirements listed above.

Other Relevant Skills

For complementary skills, please see above and/or contact the recruiter.

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.

View Citi's EEO Policy Statement and the Know Your Rights poster.

  • Spark/scala

    4 days ago

    Pune, India Codvo.ai Full time

    **Spark /Scala** **Company Overview**: At Codvo, software and people transformations go hand-in-hand. We are a global empathy-led technology services company. Product innovation and mature software engineering are part of our core DNA. Respect, Fairness, Growth, Agility, and Inclusiveness are the core values that we aspire to live by each day. - We continue...

  • Scala Spark Developer

    16 hours ago

    Chennai, Pune, India Cloudxtreme Full time US$ 90,000 - US$ 1,20,000 per year

    Role : Scala Spark DeveloperLocation : Pune/ChennaiCompany : MNCRequired Skills & Qualifications:Minimum 5 years of professional experience in Data Engineering, with a strong focus on big data technologies.Proficiency in Scala for developing big data applications and transformations, especially with Apache Spark.Expert-level proficiency in SQL; ability to...

  • Databricks Scala/Spark Data Engineer

    6 days ago

    Pune, Mumbai, Bengaluru / Bangalore, India beBeeDataEngineer Full time ₹ 80,000 - ₹ 2,00,000

    Job Title: Databricks Scala/Spark DeveloperJob Description: As a Databricks Scala/Spark developer, you will be responsible for designing and implementing scalable data processing systems using Spark and Scala. The ideal candidate will have strong programming skills and experience with complex objects and datasets.Required Skills:Strong knowledge of Spark and...

  • Spark-Scala Position

    17 hours ago

    Bengaluru, Chennai, Pune, India Orcapod Consulting Services Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Position: Spark-ScalaWork location : Bangalore , Chennai, Hyderabad, Pune, Chandigarh.Type: C2H (Convert into Full-Time Employment (FTE) within 90 days)Experience: 8-10 yrs.Skillsets:Mandatory skills - Spark & ScalaDesired skills - Spark Streaming, Hadoop, Hive, SQL, Sqoop, ImpalaJoining: Immediate joiner or 15 to 30 days

  • Data Streaming

    5 days ago

    Pune, India ACE Talent Consulting Full time

    Job Description: Spark/Scala/PySpark developer who knows how to fully exploit the potential of our Spark cluster. Should have ability to clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data. **Responsibilities**: Create Scala/Spark/Pyspark jobs for data transformation and aggregation Produce...

  • Data Streaming

    5 days ago

    Pune, India ACE Talent Consulting Full time

    ob Description: Spark/Scala/PySpark developer who knows how to fully exploit the potential of our Spark cluster. Should have ability to clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data. **Responsibilities**: Create Scala/Spark/Pyspark jobs for data transformation and aggregation Produce...

  • BigData-Hadoop/Scala Engineer, AVP

    5 days ago

    Pune, Maharashtra, India Deutsche Bank Full time

    Job DescriptionBigData-Hadoop/Scala Engineer, AVPPosition OverviewJob Title : BigData-Hadoop/Scala Engineer, AVPLocation : Pune, IndiaRole DescriptionA Senior Engineer is responsible for designing and developing entire engineering solutions to accomplish business goals. Key responsibilities of this role include ensuring that solutions are well architected,...

  • Bigdata -Pyspark /Scala Spark- Data Engineer

    18 hours ago

    Pune, Maharashtra, India LTIMindtree Full time US$ 1,50,000 - US$ 2,00,000 per year

    30 days to immediate3+ expJob description:Myrefers Big Data PySpark Scala Spark Java Sparkp3PuneWe are seeking a highly skilled and experienced Big Data Engineer to join our data engineering team The ideal candidate will have a strong background in Hadoop ecosystem tools Apache Spark including SparkSQL and Python programming You will be responsible for...

  • Spark/Scala Developer

    15 hours ago

    Pune, Maharashtra, India Cyanous Software Private Limited Full time US$ 1,50,000 - US$ 2,00,000 per year

    Detailed JD (Roles And Responsibilities)At least 8+ years of experience and strong knowledge in Scala programming language.Able to write clean, maintainable and efficient Scala code following best practices.Good knowledge on the fundamental Data Structures and their usageAt least 8+ years of experience in designing and developing large scale, distributed...

  • Spark-Scala Professional

    19 hours ago

    Pune, Maharashtra, India IDESLABS PRIVATE LIMITED Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    skills Spark-Scala Experience 6+ Years Location PAN INDIA Job type Contract to Hire Work Model HybridHands on experience of 4-5 years on Spark-Scala combinationAwareness of Hive DBAwareness and experience of working on Hadoop platformGood SQL knowledgeNP