Hadoop Data Engineer/Senior Software Engineer

1 week ago

Pune, Maharashtra, India HSBC Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Job description

Some careers shine brighter than others.

If you're looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.

HSBC is one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions.

We are currently seeking an experienced professional to join our team in the role of Senior Software Engineer

In this role you will be

  • Expertise in Scala-Spark/Python-Spark development and should be able to Work with Agile application dev team to implement data strategies.
  • Design and implement scalable data architectures to support the bank's data needs.
  • Develop and maintain ETL (Extract, Transform, Load) processes.
  • Ensure the data infrastructure is reliable, scalable, and secure.
  • Oversee the integration of diverse data sources into a cohesive data platform.
  • Ensure data quality, data governance, and compliance with regulatory requirements.
  • Monitor and optimize data pipeline performance.
  • Troubleshoot and resolve data-related issues promptly.
  • Implement monitoring and alerting systems for data processes.
  • Troubleshoot and resolve technical issues optimizing system performance ensuring reliability.
  • Create and maintain technical documentation for new and existing system ensuring that information is accessible to the team.
  • Implementing and monitoring solutions that identify both system bottlenecks and production issues.

Requirements

To be successful in this role, you should meet the following requirements:

  • Experience in data engineering or related field and hands-on experience of building and maintenance of ETL Data pipelines
  • Good experience in Designing and Developing Spark Applications using Scala or Python.
  • Good experience with database technologies (SQL, NoSQL), data warehousing solutions, and big data technologies (Hadoop, Spark)
  • Proficiency in programming languages such as Python, Java, or Scala.
  • Optimization and Performance Tuning of Spark Applications
  • GIT Experience on creating, merging and managing Repos.
  • Perform unit testing and performance testing.
  • Good understanding of ETL processes and data pipeline orchestration tools like Airflow, Control-M.
  • Strong problem-solving skills and ability to work under pressure.
  • Excellent communication and interpersonal skills.

You'll achieve more when you join HSBC.

HSBC is committed to building a culture where all employees are valued, respected and opinions count. We take pride in providing a workplace that fosters continuous professional development, flexible working and opportunities to grow within an inclusive and diverse environment. Personal data held by the Bank relating to employment applications will be used in accordance with our Privacy Statement, which is available on our website.

Issued by – HSDI

  • Hadoop data Engineer/ Software Engineer

    2 weeks ago

    Pune, Maharashtra, India HSBC Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job descriptionome careers shine brighter than others.If you're looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.HSBC is one of the largest...

  • Senior Software Engineer-3

    22 hours ago

    Pune, Maharashtra, India Mastercard Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Title and SummarySenior Software Engineer-3 Senior Software Development Engineer (DW)Job Posting TitleOverviewMastercard is looking for a Senior Software Engineer to join the Account Level Management(ALM) team in our Pune office thats focused on building ALM Services with Data warehouse skills. The Mastercard Account Level Management platform empowers...

  • Hadoop Senior Reliability Engineer

    7 days ago

    Pune, Maharashtra, India Citi Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    The Engineering Lead Analyst is a senior level position responsible for leading a variety of engineering activities including the design, acquisition and deployment of hardware, software and network infrastructure in coordination with the Technology team. The overall objective of this role is to lead efforts to ensure quality standards are being met within...

  • BigData-Hadoop/Scala Engineer, AVP

    1 week ago

    Pune, Maharashtra, India Deutsche Bank Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    BigData-Hadoop/Scala Engineer, AVPJob ID: R0388873Full/Part-Time: Full-timeRegular/Temporary: RegularListed: Location: PunePosition OverviewJob Title : BigData-Hadoop/Scala Engineer, AVPLocation : Pune, IndiaRole DescriptionA Senior Engineer is responsible for designing and developing entire engineering solutions to accomplish business goals. Key...

  • BigData-Hadoop/Scala Engineer. AS

    2 weeks ago

    Pune, Maharashtra, India Deutsche Bank Full time ₹ 5,00,000 - ₹ 12,00,000 per year

    BigData-Hadoop/Scala Engineer. ASJob ID: R0388874Full/Part-Time: Full-timeRegular/Temporary: RegularListed: Location: PunePosition OverviewJob Title : BigData-Hadoop/Scala EngineerLocation : Pune, IndiaRole DescriptionAn Associate Engineer is responsible for developing and delivering elements of engineering solutions to accomplish business goals. Awareness...

  • Senior Data Engineer

    3 days ago

    Pune, Maharashtra, India Populace World Solutions Full time ₹ 8,00,000 - ₹ 20,00,000 per year

    Description : Location : Pune (Kharadi), India Experience : 8 YearsAbout the Role : We are seeking a highly skilled and experienced Senior Data Engineer to join our team in Pune. This role is crucial for designing, building, and optimizing our large-scale data processing systems and platforms. As a senior member of the team, you will apply your...

  • Senior Software Engineer

    3 days ago

    Pune, Maharashtra, India PubMatic Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    About The RolePubMatic is seeking Data Analytics focused Senior Software Engineers with expertise in building and optimizing AI agents, including strong skills in Hadoop, Spark, Scala, Kafka, Spark Streaming, and cloud-based solutions, with proficiency in programming languages such as Scala and Python. You will be responsible for developing advanced AI...

  • GCP Data Engineer/Senior Software Engineer

    2 weeks ago

    Pune, Maharashtra, India HSBC Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job descriptionSome careers shine brighter than others.If you're looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.HSBC is one of the largest...

  • Senior Data Engineer( DWH)

    2 hours ago

    Pune, Maharashtra, India, Maharashtra Mastercard Full time

    Title and SummarySenior Data EngineerJob Description SummarySenior Data Engineer (DW)Mastercard is a global technology company in the payments industry. Our mission is to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart, and accessible. Using secure data and networks, partnerships...

  • Senior Software Engineer

    7 days ago

    Pune, Maharashtra, India Crest Data Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    We are looking for a strong ReactJS Lead Engineers to join our engineering team in Ahmedabad. The primary responsibility will be to lead the design and develop Enterprise Software for our Global Fortune 500 clients in Data Center and Big Data segments.Location: PUNE / AHMEDABAD ( WFO Only)Key ResponsibilitiesResponsible for providing expertise in software...