Hadoop Senior Data Engineer/ Seniorconsultant Specialist

2 weeks ago


Pune Maharashtra Bangalore Karnataka, India HSBC Full time

Job description Some careers shine brighter than others If you re looking for a career that will help you stand out join HSBC and fulfil your potential Whether you want a career that could take you to the top or simply take you in an exciting new direction HSBC offers opportunities support and rewards that will take you further HSBC is one of the largest banking and financial services organisations in the world with operations in 64 countries and territories We aim to be where the growth is enabling businesses to thrive and economies to prosper and ultimately helping people to fulfil their hopes and realise their ambitions We are currently seeking an experienced professional to join our team in the role of Senior Consultant Specialist In this role you will Data Pipelines Integration and Management Expertise in Scala-Spark Python-Spark development and should be able to Work with Agile application dev team to implement data strategies Design and implement scalable data architectures to support the bank s data needs Develop and maintain ETL Extract Transform Load processes Ensure the data infrastructure is reliable scalable and secure Oversee the integration of diverse data sources into a cohesive data platform Ensure data quality data governance and compliance with regulatory requirements Monitor and optimize data pipeline performance Troubleshoot and resolve data-related issues promptly Implement monitoring and alerting systems for data processes Troubleshoot and resolve technical issues optimizing system performance ensuring reliability Create and maintain technical documentation for new and existing system ensuring that information is accessible to the team Implementing and monitoring solutions that identify both system bottlenecks and production issues Requirements To be successful in this role you should meet the following requirements 5 years of experience in data engineering or related field and hands-on experience of building and maintenance of ETL Data pipelines Good experience in Designing and Developing Spark Applications using Scala or Python Good experience with database technologies SQL NoSQL data warehousing solutions and big data technologies Hadoop Spark Proficiency in programming languages such as Python Java or Scala Optimization and Performance Tuning of Spark Applications GIT Experience on creating merging and managing Repos Perform unit testing and performance testing Good understanding of ETL processes and data pipeline orchestration tools like Airflow Control-M Strong problem-solving skills and ability to work under pressure Excellent communication and interpersonal skills The successful candidate will also meet the following requirements Good to have Requirements Experience in the banking or financial services industry Familiarity with regulatory requirements related to data security and privacy in the banking sector Experience with cloud platforms Google Cloud and their data services Certifications in cloud platforms AWS Certified Data Analytics Google Professional Data Engineer etc You ll achieve more when you join HSBC www hsbc com careers HSBC is committed to building a culture where all employees are valued respected and opinions count We take pride in providing a workplace that fosters continuous professional development flexible working and opportunities to grow within an inclusive and diverse environment Personal data held by the Bank relating to employment applications will be used in accordance with our Privacy Statement which is available on our website Issued by - HSDI



  • Pune, Maharashtra - Bangalore, Karnataka, India HSBC Full time

    Job description Some careers shine brighter than others If you re looking for a career that will help you stand out join HSBC and fulfil your potential Whether you want a career that could take you to the top or simply take you in an exciting new direction HSBC offers opportunities support and rewards that will take you further HSBC is one of the largest...


  • Pune, Maharashtra, India Real Jobs Consulting Services Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per year

    Company DescriptionReal Jobs Consulting Services is a trusted placement provider based in Gurgaon, offering a wide range of HR and placement services. These include HR consultancy, manpower recruitment, domestic placement, and career consultancy services. The company is known for its team of expert consultants who bring strategic insights to help clients...


  • Pune, Maharashtra, India HSBC Full time

    Some careers shine brighter than others If you re looking for a career that will help you stand out join HSBC and fulfil your potential Whether you want a career that could take you to the top or simply take you in an exciting new direction HSBC offers opportunities support and rewards that will take you further HSBC is one of the largest banking and...


  • Pune, Maharashtra, India HSBC Full time

    Some careers shine brighter than others If you re looking for a career that will help you stand out join HSBC and fulfil your potential Whether you want a career that could take you to the top or simply take you in an exciting new direction HSBC offers opportunities support and rewards that will take you further HSBC is one of the largest banking and...


  • Pune, Maharashtra Bangalore, Karnataka, India HSBC Full time

    Job description Some careers shine brighter than others If you re looking for a career that will help you stand out join HSBC and fulfil your potential Whether you want a career that could take you to the top or simply take you in an exciting new direction HSBC offers opportunities support and rewards that will take you further HSBC is one of the largest...

  • Senior Data Architect

    2 weeks ago


    Pune, India Crazy Solutions Full time

    Senior Data Architect / Engineer Role :Senior Data Engineer/Architect Location: Chennai / Pune Company: Sunware Technologies Private Limited Position Overview: We are hiring an experienced Senior Data Engineer/Architect with 7-10 years of expertise in data modeling, big data tools, database management, and cryptography. The role involves designing scalable...


  • Pune, Maharashtra, India HSBC Full time

    Job description Some careers shine brighter than others If you re looking for a career that will help you stand out join HSBC and fulfil your potential Whether you want a career that could take you to the top or simply take you in an exciting new direction HSBC offers opportunities support and rewards that will take you further HSBC is one of the largest...


  • Pune, India Real Jobs Consulting Services Full time

    Company Description Real Jobs Consulting Services is a trusted placement provider based in Gurgaon, offering a wide range of HR and placement services. These include HR consultancy, manpower recruitment, domestic placement, and career consultancy services. The company is known for its team of expert consultants who bring strategic insights to help clients...


  • Pune, Maharashtra, India HSBC Full time

    Some careers shine brighter than others If you re looking for a career that will help you stand out join HSBC and fulfil your potential Whether you want a career that could take you to the top or simply take you in an exciting new direction HSBC offers opportunities support and rewards that will take you further HSBC is one of the largest banking and...


  • bangalore, India Information Tech Consultants Full time

    Job Title: Senior Big Data DeveloperLocation: UK (Relocation Required - Sponsorship will be provided)Experience: 8-14 yearsEducation: Bachelors in Science (IT/Computer Science/Engineer)Employment Type: Full-TimeUK based candidates only.Role Overview:We are seeking an experienced Scala /Hadoop/ Big Data Developer. The role will focus on building and enhancing...