Hadoop Data Engineer

Some careers shine brighter than others If you re looking for a career that will help you stand out join HSBC and fulfil your potential Whether you want a career that could take you to the top or simply take you in an exciting new direction HSBC offers opportunities support and rewards that will take you further HSBC is one of the largest banking and financial services organisations in the world with operations in 64 countries and territories We aim to be where the growth is enabling businesses to thrive and economies to prosper and ultimately helping people to fulfil their hopes and realise their ambitions We are currently seeking an experienced professional to join our team in the role of Senior Consultant Specialist In this role will be responsible for the below The Senior Data Engineer will be responsible for designing building and managing the data infrastructure and data pipeline processes for the bank This role involves leading a team of data engineers working closely with data scientists analysts and IT professionals to ensure data is accessible reliable and secure The ideal candidate will have a strong background in data engineering excellent leadership skills and a thorough understanding of the banking industry s data requirements Leadership and Team Management Lead mentor and develop a team of data engineers Establish best practices for data engineering and ensure team adherence Coordinate with other IT teams business units and stakeholders Data Pipelines Integration and Management Design and implement scalable data architectures to support the bank s data needs Develop and maintain ETL Extract Transform Load processes Ensure the data infrastructure is reliable scalable and secure Oversee the integration of diverse data sources into a cohesive data platform Ensure data quality data governance and compliance with regulatory requirements Develop and enforce data security policies and procedures Monitor and optimize data pipeline performance Troubleshoot and resolve data-related issues promptly Implement monitoring and alerting systems for data processes To be successful in this role you should meet the following requirements Must have Requirements 8 years of experience in data engineering or related field Strong experience with database technologies SQL NoSQL data warehousing solutions and big data technologies Hadoop Spark Proficiency in programming languages such as Python Java or Scala Experience with cloud platforms AWS Azure Google Cloud and their data services Deep understanding of ETL processes and data pipeline orchestration tools Airflow Apache NiFi Knowledge of data modeling data warehousing concepts and data integration techniques Strong problem-solving skills and ability to work under pressure Excellent communication and interpersonal skills Experience in the banking or financial services industry Familiarity with regulatory requirements related to data security and privacy in the banking sector Certifications in cloud platforms AWS Certified Data Analytics Google Professional Data Engineer etc Experience with machine learning and data science frameworks Location Pune and Bangalore You ll achieve more when you join HSBC HSBC is committed to building a culture where all employees are valued respected and opinions count We take pride in providing a workplace that fosters continuous professional development flexible working and opportunities to grow within an inclusive and diverse environment Personal data held by the Bank relating to employment applications will be used in accordance with our Privacy Statement which is available on our website Issued by - HSBC Software Development India