SQL BigQuery

Some careers shine brighter than others.

If you're looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.

HSBC is one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions.

We are currently seeking an experienced professional to join our team in the role of Consultant Specialist 

Role Overview:

We are seeking a highly experienced Senior Data Engineer with over 10 years of expertise in designing, building, and managing scalable data solutions. The ideal candidate will have extensive hands-on experience with Google Cloud Platform (GCP) services, particularly BigQuery, and a strong background in data pipelines, ETL/ELT processes, and data architecture. This role requires a strategic thinker who can lead complex data engineering projects, mentor junior team members, and collaborate with cross-functional teams to deliver high-quality data solutions.

Key Responsibilities:

• Design, develop, and maintain scalable and efficient data pipelines and ETL/ELT workflows using GCP services.
• Architect and implement data warehouse solutions using BigQuery, ensuring optimal performance and cost efficiency.
• Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver actionable insights.
• Optimize and manage large-scale datasets, ensuring data quality, integrity, and security.
• Develop and enforce best practices for data governance, data modeling, and data lifecycle management.
• Implement streaming data solutions using tools like Dataflow, Pub/Sub, and Apache Beam.
• Monitor and troubleshoot data pipelines, ensuring high availability and reliability.
• Lead the migration of on-premise data systems to GCP, ensuring seamless integration and minimal downtime.
• Mentor and guide junior engineers, fostering a culture of continuous learning and innovation.
• Stay updated with the latest advancements in GCP and data engineering technologies, and recommend improvements to existing systems.

Required Skills and Qualifications:

• 10+ years of experience in data engineering, with a focus on cloud-based solutions.
• Expertise in GCP services, including but not limited to:
  • BigQuery
  • Dataflow
  • Pub/Sub
  • Cloud Storage
  • Cloud Composer (Airflow)
  • Cloud Functions
• Strong proficiency in SQL and experience with BigQuery SQL for complex queries and performance optimization.
• Hands-on experience with Python or Java for building data pipelines and automation.
• Deep understanding of data modeling, data warehousing, and schema design.
• Experience with streaming data processing and tools like Apache Beam or Kafka.
• Familiarity with CI/CD pipelines and version control systems like Git.
• Strong knowledge of data security and compliance standards (e.g., GDPR, HIPAA).
• Proven experience in migrating on-premise data systems to GCP.
• Excellent problem-solving skills and the ability to work in a fast-paced, dynamic environment.
• Strong communication and collaboration skills, with the ability to work effectively with both technical and non-technical stakeholders.

Preferred Qualifications:

• GCP certifications such as Professional Data Engineer or Professional Cloud Architect.
• Experience with machine learning workflows and integration with tools like Vertex AI.
• Familiarity with other cloud platforms (AWS, Azure) and hybrid cloud environments.
• Knowledge of Terraform or Infrastructure as Code (IaC) for managing GCP resources.
• Experience with data visualization tools like Looker, Tableau, or Power BI.

What We Offer:

• Opportunity to work on cutting-edge data engineering projects with a focus on GCP.
• Competitive salary and benefits package.
• A collaborative and innovative work environment.
• Opportunities for professional growth and certifications.

You'll achieve more when you join HSBC.

HSBC is committed to building a culture where all employees are valued, respected and opinions count. We take pride in providing a workplace that fosters continuous professional development, flexible working and opportunities to grow within an inclusive and diverse environment. Personal data held by the Bank relating to employment applications will be used in accordance with our Privacy Statement, which is available on our website.

Issued by – HSBC Software Development India