Senior GCP Data Engineer/Consultant Specialist
1 day ago
Job Description Job Description Some careers shine brighter than others. If you're looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further. HSBC is one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions. We are currently seeking an experienced professional to join our team in the role of Consultant Specialist. In this role, you will: - Design and Develop Scalable Data Pipelines: Architect and implement end-to-end data workflows using Apache Airflow for orchestration, integrating multiple data sources and sinks across cloud and on-prem environments. - BigQuery Data Modeling and Optimization: Build and optimize data models in Google BigQuery for performance and cost-efficiency, including partitioning, clustering, and materialized views to support analytics and reporting use cases. - ETL/ELT Development and Maintenance: Design robust ETL/ELT pipelines to extract, transform, and load structured and semi-structured data, ensuring data quality, reliability, and availability. - Cloud-Native Engineering on GCP: Leverage GCP services like Cloud Storage, Pub/Sub, Dataflow, and Cloud Functions to build resilient, event-driven data workflows. - CI/CD and Automation: Implement CI/CD for data pipelines using tools like Cloud Composer (managed Airflow), Git, and Terraform, ensuring automated deployment and versioning of workflows. - Data Governance and Security: Ensure proper data classification, access control, and audit logging within GCP, adhering to data governance and compliance standards. - Monitoring and Troubleshooting: Build proactive monitoring for pipeline health and data quality using tools such as Stackdriver (Cloud Monitoring) and custom Airflow alerting mechanisms. - Collaboration and Stakeholder Engagement: Work closely with data analysts, data scientists, and business teams to understand requirements and deliver high-quality, timely data products. Requirements To be successful in this role, you should meet the following requirements: - Mandatory 6+ hands on working experience on GCP Bigquery (Mandatory) - Mandatory 6+ hands on working experience on Apache Airflow (Mandatory) - Mandatory 5+ hands on working experience on Python (Mandatory) - Mandatory 5+ hands on working experience on Linux/Unix (Mandatory) - Mandatory 3+ hands on working experience on PL/SQL Scripting (Mandatory) - Mandatory 2+ hands on working experience on ETL tools (Mandatory)- (Mandatory) Data stage/ Informatica/ Prophecy. - GCP Certification on ACE (Associate Cloud Engineer) is added advantage. You'll achieve more when you join HSBC. www.hsbc.com/careers HSBC is committed to building a culture where all employees are valued, respected and opinions count. We take pride in providing a workplace that fosters continuous professional development, flexible working and opportunities to grow within an inclusive and diverse environment. Personal data held by the Bank relating to employment applications will be used in accordance with our Privacy Statement, which is available on our website. Issued by HSBC Software Development India
-
Data Engineer Senior Consultant
2 weeks ago
Pune, India NTT Data Full timeJob Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer Senior Consultant to join our team in Pune, Mahrshtra (IN-MH), India (IN). Location: | Experience: 5+...
-
GCP Data Engineer
1 week ago
Hyderabad, Telangana, India HSBC Full time ₹ 12,00,000 - ₹ 36,00,000 per yearSome careers shine brighter than others.If you're looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.HSBC is one of the largest banking and...
-
GCP Data Engineer
6 days ago
Hyderabad, Telangana, India HSBC Full time ₹ 12,00,000 - ₹ 36,00,000 per yearSome careers shine brighter than others.If you're looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.HSBC is one of the largest banking and...
-
GCP Senior Data Engineer
4 weeks ago
Hyderabad, Telangana, India, Telangana People Prime Worldwide Full timeAbout Company : Our Client is a leading Indian multinational IT services and consulting firm. It provides digital transformation, cloud computing, data analytics, enterprise application integration, infrastructure management, and application development services. The company caters to over 700 clients across industries such as banking and financial services,...
-
GCP Senior Data Engineer
4 weeks ago
Hyderabad, India People Prime Worldwide Full timeAbout Company : Our Client is a leading Indian multinational IT services and consulting firm. It provides digital transformation, cloud computing, data analytics, enterprise application integration, infrastructure management, and application development services. The company caters to over 700 clients across industries such as banking and financial services,...
-
GCP Senior Data Engineer
4 weeks ago
Hyderabad, India People Prime Worldwide Full timeAbout Company : Our Client is a leading Indian multinational IT services and consulting firm. It provides digital transformation, cloud computing, data analytics, enterprise application integration, infrastructure management, and application development services. The company caters to over 700 clients across industries such as banking and financial services,...
-
GCP Senior Data Engineer
4 weeks ago
Hyderabad, India People Prime Worldwide Full timeAbout Company : Our Client is a leading Indian multinational IT services and consulting firm. It provides digital transformation, cloud computing, data analytics, enterprise application integration, infrastructure management, and application development services. The company caters to over 700 clients across industries such as banking and financial services,...
-
GCP Senior Data Engineer
4 weeks ago
Hyderabad, India People Prime Worldwide Full timeAbout Company : Our Client is a leading Indian multinational IT services and consulting firm. It provides digital transformation, cloud computing, data analytics, enterprise application integration, infrastructure management, and application development services. The company caters to over 700 clients across industries such as banking and financial services,...
-
Data Engineer
7 days ago
hyderabad, India People Prime Worldwide Full timeJob Title: Senior Data Engineer - GCP + PythonLocation: HyderabadYears of Experience: 6+YearsAbout the CompanyOur client is a trusted global innovator of IT and business services, present in 50+ countries. They specialize in digital & IT modernization, consulting, managed services, and industry-specific solutions. With a commitment to long-term success, they...
-
Data Engineer
1 week ago
Hyderabad, India People Prime Worldwide Full timeJob Title: Senior Data Engineer - GCP + PythonLocation: HyderabadYears of Experience : 6+YearsAbout the CompanyOur client is a trusted global innovator of IT and business services, present in 50+ countries. They specialize in digital & IT modernization, consulting, managed services, and industry-specific solutions. With a commitment to long-term success,...
