Observability Engineer

This job is with Standard Chartered Bank, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly.Job Summary•As an Observability Engineer with a specialization on the Grafana stack, you will play a critical role in making the internal state of the market's infrastructure and services visible to stakeholders for troubleshooting, performance analysis, capacity planning, and reporting with a focus on telemetry solutions. •You will develop platforms and tooling to enable developers and operators to efficiently trace performance problems to their source and map their application performance to businessobjectives using traces. •You will assist teams in instrumenting their applications and systems to generate and utilize traces. •You will engineer the standardization and adoption of observability tools for the Infrastructure departments including Platform, Database, Reliability, and Cloud Operations teams, as well as developer teams. Key Responsibilities •Design and build an observability infrastructure for all engineering teams to consume. •Develop and improve instrumentation for monitoring and logging the health and availability of services. •Design and develop tools for metric collection, analysis, and reporting. •Educate and lead efforts to improve observability among all engineering teams. •Work with teams to enable an effective and pleasant on-call experience. •Identify and collect the appropriate measurements, and synthesize the correct queries, to show intuitiveand insightful visualizations which characterize the behavior of complex systems. •Build a metrics pipeline with end-to-end latency under 5 minutes. •Integrate logs with time series data for event correlation. •Help us unlock the power of distributed tracing. •Proactively monitor systems, networks, and applications to provide input in improving the stability, security, efficiency, and scalability of systems. Key ResponsibilitiesOur ideal candidate would have: •Familiarity with the Grafana tech stack: Loki, Grafana, Tempo, Mimir/Prometheus •In-depth experience designing at-scale monitoring and logging for corporate infrastructure services. •5 years experience working in Monitoring / Observability / SRE / DevOps / Performance Tuning. •Experience working with cloud infrastructures, particularly Kubernetes and AWS. •Experience with Git/version control solutions •Experience with programming languages, primarily Go, Rust, Java, Python •Experience with CI/CD pipelines like Azure Pipelines, Jenkins •Expert-level experience in monitoring and logging technologies, both open source Strategy •Awareness and understanding of the TTO'25 business strategy and model appropriate to the role. Support and the enablement of the Central Monitoring & Observability strategy, goals and objectives by developing prioritized features aligned to the Catalyst and Tech Simplification programmes. Business •The Monitoring & Observability Platform team is a global team ensuring the design, development, delivery & support of the bank's central monitoring and observability services for all TTO teams (technology domains). •The ideal candidate will possess a deep understanding of the Grafana tech stack and integrating to it and its other required capabilities, such as Kafka messaging, database management, enabling the design, development, implementation, and management of the central solution, integrating advanced technological tools and techniques, and overseeing large-scale enterprise-level implementations. Processes •As an Observability engineer, you will play a crucial role in ensuring the stability, reliability, and performance of our applications and platform, thereby enabling our organization to deliver exceptional services to our internal stakeholders by adhering to the Enterprise SDLC (eSDLC) framework and guidelines. People & Talent •Actively engaging in stakeholders' conversations, providing timely, clear and actionable feedback to deliver solution within timeline. Risk Management •The ability to interpret the Group's technical and security (ICS) control requirements and information to identify potential risks and key issues based on this information and put in place appropriate controls and measures to mitigate or minimize risk to the central monitoring & observability platform delivery. Governance •Awareness and understanding of the eSDLC framework, in which the TTO software delivery operates, and the requirements and expectations relevant to the role. •Responsible for adhering to the effectiveness of the central monitoring and observability platform deliver governance, based on oversight and controls of the eSDLC framework. Regulatory & Business Conduct •Display exemplary conduct and live by the Group's Values and Code of Conduct. •Take personal responsibility for embedding the highest standards of ethics, including regulatory and business conduct, across Standard Chartered Bank. This includes understanding and ensuring compliance with, in letter and spirit, all applicable laws, regulations, guidelines and the Group Code of Conduct. •Effectively and collaboratively identify, escalate, mitigate and resolve risk, conduct and compliance matters. QualificationsKey stakeholders •TTO CIO Development teams •TTO Product Owners •TTO SRE / PSS •ET Foundation Service Owners Other Responsibilities •Embed Here for good and Group's brand and values in the Observability Platform Team; Perform other responsibilities assigned under Group, Country, Business or Functional policies and procedures; Multiple functions (double hats); [List all responsibilities associated with the role] •Participate in solution architecture / design consulting, platform management, and capacity planning activities •Create sustainable solutions and services through automation and service uplifts within monitoring and observability disciplines •Daily tasks include providing Level 2 / Level 3 support to delivered solutions. This means solving incidents and problems and applying changes according to the bank's defined processes Education •EducationDegree •TrainingAgile Delivery, DevOps, SRE •LicensesAny •MembershipAny •CertificationsAny Monitoring or Observability product certifications, primarily Grafana technologies such as Loki, Grafana, Tempo and Mimir/Prometheus. Experience inITRS Geneos, Zabbix, and ElasticSearch is helpful •LanguagesEnglish Skills and Experience•Application Delivery Process •Software Engineering •Software Product Technical Knowledge •Software Change Request Management •Technical Troubleshooting About Standard CharteredWe're an international bank, nimble enough to act, big enough for impact. For more than 170 years, we've worked to make a positive difference for our clients, communities, and each other. We question the status quo, love a challenge and enjoy finding new opportunities to grow and do better than before. If you're looking for a career with purpose and you want to work for a bank making a difference, we want to hear from you. You can count on us to celebrate your unique talents and we can't wait to see the talents you can bring us. Our purpose, to drive commerce and prosperity through our unique diversity, together with our brand promise, to be here for good are achieved by how we each live our valued behaviours. When you work with us, you'll see how we value difference and advocate inclusion. Together we: Do the right thingand are assertive, challenge one another, and live with integrity, while putting the client at the heart of what we do Never settle,continuously striving to improve and innovate, keeping things simple and learning from doing well, and not so well Are better together,we can be ourselves, be inclusive, see more good in others, and work collectively to build for the long term What we offerIn line with our Fair Pay Charter,we offer a competitive salary and benefits to support your mental, physical, financial and social wellbeing. Core bank funding for retirement savings, medical and life insurance,with flexible and voluntary benefits available in some locations. Time-offincluding annual leave, parental/maternity (20 weeks), sabbatical (12 months maximum) and volunteering leave (3 days), along with minimum global standards for annual and public holiday, which is combined to 30 days minimum. Flexible workingoptions based around home and office locations, with flexible working patterns. Proactive wellbeing supportthrough Unmind, a market-leading digital wellbeing platform, development courses for resilience and other human skills, global Employee Assistance Programme, sick leave, mental health first-aiders and all sorts of self-help toolkits A continuous learning cultureto support your growth, with opportunities to reskill and upskill and access to physical, virtual and digital learning. Being part of an inclusive and values driven organisation,one that embraces and celebrates our unique diversity, across our teams, business functions and geographies - everyone feels respected and can realise their full potential.