Observability Software Engineer

About us:

We are a leading technology company that values innovation and customer satisfaction. Our success is built on a collaborative approach, driven by the desire to understand and enhance the user experience.

Our team is responsible for building and fine-tuning platform components for our observability product.

You'll work closely with the Lead engineer, performance team, data ingestion, platform DevOps and data visualization teams under our observability product.

The candidate needs to be able to support and maintain the applications onboarded to Grafana Observability, Ingestion and visualization written in PromQL, Log queries, etc., and monitoring technologies.

Key Responsibilities:

• Troubleshoot platform issues and restore service by resolving customer-facing incidents
• Development and implementation of build release pipelines with accountability for managing deployment schedules, issues, risks, and impediments.
• Agile development experience with team member accountability for commitment and delivery each sprint.
• Troubleshoot and implement corrections to problems associated with connectivity between the supported applications and the clients they serve
• Provide technical guidance, in the diagnosis of issues as they arise in support of critical applications
• Drive collaboration sessions among IT and business groups to facilitate optimal support and operation of the relevant applications
• Provide Site Reliability Engineering techniques such as observability, alerting and performance tuning
• Contribute to the design, implementation, and enhancement of critical applications
• Perform proactive analysis and troubleshooting to predict and prevent production incidents
• Define and contribute to monitoring capabilities for critical applications
• Collaborate with key vendors on functional, performance and capacity improvements
• Design and build tools to automate support and monitoring functions
• Ensure that all implementations of observability meet the requirements prescribed by IT Services through the effective implementation or use of approved processes, methodologies, and deliverables.

We are searching for someone with the following skills:

• Experience with gathering and organizing large volume of data to use for instrumentation into an Enterprise Observability solution.
• Experience with recommending baseline monitoring thresholds, and performance monitoring KPIs and SLAs.
• Good Knowledge and understanding of Azure foundation components e.g. App GW, APIM, Virtual Network, NSG, Load Balancer, Azure VM etc. is required.
• Experience with Databases Azure SQL, PostgreSQL, MySQL, MongoDB, TSDB or similar databases.
• Knowledge of monitoring tools such as Log Analytics, App Dynamics, Grafana, Prometheus, Splunk, and Sitescope
• Azure / GCP hands-on with details around pulling observability data from managed services
• Golang / Python coding or from solutioning background with experience on SRE development and Open telemetry implementation
• Deploying/managing and optimizing enterprise level observability platform for Grafana OSS products like Mimir,Loki,Tempo, Fluentbit/Vector
• Design and develop standard Grafana dashboards for critical metrics for various Azure/GCP services using the observability data
• Experience must include at least one of the following languages: Java (required), Desired--Python, GoLang, node.js
• Experience in working with ServiceNow or similar Service Management tools
• Familiarity with Cloud technologies in Azure, AWS, and Google Cloud
• Experience on PCF, Docker, Kubernetes platform is required.
• Experience with DevOps and CI/CD tools and processes is required.

We value diversity and inclusion in our workplace and encourage applicants from diverse backgrounds to apply.

This role is an individual contributor position, requiring strong communication and problem-solving skills.

We offer competitive compensation and benefits package, including opportunities for professional growth and development.

Please submit your application with your resume and cover letter.