Senior Software Engineer

Senior Software Engineer - Grafana Developer (DevOps)

Experience : 5 - 8 Years

Job Type : Full-time

Job Overview :

We are seeking a highly skilled and experienced Senior Software Engineer - Grafana Developer with a strong background in DevOps practices. You will be instrumental in designing, developing, and maintaining our monitoring and observability solutions, primarily leveraging Grafana to visualize complex data from various sources. This role requires a blend of software engineering expertise, a deep understanding of DevOps principles, and the ability to build scalable, reliable, and insightful dashboards and alerts to support our critical systems.

Responsibilities :

- Lead the design, development, and maintenance of Grafana dashboards, alerts, and data sources to provide comprehensive visibility into system performance, health, and application metrics.

- Integrate Grafana with various monitoring tools and data sources such as Prometheus, Loki, Elasticsearch, InfluxDB, relational databases, and cloud-native monitoring services.

- Develop and maintain custom Grafana plugins or panels as needed, using JavaScript, TypeScript, or Go to extend functionality.

- Collaborate closely with DevOps, SRE, and development teams to understand their monitoring needs and translate them into effective Grafana solutions.

- Implement Infrastructure as Code (IaC) for Grafana configurations, dashboards, and alerting rules using tools like Terraform or JSON/YAML templating.

- Drive the adoption of observability best practices, including metrics, logs, and traces, and ensure their effective visualization in Grafana.

- Optimize Grafana performance and scalability, managing instances, user access, and security configurations.

- Participate in the design and implementation of automated testing for monitoring solutions.

- Troubleshoot and resolve complex issues related to Grafana, its data sources, and underlying monitoring infrastructure.

- Contribute to the broader DevOps culture by automating monitoring deployments, establishing CI/CD pipelines for Grafana assets, and promoting a "monitor-first" approach to development.

- Provide mentorship and technical guidance to junior team members on Grafana development and observability practices.

- Stay current with the latest trends and advancements in Grafana, monitoring tools, and DevOps methodologies.

Required Technical Skills :

- 5-8 years of experience in software engineering, with a strong focus on monitoring and observability.

- Expert-level proficiency in Grafana, including dashboard creation, advanced panel configuration, templating, and variable usage.

- Strong experience in integrating Grafana with various data sources like Prometheus, Elasticsearch (ELK stack), Loki, and SQL/NoSQL databases.

- Solid understanding of DevOps principles and experience implementing CI/CD pipelines for monitoring infrastructure (e.g., Jenkins, GitLab CI, CircleCI).

- Proficiency in at least one scripting language (e.g., Python, Go, Shell) for automation and data processing.

- Experience with Infrastructure as Code (IaC) tools such as Terraform for managing Grafana and monitoring infrastructure.

- Strong understanding of Linux/Unix systems and cloud platforms (AWS, Azure, or GCP).

- Knowledge of containerization technologies like Docker and Kubernetes.

- Familiarity with Git for version control.

- Understanding of network protocols and system architecture.

Good to Have :

- Experience with developing custom Grafana plugins or panels.

- Background in SRE practices.

- Experience with other monitoring tools like Splunk, New Relic, Datadog.

- Understanding of logging platforms and log management best practices.

- Experience with APM (Application Performance Monitoring) tools.