gitea-pages/engineering-guide/metrics.md

Metrics Server - Grafana

The Grafana frontend can be accessed via - https://metrics.psi.ch

This machine is puppet managed: https://git.psi.ch/linux-infra/hiera/data-lx/blob/master/default/lx-metrics-01.psi.ch.yaml

The rights for Grafana are managed with these two AD groups:

Group	Notes
unx-lx_grafana_adm	Grafana Administrators
unx-lx_grafana_edi	Group with Grafana editor rights

Administration

New telegraf/hiera metric sources are automatically added by a systemd timer once a day (~ 01:08).

To add a new metric source manually go about like this:

Configuration

Grafana Dashboard Management

Dashboards can be automatically imported into grafana via files on the filesytem: https://grafana.com/docs/grafana/latest/administration/provisioning/#dashboards

/etc/grafana/provisioning/dashboards/importer.yaml:

# # config file version
# https://grafana.com/docs/grafana/latest/administration/provisioning/#dashboards
apiVersion: 1

providers:
 - name: 'default'
   orgId: 1
   folder: ''
   folderUid: ''
   type: file
   disableDeletion: false
   updateIntervalSeconds: 10
   allowUiUpdates: false
   options:
     path: /var/lib/grafana/dashboards
     foldersFromFilesStructure: true

The dashboard .json files need to be located then in /var/lib/grafana/dashboards