Check static dashboard support in Grafana about kube-prometheus

[andrewhowdencom]

I've sort of, mashed this with some of the prometheus/grafana work in kubernetes/charts.

See https://github.com/littlemanco/k8s.instrumentation/tree/master/deployment/charts/grafana for where I landed on. I'm happy with it for the minute.

[r4j4h]

@andrewhowdencom thank you so much for that. The doubled up dashboards from ..data was driving me crazy last week and I knew it was related to the symlinking and your comment just answered how for me! 😆

[andrewhowdencom]

FWIW, from the configmap in this repo, I had to slightly modify the configuration so it used a pre-defined source, and drop some of the JSON configuration associated with creating that source and I got it working.

Still have to add the source after grafana is created. However, there's an outstanding feature request to solve that here: grafana/grafana#5674

Also, it seems to be looking recursively. Because k8s mounts in the data in a folder called ".data", and then symlinks the files where they're supposed to be it's finding them 2x (1x in the folder called ".data", 1x. for each file). To solve that, I'm just reading the .data folder -- dirty hax, but seems to work fine.

Lastly -- these are super nice dashboards. <3

[brancz]

@andrewhowdencom thanks for your feedback - glad to hear! Just for us to understand better, are you using all of the resources of this repo or just the grafana sidecar?