Grafana stop log metrics
1 min read

Grafana stop log metrics

Debug found that carbon process not running

Check /var/log/supervisor/carbon-cache.log

it says "carbon-cache (instance a) is already running with pid 36"

it work by check pid in this file/opt/graphite/storage/ or /var/run/
which content is 36. Check cat /proc/36/cmdline , found it is another process!

check the modify time of, which is very old. For some reason, it is not updated or deleted properly, which prevent new process to start, and lead to deadlock.

delete, restart grafana, it work again.