WAL-G textfile metrics missing on CT 113 #16

Open
opened 2026-05-27 05:56:51 +00:00 by fkrebs · 0 comments
Owner

Problem

/var/lib/node_exporter/walg-metrics.prom no longer exists on CT 113. Was set up 2026-05-23. Prometheus alert WalgArchiveStale will fire or already has.

Investigate

  • SSH to CT 113, check if the file exists and at what path
  • Check cron job / systemd timer that writes the metrics file
  • Check node_exporter textfile collector config — is it pointed at the right dir?
  • If cron broke, re-deploy and verify the file is written on next run
  • Silence or resolve the Prometheus alert once fixed

Context

WAL-G is used for Postgres WAL archiving from CT 113 (shared-db). Metrics are scraped by Prometheus on CT 109 to detect archiving staleness.

## Problem `/var/lib/node_exporter/walg-metrics.prom` no longer exists on CT 113. Was set up 2026-05-23. Prometheus alert `WalgArchiveStale` will fire or already has. ## Investigate - [ ] SSH to CT 113, check if the file exists and at what path - [ ] Check cron job / systemd timer that writes the metrics file - [ ] Check node_exporter textfile collector config — is it pointed at the right dir? - [ ] If cron broke, re-deploy and verify the file is written on next run - [ ] Silence or resolve the Prometheus alert once fixed ## Context WAL-G is used for Postgres WAL archiving from CT 113 (shared-db). Metrics are scraped by Prometheus on CT 109 to detect archiving staleness.
Sign in to join this conversation.
No Label
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: fkrebs/docs#16