655 B
655 B
Observability runbook
SLO: 99% successful API requests per rolling 30 minutes and 95% of accepted attachments reaching ready within 60 seconds. ApiHighErrorRate detects a two-minute burn; AttachmentQueueLag detects a sustained queue-age breach.
- Open the Grafana dashboard and compare API p95 with queue age.
- Follow the trace from the API request into the worker span using the trace id in structured logs.
- Check Prometheus
messenger_http_requests_total,messenger_http_request_duration_seconds_bucket, and worker/job metrics. - If the backend is unavailable, keep API/worker running; restore the backend and verify alerts resolve.