Files
mtusi2026lab7/docs/GRAFANA-ACCEPTANCE-CASES.md

6.1 KiB

Native Grafana acceptance boundary

This phase uses the authorized Grafana13.3.1 image and unmodified ready-made OpenObserve1.0.1 plugin from the coordinator's single verified download. Copy only verified public artifacts into the lab7 namespace. Wait for exact native image/import handover before any stand start. No OpenBao or SII download is authorized. Preserve ZIP361cae, its manifest backup and historical closures; backend112 and its protected source remain unchanged.

Use system-design/test-design/browser-testing. Operational helpers stay TypeScript+Bun and pinned Compose project/manifest; native runs use background.slice on the owned HDD path. Reuse existing request/receipt/secret readers. New unique receipts exclusively claimed before work, preserve primary stage/status/content type, best-effort diagnostics, owned teardown in finally. Never count HTTP200 with empty/error data as acceptance.

Situation / input class Example Expected result Level
Valid cached image and plugin Coordinator receipts, SHA and linux/amd64 identities Freeze own alias and own plugin copy; no second download or source-cache changes Read-only guard + native
Missing or mismatched artifact Wrong imageID/version/pluginSHA Stop before credential read or stand start Guard / negative fixture
Exact current source BACKEND-READY09fe,112files + checked binaries Initial lease retained through final checks; historical archive untouched Existing source guard
Published Grafana endpoint grafana-gateway has private+edge networks Resolve verified owned published127.0.0.1 binding3443; verify actual HTTPS response and CA/SAN Pure guard + native
Wrong HTTPS identity foreign trust/wrong hostname Explicit certificate failure with authenticated positive control Native TLS
Native datasources prometheus + openobserve dedicated querySA Native API registration/health/query success, no root credential; mTLS query5082 Native API + browser
Metrics All19 mounted targets in retained historical interval Each actual response has finite nonempty numeric data, no embedded errors; browser renders panels Native datasource + browser
Logs/traces Retained trace13aa5cd043d490330a867149fc7f4dbf,42spans/41parents,3logs Actual ready-made plugin native trace view, correct start/duration/parents; log↔trace navigation Native plugin + browser
Response limits Below/at/above declared cap through actual consumer Explicit success/rejection per real Prom proxy/plugin path; do not transfer a generic proxy limit claim to plugin backend Native boundary
Worker incident Stop own worker, one new unique upload fixture Original backlog rule observes age>30, pending→firing; worker recovery completes same job and rule resolves Native application + actual Grafana rule
DB incident Bounded own DB outage + minimal real requests Original server-error rule sees actual5xx ratio, pending→firing; DB recovery restores normal and resolves Native application + actual Grafana rule
Alert dependency failure NoData/evaluationError Preserve actual state; never count it as threshold firing or recovery Native rule readback
Teardown Failure during any stage Stop only owned services, retain first error; prove no owned running containers Native lifecycle
Browser context acquired, page creation rejects Required fake acquire succeeds, fake newPage rejects Close exactly once, preserve original error Pure lifecycle factory
Browser listener initialization throws Required fake page exists, listener throws Close exactly once before propagating primary error Pure lifecycle factory
Browser cleanup also rejects Primary failure plus failing close/reporter, or normal work plus close failure Report cleanup separately; retain primary, otherwise reject cleanup error Pure lifecycle factory
Gauge restart history Same fixed incident timestamp, full labels including start_time, raw120s samples Old capacity/observer expressions compared with timestamp-filtered native expressions; retained samples identify age without assuming which label changed Native PromQL, storage only
Gauge series absent Missing service selector at same timestamp Both filtered aggregates remain NoData, never synthetic0 Native PromQL

Failure cases: image/import mismatch, absent plugin executable, failed provisioning/auth, TLS or service DNS failure, empty/NaN frames, wrong historical window, missing/zero-duration trace spans, failed internal links, cap bypass on another consumer, alert NoData instead of Firing, outage not restored, primary failure replaced by teardown or evidence I/O. Cases not yet executed stay pending.

Retained history and newly authorized incidents have separate receipts. The new minimal producer fixture is allowed only to exercise mandatory fresh worker/DB alert incidents. Do not rerun public full smoke/security,120s freshness or old all3 producer merely to repair readback. Operator-rendered credentials/heartbeat remain explicitly not Bao. Actual rule expressions and thresholds are preserved; synthetic vectors or patched thresholds are not incident acceptance.

Native reader correction: /api/datasources is only a list DTO; its missing basicAuthUser/secureJsonFields is not an authentication failure. The actual UID detail reader and matching health endpoint expose/prove the intended values; required fake request ports cover the native list shape, an owner-account mismatch and HTTP200 health with an error body. Production preflight uses the same reader.

A retained historical histogram-rate panel can be NoData after traffic stops even while cumulative histogram queries remain finite. Preserve this outcome. Fresh live19-panel acceptance belongs to the newly authorized incident fixture. Use at most one unique two-member chat and three tiny uploads: the worker outage/restart changes its SDK instance, so an incident job plus a later completion in that same restarted instance supplies two cumulative histogram observations. Generate only bounded real business requests, without repeating the public full smoke suite or substituting alert expressions/thresholds.