6.1 KiB
Native Grafana acceptance boundary
This phase uses the authorized Grafana13.3.1 image and unmodified ready-made OpenObserve1.0.1 plugin from the coordinator's single verified download. Copy only verified public artifacts into the lab7 namespace. Wait for exact native image/import handover before any stand start. No OpenBao or SII download is authorized. Preserve ZIP361cae, its manifest backup and historical closures; backend112 and its protected source remain unchanged.
Use system-design/test-design/browser-testing. Operational helpers stay TypeScript+Bun and pinned Compose project/manifest; native runs use background.slice on the owned HDD path. Reuse existing request/receipt/secret readers. New unique receipts exclusively claimed before work, preserve primary stage/status/content type, best-effort diagnostics, owned teardown in finally. Never count HTTP200 with empty/error data as acceptance.
| Situation / input class | Example | Expected result | Level |
|---|---|---|---|
| Valid cached image and plugin | Coordinator receipts, SHA and linux/amd64 identities | Freeze own alias and own plugin copy; no second download or source-cache changes | Read-only guard + native |
| Missing or mismatched artifact | Wrong imageID/version/pluginSHA | Stop before credential read or stand start | Guard / negative fixture |
| Exact current source | BACKEND-READY09fe,112files + checked binaries | Initial lease retained through final checks; historical archive untouched | Existing source guard |
| Published Grafana endpoint | grafana-gateway has private+edge networks | Resolve verified owned published127.0.0.1 binding3443; verify actual HTTPS response and CA/SAN | Pure guard + native |
| Wrong HTTPS identity | foreign trust/wrong hostname | Explicit certificate failure with authenticated positive control | Native TLS |
| Native datasources | prometheus + openobserve dedicated querySA | Native API registration/health/query success, no root credential; mTLS query5082 | Native API + browser |
| Metrics | All19 mounted targets in retained historical interval | Each actual response has finite nonempty numeric data, no embedded errors; browser renders panels | Native datasource + browser |
| Logs/traces | Retained trace13aa5cd043d490330a867149fc7f4dbf,42spans/41parents,3logs | Actual ready-made plugin native trace view, correct start/duration/parents; log↔trace navigation | Native plugin + browser |
| Response limits | Below/at/above declared cap through actual consumer | Explicit success/rejection per real Prom proxy/plugin path; do not transfer a generic proxy limit claim to plugin backend | Native boundary |
| Worker incident | Stop own worker, one new unique upload fixture | Original backlog rule observes age>30, pending→firing; worker recovery completes same job and rule resolves | Native application + actual Grafana rule |
| DB incident | Bounded own DB outage + minimal real requests | Original server-error rule sees actual5xx ratio, pending→firing; DB recovery restores normal and resolves | Native application + actual Grafana rule |
| Alert dependency failure | NoData/evaluationError | Preserve actual state; never count it as threshold firing or recovery | Native rule readback |
| Teardown | Failure during any stage | Stop only owned services, retain first error; prove no owned running containers | Native lifecycle |
| Browser context acquired, page creation rejects | Required fake acquire succeeds, fake newPage rejects | Close exactly once, preserve original error | Pure lifecycle factory |
| Browser listener initialization throws | Required fake page exists, listener throws | Close exactly once before propagating primary error | Pure lifecycle factory |
| Browser cleanup also rejects | Primary failure plus failing close/reporter, or normal work plus close failure | Report cleanup separately; retain primary, otherwise reject cleanup error | Pure lifecycle factory |
| Gauge restart history | Same fixed incident timestamp, full labels including start_time, raw120s samples | Old capacity/observer expressions compared with timestamp-filtered native expressions; retained samples identify age without assuming which label changed | Native PromQL, storage only |
| Gauge series absent | Missing service selector at same timestamp | Both filtered aggregates remain NoData, never synthetic0 | Native PromQL |
Failure cases: image/import mismatch, absent plugin executable, failed provisioning/auth, TLS or service DNS failure, empty/NaN frames, wrong historical window, missing/zero-duration trace spans, failed internal links, cap bypass on another consumer, alert NoData instead of Firing, outage not restored, primary failure replaced by teardown or evidence I/O. Cases not yet executed stay pending.
Retained history and newly authorized incidents have separate receipts. The new minimal producer fixture is allowed only to exercise mandatory fresh worker/DB alert incidents. Do not rerun public full smoke/security,120s freshness or old all3 producer merely to repair readback. Operator-rendered credentials/heartbeat remain explicitly not Bao. Actual rule expressions and thresholds are preserved; synthetic vectors or patched thresholds are not incident acceptance.
Native reader correction: /api/datasources is only a list DTO; its missing basicAuthUser/secureJsonFields is not an authentication failure. The actual UID detail reader and matching health endpoint expose/prove the intended values; required fake request ports cover the native list shape, an owner-account mismatch and HTTP200 health with an error body. Production preflight uses the same reader.
A retained historical histogram-rate panel can be NoData after traffic stops even while cumulative histogram queries remain finite. Preserve this outcome. Fresh live19-panel acceptance belongs to the newly authorized incident fixture. Use at most one unique two-member chat and three tiny uploads: the worker outage/restart changes its SDK instance, so an incident job plus a later completion in that same restarted instance supplies two cumulative histogram observations. Generate only bounded real business requests, without repeating the public full smoke suite or substituting alert expressions/thresholds.