Lab5 verification, UTC 2026-11-13T09:29:53.527687+00:00
All commands below completed with exit code 0.
Go output excerpts omit SQL, runtime logs and synthetic request bodies.

$ make check build vet; make validate PYTHON=.venv/bin/python
python3 scripts/check_contract.py
PASS: offline skeleton structure, local refs and Python syntax; application NOT tested.
cd service && go build ./...
cd service && go build -o ../bin/benchmark ./cmd/benchmark
cd service && go vet ./...
.venv/bin/python scripts/validate_openapi.py
PASS: full OpenAPI 3.1 and JSON Schema validation; application NOT tested.

$ make test
python3 tests/smoke.py --base-url "http://localhost:18085" 
PASS: lab5 public API scenario; infrastructure and grading evidence remain separate.

$ make test-go (race enabled)
?   	gitea.privcloud.tech/mtusi2026/cmd/app	[no test files]
=== RUN   TestLostPostResponseIsNotRetried
--- PASS: TestLostPostResponseIsNotRetried (0.00s)
PASS
ok  	gitea.privcloud.tech/mtusi2026/cmd/benchmark	1.461s
?   	gitea.privcloud.tech/mtusi2026/internal/adapter/broker	[no test files]
?   	gitea.privcloud.tech/mtusi2026/internal/adapter/controller/http	[no test files]
?   	gitea.privcloud.tech/mtusi2026/internal/adapter/repository/cache/outside	[no test files]
=== RUN   TestIdempotencyTransactionAndExpiry
PASS
ok  	gitea.privcloud.tech/mtusi2026/internal/adapter/repository/storage	1.653s
?   	gitea.privcloud.tech/mtusi2026/internal/config	[no test files]
?   	gitea.privcloud.tech/mtusi2026/internal/dto	[no test files]
?   	gitea.privcloud.tech/mtusi2026/internal/gen/contracts	[no test files]
?   	gitea.privcloud.tech/mtusi2026/internal/pkg/apperr	[no test files]
?   	gitea.privcloud.tech/mtusi2026/internal/pkg/auth/jwtprovider	[no test files]
?   	gitea.privcloud.tech/mtusi2026/internal/pkg/cache	[no test files]
=== RUN   TestSessionFingerprints
--- PASS: TestSessionFingerprints (0.02s)
PASS
ok  	gitea.privcloud.tech/mtusi2026/internal/pkg/encrypting	1.908s
?   	gitea.privcloud.tech/mtusi2026/internal/pkg/fault	[no test files]
?   	gitea.privcloud.tech/mtusi2026/internal/pkg/imageprocessor	[no test files]
?   	gitea.privcloud.tech/mtusi2026/internal/pkg/migrator	[no test files]
?   	gitea.privcloud.tech/mtusi2026/internal/pkg/objectstore	[no test files]
?   	gitea.privcloud.tech/mtusi2026/internal/pkg/postgres	[no test files]
?   	gitea.privcloud.tech/mtusi2026/internal/pkg/postgres/txmanager	[no test files]
?   	gitea.privcloud.tech/mtusi2026/internal/pkg/rest/framework	[no test files]
?   	gitea.privcloud.tech/mtusi2026/internal/pkg/rest/headers	[no test files]
=== RUN   TestVerifiedSessionIsRequestScoped
--- PASS: TestVerifiedSessionIsRequestScoped (0.00s)
=== RUN   TestMissingTokenDoesNotCallSessionStore
--- PASS: TestMissingTokenDoesNotCallSessionStore (0.00s)
PASS
ok  	gitea.privcloud.tech/mtusi2026/internal/pkg/rest/middleware	2.467s
?   	gitea.privcloud.tech/mtusi2026/internal/pkg/rest/router	[no test files]
?   	gitea.privcloud.tech/mtusi2026/internal/pkg/types	[no test files]
?   	gitea.privcloud.tech/mtusi2026/internal/pkg/types/authprovider	[no test files]
?   	gitea.privcloud.tech/mtusi2026/internal/pkg/types/environment	[no test files]
?   	gitea.privcloud.tech/mtusi2026/internal/pkg/types/role	[no test files]
?   	gitea.privcloud.tech/mtusi2026/internal/pkg/validator	[no test files]
?   	gitea.privcloud.tech/mtusi2026/internal/service/attachment	[no test files]
?   	gitea.privcloud.tech/mtusi2026/internal/service/auth	[no test files]
?   	gitea.privcloud.tech/mtusi2026/internal/service/chat	[no test files]
?   	gitea.privcloud.tech/mtusi2026/internal/service/outbox	[no test files]
?   	gitea.privcloud.tech/mtusi2026/internal/service/user	[no test files]
?   	gitea.privcloud.tech/mtusi2026/migrations	[no test files]
=== RUN   TestInvalidJSON
=== RUN   TestInvalidJSON/malformed
=== RUN   TestInvalidJSON/wrong_type
=== RUN   TestInvalidJSON/unknown_field
--- PASS: TestInvalidJSON (0.01s)
    --- PASS: TestInvalidJSON/malformed (0.01s)
    --- PASS: TestInvalidJSON/wrong_type (0.00s)
    --- PASS: TestInvalidJSON/unknown_field (0.00s)
=== RUN   TestForeignChatIsHidden
--- PASS: TestForeignChatIsHidden (0.54s)
=== RUN   TestEmptyMessage
--- PASS: TestEmptyMessage (0.21s)
=== RUN   TestDuplicateUsername
--- PASS: TestDuplicateUsername (0.28s)
=== RUN   TestMessagePagination
--- PASS: TestMessagePagination (0.22s)
=== RUN   TestAttachmentContractAndErrors
=== RUN   TestAttachmentContractAndErrors/fake
=== RUN   TestAttachmentContractAndErrors/mime_mismatch
=== RUN   TestAttachmentContractAndErrors/wrong_type
=== RUN   TestAttachmentContractAndErrors/truncated
--- PASS: TestAttachmentContractAndErrors (1.05s)
    --- PASS: TestAttachmentContractAndErrors/fake (0.00s)
    --- PASS: TestAttachmentContractAndErrors/mime_mismatch (0.00s)
    --- PASS: TestAttachmentContractAndErrors/wrong_type (0.00s)
    --- PASS: TestAttachmentContractAndErrors/truncated (0.00s)
=== RUN   TestConcurrentAttachmentMessage
--- PASS: TestConcurrentAttachmentMessage (0.25s)
=== RUN   TestConcurrentMessages
--- PASS: TestConcurrentMessages (1.84s)
=== RUN   TestIdempotencyContract
--- PASS: TestIdempotencyContract (0.45s)
=== RUN   TestConcurrentIdempotencyAcrossReplicas
--- PASS: TestConcurrentIdempotencyAcrossReplicas (0.22s)
PASS
ok  	gitea.privcloud.tech/mtusi2026/tests	7.261s

$ make test-storage (isolated database)
=== RUN   TestIdempotencyTransactionAndExpiry
=== RUN   TestIdempotencyTransactionAndExpiry/service_owns_message_content_rules
=== RUN   TestIdempotencyTransactionAndExpiry/service_owns_message_content_rules/empty
=== RUN   TestIdempotencyTransactionAndExpiry/service_owns_message_content_rules/whitespace
=== RUN   TestIdempotencyTransactionAndExpiry/service_owns_message_content_rules/invalid_UTF8
=== RUN   TestIdempotencyTransactionAndExpiry/service_owns_message_content_rules/nul
=== RUN   TestIdempotencyTransactionAndExpiry/service_owns_message_content_rules/too_long
=== RUN   TestIdempotencyTransactionAndExpiry/service_owns_message_content_rules/duplicate
=== RUN   TestIdempotencyTransactionAndExpiry/service_owns_message_content_rules/too_many
=== RUN   TestIdempotencyTransactionAndExpiry/service_owns_message_content_rules/nil_id
=== RUN   TestIdempotencyTransactionAndExpiry/service_owns_message_content_rules/unknown
=== RUN   TestIdempotencyTransactionAndExpiry/service_owns_message_content_rules/foreign_chat
=== RUN   TestIdempotencyTransactionAndExpiry/service_owns_message_content_rules/missing_object
=== RUN   TestIdempotencyTransactionAndExpiry/object_lock_cancellation_does_not_leak_a_pooled_lock
--- PASS: TestIdempotencyTransactionAndExpiry (0.12s)
    --- PASS: TestIdempotencyTransactionAndExpiry/service_owns_message_content_rules (0.02s)
        --- PASS: TestIdempotencyTransactionAndExpiry/service_owns_message_content_rules/empty (0.00s)
        --- PASS: TestIdempotencyTransactionAndExpiry/service_owns_message_content_rules/whitespace (0.00s)
        --- PASS: TestIdempotencyTransactionAndExpiry/service_owns_message_content_rules/invalid_UTF8 (0.00s)
        --- PASS: TestIdempotencyTransactionAndExpiry/service_owns_message_content_rules/nul (0.00s)
        --- PASS: TestIdempotencyTransactionAndExpiry/service_owns_message_content_rules/too_long (0.00s)
        --- PASS: TestIdempotencyTransactionAndExpiry/service_owns_message_content_rules/duplicate (0.00s)
        --- PASS: TestIdempotencyTransactionAndExpiry/service_owns_message_content_rules/too_many (0.00s)
        --- PASS: TestIdempotencyTransactionAndExpiry/service_owns_message_content_rules/nil_id (0.00s)
        --- PASS: TestIdempotencyTransactionAndExpiry/service_owns_message_content_rules/unknown (0.00s)
        --- PASS: TestIdempotencyTransactionAndExpiry/service_owns_message_content_rules/foreign_chat (0.00s)
        --- PASS: TestIdempotencyTransactionAndExpiry/service_owns_message_content_rules/missing_object (0.00s)
    --- PASS: TestIdempotencyTransactionAndExpiry/object_lock_cancellation_does_not_leak_a_pooled_lock (0.05s)
PASS

$ make test-images
PASS: image geometry, EXIF, alpha, real formats, checksums, ACL and negative inputs

$ make test-staging
PASS: active source protected, ready staging removed, failed retention enforced, restore/replay verified

$ make test-broker-persistence
PASS: confirmed message survived broker container replacement with the same volume and stable node identity

$ make test-persistence ACTION_SCRIPT=scripts/restart.sh
python3 tests/resilience.py --mode persistence --action-script "scripts/restart.sh" --base-url "http://localhost:18085" 
Executing explicit persistence hook; hook output suppressed to avoid leaking secrets.
PASS: persistence preserved confirmed data and existing session. Hook scope needs operator evidence.

$ make test-failover ACTION_SCRIPT=scripts/stop-one.sh
python3 tests/resilience.py --mode failover --action-script "scripts/stop-one.sh" --base-url "http://localhost:18085" 
Executing explicit failover hook; hook output suppressed to avoid leaking secrets.
{"observed_instances_before": 2, "successful_writes": 133, "failed_attempts": 1, "first_recovery_seconds": 1.273}
PASS: failover preserved confirmed data and existing session. Hook scope needs operator evidence.

Actual process state before persistence hook
/mtusi2026lab5-api-1 pid=63585 started=2026-11-13T09:13:37.287792805Z
/mtusi2026lab5-api-2 pid=63443 started=2026-11-13T09:13:37.185017014Z
/mtusi2026lab5-broker-1 pid=16156 started=2026-11-13T09:06:10.180568751Z
/mtusi2026lab5-dispatcher-1 pid=63444 started=2026-11-13T09:13:37.187137055Z
/mtusi2026lab5-lb-1 pid=6588 started=2026-11-13T08:49:29.974451052Z
/mtusi2026lab5-postgres-1 pid=15734 started=2026-11-13T09:06:09.241419334Z
/mtusi2026lab5-redis-1 pid=15771 started=2026-11-13T09:06:09.289178667Z
/mtusi2026lab5-s3-1 pid=17699 started=2026-11-13T09:06:34.353438762Z
/mtusi2026lab5-worker-1 pid=66553 started=2026-11-13T09:14:11.339788001Z

Actual process state after persistence hook
/mtusi2026lab5-api-1 pid=73635 started=2026-11-13T09:15:52.601737132Z
/mtusi2026lab5-api-2 pid=73510 started=2026-11-13T09:15:52.490649465Z
/mtusi2026lab5-broker-1 pid=70234 started=2026-11-13T09:14:51.740755173Z
/mtusi2026lab5-dispatcher-1 pid=73512 started=2026-11-13T09:15:52.489731548Z
/mtusi2026lab5-lb-1 pid=73700 started=2026-11-13T09:15:52.696327173Z
/mtusi2026lab5-postgres-1 pid=70113 started=2026-11-13T09:14:50.775761506Z
/mtusi2026lab5-redis-1 pid=70044 started=2026-11-13T09:14:50.718397506Z
/mtusi2026lab5-s3-1 pid=71476 started=2026-11-13T09:15:16.065232545Z
/mtusi2026lab5-worker-1 pid=73511 started=2026-11-13T09:15:52.490188673Z

Actual state after API failover, before restoring stopped replica
api mtusi2026lab5-api-1 running healthy
api mtusi2026lab5-api-2 exited 
broker mtusi2026lab5-broker-1 running healthy
dispatcher mtusi2026lab5-dispatcher-1 running 
lb mtusi2026lab5-lb-1 running healthy
migrate mtusi2026lab5-migrate-1 exited 
postgres mtusi2026lab5-postgres-1 running healthy
redis mtusi2026lab5-redis-1 running healthy
s3 mtusi2026lab5-s3-1 running healthy
s3-init mtusi2026lab5-s3-init-1 exited 
worker mtusi2026lab5-worker-1 running 

Effective container resource limits
/mtusi2026lab5-api-1 memory_bytes=536870912 cpu_nano=1000000000
/mtusi2026lab5-api-2 memory_bytes=536870912 cpu_nano=1000000000
/mtusi2026lab5-broker-1 memory_bytes=536870912 cpu_nano=500000000
/mtusi2026lab5-dispatcher-1 memory_bytes=134217728 cpu_nano=250000000
/mtusi2026lab5-lb-1 memory_bytes=134217728 cpu_nano=500000000
/mtusi2026lab5-postgres-1 memory_bytes=1073741824 cpu_nano=2000000000
/mtusi2026lab5-redis-1 memory_bytes=134217728 cpu_nano=250000000
/mtusi2026lab5-s3-1 memory_bytes=536870912 cpu_nano=1000000000
/mtusi2026lab5-worker-1 memory_bytes=1073741824 cpu_nano=1000000000

make test-pipeline: 39/39 PASS; details and repetitions in pipeline.json
Final image targeted fault checks: 3/3 PASS; details in pipeline-final.json
