Подтвердить трек 2 реальными сбоями, нагрузкой и отчётом

This commit is contained in:
2026-11-20 07:05:16 +03:00
parent 42bf6aa702
commit ef1f470659
43 changed files with 11538 additions and 30 deletions
+191 -21
View File
@@ -1,37 +1,207 @@
# Отчёт — лабораторная 5
# Лабораторная №5 — очереди и асинхронная обработка изображений
- Автор, группа: TODO
- Целевая оценка; выбранный трек 5, если нужен: TODO
- Commit/PR: TODO после публикации
- Использованные источники, библиотеки и помощь ИИ: TODO
**Ляхонов Сергей, БВТ2301. 20 ноября 2026 года.** Цель: **5**, выбран **трек 2 — доказанная идемпотентность versioned pipeline**. Ветка `solution/BVT2301-lyakhonov`. Проверенная ревизия — в [reproduction.json](evidence/reproduction.json), авторство — в [audit.json](evidence/audit.json).
## Запуск из чистого clone
TODO: версии runtime/образов, prerequisites, команды создания локальных secrets/.env, build, миграций, запуска, ожидания готовности, тестов и остановки. Указать необходимые действия оператора. Не вставлять секреты. Отдельно указать безопасную остановку и команду намеренного удаления учебных данных.
Нужны Docker Desktop с Linux-контейнерами и Compose v2, Python 3.11+ для собственных генераторов (публичным тестам достаточно 3.9+). Проверено: Windows, Python хоста 3.13.7, Python контейнера 3.11.10, Engine 28.5.1, Compose 2.40.3-desktop.1, Intel i5-1340P, 16 логических CPU/16 GB RAM. Docker VM: 16 CPU/8 126 664 704 bytes RAM. ID образов, контейнеров, лимиты и параметры эксперимента: [environment.json](evidence/environment.json).
## Архитектура и решения
PowerShell из корня №5:
TODO: схема процессов/хранилищ, источник истины, транзакционные границы, ограничения. Что перенесено из lab4, что изменено в этой работе. Соответствие переменных из .env.example реальной конфигурации.
```powershell
$env:PYTHONUTF8='1'
python scripts/bootstrap.py
docker compose -p lyakhonov-lab5 config --quiet
docker compose -p lyakhonov-lab5 build api s3
docker compose -p lyakhonov-lab5 up -d
python scripts/wait_ready.py
python scripts/check_contract.py
python tests/smoke.py --base-url http://127.0.0.1:8085
python -m venv .venv
.venv/Scripts/python -m pip install -r requirements-dev.txt
.venv/Scripts/python scripts/validate_openapi.py
docker compose -p lyakhonov-lab5 run --rm --no-deps -v "${PWD}:/suite:ro" -w /suite api python -m unittest discover -s student-tests -p 'test_*.py'
python student-tests/resilience_driver.py
```
## Доказательства критериев
`make check validate test PYTHON=python BASE_URL=http://127.0.0.1:8085` эквивалентен прямым командам при наличии make и validator. UTF-8 mode обязателен на этом Windows: без него исходный публичный checker получает `UnicodeDecodeError` при чтении UTF-8 JSON как cp1251. Checker не изменён.
| Критерий README | Команда/сценарий | Наблюдаемый результат | Файл доказательства |
Bootstrap создаёт **только отсутствующие** `.env` и `secrets/`, не перезаписывает настройки. Для чистого экспорта генерируются новые секреты. `migrate` применяет 001–006 в транзакции под advisory lock до запуска API. Повторные migrate, bucket-init и объявления очереди безопасны. Секреты передаются файлами `/run/secrets`, исключены из Git и build context.
Рабочая конфигурация — `compose.yaml` и `lab5.env.example`. Исходный `.env.example` задания сохранён: сессии фактически в PostgreSQL, кэш через внутренний `CACHE_URL`, storage credentials отображены на `S3_ACCESS_KEY_FILE/S3_SECRET_KEY_FILE`, bucket — `attachments`. Лимиты bytes/pixels и 24h TTL идемпотентности фиксированы контрактом в коде. `WORKER_CONCURRENCY` — число worker-контейнеров, каждый имеет prefetch=1.
Единственный опубликованный порт — `127.0.0.1:8085` HAProxy. При занятости задайте свободный `LAB5_PORT` и соответствующий URL тестов. Внутренние API, DB, broker, Redis, S3 не опубликованы. Тома/сеть принадлежат отдельному проекту `lyakhonov-lab5`, образы — `lyakhonov-messenger:lab5`, `lyakhonov-storage:lab5`.
MinIO/mc собираются из официальных исходников: MinIO commit `07c3a429bfed433e49018cb0f78a52145d4bedeb`, mc `RELEASE.2025-04-16T18-13-26Z`. Архивы проверяются `ADD --checksum`, Go/Debian закреплены digest, Go modules — go.sum. Лицензии включены в образ. Сборка действительно прошла с использованием build cache; повторной недоступности официального MinIO-образа не утверждаю. Без кэша нужен доступ к Docker Hub/GitHub/Python package index/Go proxy.
Остановка с сохранением данных: `docker compose -p lyakhonov-lab5 down`. Только при намеренном удалении своих учебных данных: `docker compose -p lyakhonov-lab5 down --volumes`. В persistence/failover volumes не удаляются. POSIX: python3, `.venv/bin/python`, executable `scripts/restart.sh`/`stop-one.sh`; Windows использует `.cmd` hooks.
## Архитектура и перенос
```mermaid
flowchart LR
C[Клиент] --> LB[HAProxy :8085]
LB --> A[2 FastAPI API]
A --> DB[(PostgreSQL: metadata, sessions, messages, jobs/outbox)]
A --> S[(MinIO: staging и final)]
D[Dispatcher: publish confirm, recovery] --> DB
D --> Q[(RabbitMQ durable queue)]
Q --> W[2 worker, prefetch 1]
W --> S
W --> DB
SC[Staging cleaner] --> DB
SC --> S
```
Из собственной №4 перенесены мессенджер, Argon2id/серверные сессии, keyset-пагинация, транзакционная идемпотентность сообщений, Redis-кэш профилей, приватный S3, HAProxy и рецепты сборки. История №4 не копировалась. Материалы №5, contracts, публичные tests/fixtures/examples сохранены. Существующие коммиты временного клона №5 `5894da9`, `a0ec26d`, `e376ede` перенесены без переписывания. Первоначальные незакоммиченные файлы сохранены отдельной копией вне проекта до переключения ветки.
Изменения: upload `201 ready` → `202 queued`, устойчивый staging, jobs/outbox, отдельные broker/dispatcher/worker/cleaner, lease/retry/replay, versioned manifests. Reconciler исследования №4 не является обязательной частью №5; результаты №4 не выдаются за новые. №4 использована только для чтения: [fingerprint](evidence/lab4-baseline.json), [аудит](evidence/audit.json).
| Роль/сервис | Версия | Готовность и данные | CPU/RAM |
| --- | --- | --- | --- |
| Публичный smoke | make test | TODO | TODO |
| Остальные пункты уровня 3 | TODO | TODO | TODO |
| Все пункты уровня 4, если заявлен | TODO | TODO | TODO |
| Выбранный трек 5, если заявлен | TODO | TODO | TODO |
| `api` ×2 | Python 3.11.10, FastAPI 0.115.0 | readiness PostgreSQL+S3; без локального durable state | 0.5/640 MiB каждый |
| `db` | PostgreSQL 16.6-alpine | pg_isready, postgres_data | 1/512 MiB |
| `s3` | закреплённый MinIO commit | bucket-init, s3_data | 1/768 MiB |
| `broker` | RabbitMQ 4.1.0-alpine | diagnostics ping, broker_data | 0.75/512 MiB |
| `worker` ×2 | приложение, Pillow 12.0.0, pika 1.3.2 | отдельный процесс, manual ack, restart unless-stopped | 0.75/768 MiB каждый |
| `dispatcher` | приложение | publisher confirm, recovery deadlines | 0.5/256 MiB |
| `staging-cleaner` | приложение | цикл 30 s, locks и реестр | 0.25/256 MiB |
| `redis` | Redis 7.4.1-alpine | необязательный восстанавливаемый кэш | 0.25/128 MiB |
| `lb` | HAProxy 3.0.6-alpine | HTTP readiness backend, round-robin | 0.5/128 MiB |
TODO: добавить отдельную строку для каждого заявленного критерия. PASS без команды и наблюдения не является доказательством. Проверка инфраструктурного hook требует подтверждения, какие реальные процессы/хранилища перезапущены.
Сумма runtime-лимитов: **6.75 CPU/5376 MiB**, плюс одноразовые migrate/bucket-init и генератор. Это лимиты cgroup, не фактическое потребление. Полные зависимости закреплены в `requirements.lock.txt`. Graceful shutdown API — 8 s внутри 12 s Docker grace, worker — до 95 s; crash-тесты намеренно обходят graceful shutdown.
## Эксперименты и отказы
## Границы надёжности и инварианты
TODO: гипотеза, hardware/лимиты, версии, объём данных, профиль нагрузки, concurrency/arrival rate, длительность/прогрев, повторы, успешные RPS, ошибки, p50/p95/p99, CPU/RAM. Сохранить raw summary без tokens и объяснить ограничения измерения.
1. До 202 API принимает и проверяет **все** байты, пишет `staging/{attachment_id}` в приватный persistent S3; затем одной PostgreSQL-транзакцией создаёт attachment и job/outbox. Ответ — queued snapshot после COMMIT. Разрыв staging/DB может оставить неподтверждённый orphan; он не считается принятой задачей.
2. Dispatcher резервирует committed job с durable deadline 15 s, публикует ID/version/attempt/time, ждёт publisher confirm и отмечает публикацию. Смерть до publish или до отметки восстанавливается deadline и допускает повторную доставку. Байтов/credentials/произвольных URL в broker нет.
3. Логическая работа уникальна по `(attachment_id,pipeline_version)`, эффект по `(attachment_id,pipeline_version,variant)`. Claim блокирует attachment, затем job, сверяет envelope/attempt/target, выдаёт fencing token и lease. Дубль ready/processing или устаревшая версия не создаёт новую попытку. Durable lease восстанавливает работу владельца даже если другой дубль уже ack-нут.
4. Worker проверяет SHA-256/size staging, выполняет Pillow в отдельном subprocess, пишет immutable original и versioned variants с `If-None-Match: *`. Существующий key должен совпадать по metadata SHA-256/size/MIME. Manifest и ready публикуются одной DB-транзакцией только при актуальных token, lease и target version; затем ack.
5. Upgrade атомарно повышает target version и помечает старые активные jobs superseded. Старый живой worker может записать только keys своей версии и не может заменить новый manifest. Уже опубликованная v1 остаётся доступной до COMMIT v2; неуспешный upgrade виден в failed-реестре, прежний ready остаётся доступным.
6. Инварианты тестов: принятые задачи завершаются после исследованных сбоев; 3 manifest-записи на опубликованную версию; original/варианты скачиваются и совпадают с SHA-256; дубль не размножает keys; old job и old live worker не меняют published version/bytes v2.
| Воздействие | Что ожидаем | Что наблюдали | Время восстановления / потеря данных |
Это **at-least-once**, не exactly-once доставка. Повторяются доставка, resize и PUT; единственен логический опубликованный эффект. Publisher confirm — приём брокером, consumer ack — обработка доставки. Общей транзакции PostgreSQL/S3/RabbitMQ нет.
Версии `src/pipeline_versions.py`: v1 JPEG quality=85/WebP=82, v2 JPEG=90/WebP=88. Байты вариантов действительно отличаются; original неизменен. Thumbnail вписан в 256×256 без увеличения, floor/minimum 1 px; crop — центрированный JPEG 128×128; optimized — WebP в 1280×1280 без увеличения, method=4. EXIF orientation применяется, метаданные удаляются, alpha компонуется на белый. Уменьшение каждого маленького файла не обещается.
Ограничения: ≤10 MiB, ≤40 MP до полного decode, один upload/API-процесс, приём ≤20 s; worker subprocess timeout 60 s и worker cgroup 768 MiB. Lease по умолчанию 90 s, минимум timeout+5 s; prefetch=1. Для коротких fault-экспериментов использованы timeout=5 s/lease=10 s: [fault-environment.json](evidence/fault-environment.json). Их время восстановления нельзя объявлять временем production-конфигурации.
До 5 управляемых попыток. Backoff `min(30,2^(attempt-1))*uniform(0.75,1.25)` s. Invalid image/integrity/object conflict постоянны; S3/timeout временны; исчерпание — `retry_exhausted`. Failed-реестр хранится в PostgreSQL, отдельная DLQ не нужна. Replay проверяет доступность source, записывает audit и выдаёт новый ограниченный бюджет. Ready replay не выполняет.
```powershell
docker compose -p lyakhonov-lab5 exec -T --index 1 worker python -m src.operator failed
docker compose -p lyakhonov-lab5 exec -T --index 1 worker python -m src.operator replay ATTACHMENT_UUID
docker compose -p lyakhonov-lab5 exec -T --index 1 worker python -m src.operator upgrade ATTACHMENT_UUID --version 2
```
Это локальные операторские расширения, обязательные HTTP endpoint/схемы не изменены. Staging ready очищается после безопасного manifest; failed/orphan retention 86400 s, для failed отсчёт от settled_at. Queued/processing не удаляются. Cleanup и upload/replay/upgrade согласованы advisory locks. Финальные original и старые versioned variants автоматически не удаляются.
## Проверки и доказательства
| Критерий | Команда/сценарий | Наблюдение | Доказательство |
| --- | --- | --- | --- |
| TODO | TODO | TODO | TODO |
| Материалы/контракт | checker, validator, audit | структура, OpenAPI 3.1/JSON Schema, исходные материалы не изменены | [structure](evidence/structure.txt), [validation](evidence/validation.txt), [audit](evidence/audit.json) |
| Минимум №4 с новым upload | public smoke | auth, messages, pagination, ACL, идемпотентность, 202→ready, original/thumbnail | [smoke](evidence/smoke.txt) |
| Durable handoff/broker/worker | worker stop → upload/message → API+broker restart → worker start | тот же attachment ID доходит до ready | [pipeline](evidence/pipeline.json), [environment](evidence/environment.json) |
| Состояния и варианты | unit/negative/durable suite | queued/processing/ready/failed, реальные JPEG/WebP и checksums | [unit](evidence/unit.txt), [pipeline](evidence/pipeline.json) |
| Bytes/pixels/MIME/name/ACL | negative suite | 413/415/400/404, 24 конкурентных POST одного ключа дают 1 message ID | [pipeline](evidence/pipeline.json) |
| Outbox COMMIT→publish | before_publish ×3 | смерть dispatcher, автоматическое ready без ручной новой job | [pipeline](evidence/pipeline.json) |
| Publish→confirm bookkeeping | after_publish ×3 | смерть до DB-отметки, повтор безопасен | [pipeline](evidence/pipeline.json) |
| Lease/side effect/ack | before_effect, after_original, after_variants, after_commit ×3 | os._exit(91), restart; те же bytes и 3 manifest-записи | [pipeline](evidence/pipeline.json) |
| Retry/failed/replay | remove/corrupt staging | постоянный отказ за 1 попытку, временный — 5, replay с audit до ready | [pipeline](evidence/pipeline.json) |
| Очистка staging | cleanup после ready → upgrade | v2 построена из immutable original после очистки | [pipeline](evidence/pipeline.json) |
| Трек 2: duplicate/reorder/stale | version suite ×3 | 52 явно опубликованных сообщения/повтор, старая paused попытка освобождена после v2, новый результат сохранён | [pipeline](evidence/pipeline.json) |
| Persistence stores | resilience_driver | публичный persistence и реальные StartedAt API/DB/S3/broker/Redis | [persistence](evidence/persistence.json) |
| Failover API | resilience_driver | публичный failover + отдельная остановка каждой API, сохранность подтверждений | [public](evidence/failover.json), [каждая API](evidence/failover-each.json) |
| Нагрузка полного pipeline | load_pipeline | completed images, ready latency, ошибки, CPU/memory | [load](evidence/load-pipeline.json) |
| Чистое воспроизведение | scripts/reproduce.py | Git export, новые secrets/images/project/volumes/port, build+smoke, cleanup своих временных ресурсов | [reproduction](evidence/reproduction.json) |
## Ограничения и следующие шаги
Fault hooks выключены по умолчанию, включаются только окружением `LAB5_FAULT_INJECTION=1`, не через HTTP. `experiment_faults` фиксирует arm/hit/process_id. Crash — реальная смерть процесса без finally/ack. Pause удерживает старую попытку до публикации новой. Каждый arm одноразовый.
TODO: какие отказы выдерживаются и какие нет; что не реализовано; где учебное упрощение; какое улучшение подтверждено, а какое пока гипотеза.
Одноразовый `inspector` профиля `tools` нужен только операторскому тесту списка S3-объектов; он не запускается обычным `up` и не публикует порты. Root credentials монтируются только в этот одноразовый процесс и bucket-init. Приложению список final-prefix не разрешён: первый запуск тестового probe получил `AccessDenied`, что сохранено в `pipeline-initial-run.txt`. Инспектор исправлен без расширения policy приложения; crash-результаты сохранены, version/error suite продолжен с `--resume`.
```powershell
$env:LAB5_FAULT_INJECTION='1'
$env:JOB_TIMEOUT_SECONDS='5'
$env:JOB_LEASE_SECONDS='10'
docker compose -p lyakhonov-lab5 up -d
python scripts/wait_ready.py
python student-tests/pipeline.py --repeats 3
Remove-Item Env:LAB5_FAULT_INJECTION,Env:JOB_TIMEOUT_SECONDS,Env:JOB_LEASE_SECONDS
docker compose -p lyakhonov-lab5 up -d
python scripts/wait_ready.py
python student-tests/load_pipeline.py --duration 20 --concurrency 2 --repeats 3
python tests/load.py --base-url http://127.0.0.1:8085 --duration 30 --concurrency 4 --output evidence/load-messages.json
python scripts/environment.py
python scripts/reproduce.py
python scripts/audit.py
```
## Методика и результаты
Гипотеза: fencing публикации manifest и immutable versioned S3 keys сохраняют принятые задачи и результат новой версии при дублях, reorder и процессных crash/restart в исследованной модели.
Fault suite использует fixture 320×200, 111817 bytes. Шесть окон crash ×3 повтора. График показывает **полную длительность сценария** (stop, upload, start, ready, downloads), не чистую latency восстановления. Сохранены ID/StartedAt и состояния до/после, checksums всех четырёх скачанных результатов.
![Реальные crash-сценарии](evidence/faults.png)
Нагрузка closed-loop: 2 клиента, 20 s запуска операций, один завершённый warmup/профиль/повтор, 3 повтора. Профили: публичный PNG 320×200 и детерминированный RGB PNG 1024×768 с псевдослучайными пикселями. Клиент ждёт **ready и три варианта**, затем начинает следующий upload. Знаменатель successful RPS — фактическая длительность с завершением последней операции. Ошибки сохраняются, прозрачных retry upload нет. Длительность включает передачу bytes, очередь, обработку и polling.
<!-- MEASUREMENTS BEGIN -->
| Профиль | Bytes/image | Завершено за 3 повтора | Успешных image/s (min–max) | p50 ready, s | p95 ready, s | p99 ready, s | Ошибки |
| --- | --- | --- | --- | --- | --- | --- | --- |
| 1024x768 | 2360847 | 117 | 1.569–2.188 | 0.790–1.067 | 1.140–1.230 | 1.161–1.322 | 1 |
| 320x200 | 111817 | 224 | 3.549–3.982 | 0.401–0.439 | 0.727–0.769 | 0.744–0.820 | 0 |
В собранных snapshots максимальная сумма CPU контейнеров: **218.3%** (100% = один CPU); сумма cgroup memory: **1047.5 MiB**. Это максимум редких снимков, не непрерывно измеренный пик.
| Точка crash | Повторов | Полная длительность сценария, s (min–max) |
| --- | --- | --- |
| before_publish | 3 | 28.940–32.205 |
| after_publish | 3 | 14.478–16.650 |
| before_effect | 3 | 25.678–28.623 |
| after_original | 3 | 25.642–26.509 |
| after_variants | 3 | 25.458–27.131 |
| after_commit | 3 | 14.989–17.081 |
Во всех сохранённых crash/version/replay-сценариях проверки инвариантов прошли. Увеличение входного изображения снижает throughput и повышает время до ready в измеренном профиле. Повторы показывают разброс, а не статистически надёжную оценку хвостов: выборка и длительность малы.
<!-- MEASUREMENTS END -->
![Throughput и p95 полного pipeline](evidence/load.png)
`docker stats --no-stream` собирается примерно раз в 2–4 s параллельно нагрузке: CPU%, cgroup memory/limits по контейнерам. Редкие snapshots могут пропустить пики и **не являются точным RSS**. Генератор на том же ноутбуке; polling 0.3 s добавляет квантование/coordinated omission. Это не доказательство максимальной производительности/SLA. Дополнительный публичный POST-message load — [load-messages.json](evidence/load-messages.json).
В профиле 1024×768 во втором повторе сохранена **одна ошибка GET соединения `URLError`** (1/33 наблюдавшихся операций, 3.03% этого повтора). Её причина не установлена: публичный helper не сохраняет низкоуровневую причину URLError. Повтор ради удаления ошибки из статистики не выполнялся. Вложение `63d3337b-5ac0-478b-9e30-cde11dd2fd07`, для которого клиент уже получил 202, отдельно найдено ready с актуальным manifest: [final-state.json](evidence/final-state.json). Финальная проверка всех вложений обнаружила ноль нарушений готовности/версии/числа вариантов. Ошибка наблюдения остаётся ошибкой генератора, а не успешной операцией в RPS.
Публичная нагрузка сообщений: 4 клиента, 30.112 s, 2507 успешных POST, 0 ошибок, **83.256 successful RPS**, p50/p95/p99 успешных запросов **25.341/146.956/251.292 ms**. Это один дополнительный запуск, не серия для оценки максимума; CPU/memory snapshots — [load-messages-resources.json](evidence/load-messages-resources.json).
Графики и таблица воспроизводятся из агрегатов:
```powershell
.venv/Scripts/python -m pip install -r requirements-research.txt
.venv/Scripts/python scripts/plot_results.py
python scripts/summarize.py
python scripts/final_state.py
```
Matplotlib 3.10.7 нужен только для графиков. Вспомогательный targeted-failover driver был исправлен после ошибки чтения JSON без указания schema публичному Client; сервер не менялся, публичные persistence/failover уже прошли, обе остановки затем проверены исправленным driver. Первичный вывод сохранён в `resilience-initial-run.txt`. В этой версии Compose `up --wait` ошибочно потребовал healthcheck отключённых background services; запуск использует `up -d` и явный `scripts/wait_ready.py`, после которого smoke проверяет реальную обработку.
## Ограничения
Проверены процессные crash/restart с сохранёнными volumes на одном Docker-host. Не исследованы потеря диска/host, порча опубликованных объектов, византийские компоненты или multi-node split-brain. DB/S3/broker/LB одиночные. Durable classic queue одного брокера не даёт multi-node HA. После confirm предполагается сохранность broker volume; полная потеря этого volume вне модели.
Нет общей транзакции PostgreSQL/S3. Неподтверждённая загрузка может оставить staging orphan до cleanup. Объекты superseded версии могут остаться недоступными через API; их GC не реализован. Повтор immutable PUT доверяет metadata SHA-256/size/MIME существующего object; runtime не перечитывает все его bytes. Тесты отдельно скачивают и пересчитывают bytes, но намеренная внешняя порча после ready этим pipeline не исправляется.
Cgroup ограничивает весь worker, а не гарантирует обработку любого допустимого 40-MP изображения: OOM может убить worker, затем lease/retry завершают ready либо failed. Subprocess не является полной security sandbox. Стенд с синтетическими данными предназначен для loopback.
## Источники и ИИ
- Нормативные README/COURSE/contracts/tests текущей №5 и собственная база №4; результаты измерены заново.
- [RabbitMQ confirms/acknowledgements](https://www.rabbitmq.com/docs/confirms): независимые границы подтверждения.
- [S3 conditional writes](https://docs.aws.amazon.com/AmazonS3/latest/userguide/conditional-writes.html): If-None-Match; совместимость закреплённого MinIO проверена повторными записями.
- [Pillow ImageOps](https://pillow.readthedocs.io/en/stable/reference/ImageOps.html): EXIF transpose/fit; фактическая версия 12.0.0 в lockfile.
- [MinIO source](https://github.com/minio/minio/tree/07c3a429bfed433e49018cb0f78a52145d4bedeb), [mc source](https://github.com/minio/mc/tree/RELEASE.2025-04-16T18-13-26Z).
Codex использован для анализа, переноса сохранённой работы, доработки кода, сценариев, запуска экспериментов и отчёта. PASS относится только к фактически выполненным проверкам. Автор должен понимать и уметь объяснить решение на защите.
+13
View File
@@ -0,0 +1,13 @@
{
"lab4_unchanged": true,
"protected_lab5_unchanged": true,
"tracked_local_secrets": false,
"scanned_files": 130,
"authors": [
"42bf6aa|Sergey Lyakhonov|lyserg119@gmail.com|Sergey Lyakhonov|lyserg119@gmail.com",
"e376ede|Sergey Lyakhonov|lyserg119@gmail.com|Sergey Lyakhonov|lyserg119@gmail.com",
"a0ec26d|Sergey Lyakhonov|lyserg119@gmail.com|Sergey Lyakhonov|lyserg119@gmail.com",
"5894da9|Sergey Lyakhonov|lyserg119@gmail.com|Sergey Lyakhonov|lyserg119@gmail.com"
],
"head": "42bf6aa702dab9270fc13d7b80df13dfca089ef8"
}
+263
View File
@@ -0,0 +1,263 @@
{
"commit": "42bf6aa702dab9270fc13d7b80df13dfca089ef8",
"python": "3.13.7",
"working_tree_dirty": true,
"docker": {
"Client": {
"Version": "28.5.1",
"ApiVersion": "1.51",
"DefaultAPIVersion": "1.51",
"GitCommit": "e180ab8",
"GoVersion": "go1.24.8",
"Os": "windows",
"Arch": "amd64",
"BuildTime": "Wed Oct 8 12:19:16 2025",
"Context": "desktop-linux"
},
"Server": {
"Platform": {
"Name": "Docker Desktop 4.49.0 (208700)"
},
"Components": [
{
"Name": "Engine",
"Version": "28.5.1",
"Details": {
"ApiVersion": "1.51",
"Arch": "amd64",
"BuildTime": "Wed Oct 8 12:17:24 2025",
"Experimental": "false",
"GitCommit": "f8215cc",
"GoVersion": "go1.24.8",
"KernelVersion": "6.6.87.2-microsoft-standard-WSL2",
"MinAPIVersion": "1.24",
"Os": "linux"
}
},
{
"Name": "containerd",
"Version": "1.7.27",
"Details": {
"GitCommit": "05044ec0a9a75232cad458027ca83437aae3f4da"
}
},
{
"Name": "runc",
"Version": "1.2.5",
"Details": {
"GitCommit": "v1.2.5-0-g59923ef"
}
},
{
"Name": "docker-init",
"Version": "0.19.0",
"Details": {
"GitCommit": "de40ad0"
}
}
],
"Version": "28.5.1",
"ApiVersion": "1.51",
"MinAPIVersion": "1.24",
"GitCommit": "f8215cc",
"GoVersion": "go1.24.8",
"Os": "linux",
"Arch": "amd64",
"KernelVersion": "6.6.87.2-microsoft-standard-WSL2",
"BuildTime": "2025-10-08T12:17:24.000000000+00:00"
}
},
"compose": "Docker Compose version v2.40.3-desktop.1",
"engine": {
"memory_bytes": 8126664704,
"cpus": 16
},
"services": [
{
"service": "api",
"id": "b3f8a331a59832dde80002af9f29c5893381e780803283476c687168ede15842",
"image": "lyakhonov-messenger:lab5",
"image_id": "sha256:2153c7be14d77d6d6e0337a445cca1feb814bef892dfaae459d9a28ce31494a4",
"started_at": "2026-11-20T04:00:04.137137202Z",
"restart_count": 0,
"oom_killed": false,
"memory_limit": 671088640,
"nanocpus": 500000000,
"ports": {},
"settings": [
"JOB_MAX_ATTEMPTS=5",
"JOB_TIMEOUT_SECONDS=60",
"STAGING_RETENTION_SECONDS=86400",
"JOB_LEASE_SECONDS=90",
"LAB5_FAULT_INJECTION=0"
]
},
{
"service": "api",
"id": "a0acb99b68a1f803792742460827528137ac3ab96ec76a68de550f930a4a9368",
"image": "lyakhonov-messenger:lab5",
"image_id": "sha256:2153c7be14d77d6d6e0337a445cca1feb814bef892dfaae459d9a28ce31494a4",
"started_at": "2026-11-20T04:00:23.843924506Z",
"restart_count": 0,
"oom_killed": false,
"memory_limit": 671088640,
"nanocpus": 500000000,
"ports": {},
"settings": [
"LAB5_FAULT_INJECTION=0",
"STAGING_RETENTION_SECONDS=86400",
"JOB_MAX_ATTEMPTS=5",
"JOB_LEASE_SECONDS=90",
"JOB_TIMEOUT_SECONDS=60"
]
},
{
"service": "broker",
"id": "b94a25ac1bb3df998e3d0c27beae4b97d655bbc0a7ae520bd60c736cd40462c9",
"image": "rabbitmq:4.1.0-alpine",
"image_id": "sha256:8a73e9185f8420247c5b3c19231df18dfac28a8d5706203e13b291934044966d",
"started_at": "2026-11-20T03:58:31.88055044Z",
"restart_count": 0,
"oom_killed": false,
"memory_limit": 536870912,
"nanocpus": 750000000,
"ports": {},
"settings": []
},
{
"service": "db",
"id": "10408d41f3b50b0a5e8ad4e21b849fa97548c03f4a535b27c8c919163b9c30b2",
"image": "postgres:16.6-alpine",
"image_id": "sha256:1d04b9ba1d4996401f2552b51beda8187f175c0645c091e4781134fc9c9a3eef",
"started_at": "2026-11-20T03:58:30.504381937Z",
"restart_count": 0,
"oom_killed": false,
"memory_limit": 536870912,
"nanocpus": 1000000000,
"ports": {},
"settings": []
},
{
"service": "dispatcher",
"id": "bdedd08309bb0db9dc94235a148fc0938180449b1431059178488d0c6f985049",
"image": "lyakhonov-messenger:lab5",
"image_id": "sha256:2153c7be14d77d6d6e0337a445cca1feb814bef892dfaae459d9a28ce31494a4",
"started_at": "2026-11-20T03:58:31.312524166Z",
"restart_count": 0,
"oom_killed": false,
"memory_limit": 268435456,
"nanocpus": 500000000,
"ports": {},
"settings": [
"JOB_TIMEOUT_SECONDS=60",
"STAGING_RETENTION_SECONDS=86400",
"JOB_LEASE_SECONDS=90",
"LAB5_FAULT_INJECTION=0",
"JOB_MAX_ATTEMPTS=5"
]
},
{
"service": "lb",
"id": "934fcb61b954722ec6f9d3ce84d3399f5a35a30e8368e0ed44a939319ea9ff4f",
"image": "haproxy:3.0.6-alpine",
"image_id": "sha256:c22c8710886104a48b920306f063401f0d11811858e3c6b9d87d88a7556b2e61",
"started_at": "2026-11-20T03:58:30.862509137Z",
"restart_count": 0,
"oom_killed": false,
"memory_limit": 134217728,
"nanocpus": 500000000,
"ports": {
"8080/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "8085"
}
]
},
"settings": []
},
{
"service": "redis",
"id": "c3962c31749b802835f909ce1b4efbe34149e88d9bc678ca3b82f9fdbcc97af1",
"image": "redis:7.4.1-alpine",
"image_id": "sha256:c1e88455c85225310bbea54816e9c3f4b5295815e6dbf80c34d40afc6df28275",
"started_at": "2026-11-20T03:58:30.614258194Z",
"restart_count": 0,
"oom_killed": false,
"memory_limit": 134217728,
"nanocpus": 250000000,
"ports": {},
"settings": []
},
{
"service": "s3",
"id": "0b09dce985685e130ed8774a277a3ff254e8a633ff1dfeed7fd2daf80b78c4e8",
"image": "lyakhonov-storage:lab5",
"image_id": "sha256:88795615d5dbc1a5618ff618334251801720cb8ba30ca34d65d6b0ad508a2afe",
"started_at": "2026-11-20T03:58:31.091098179Z",
"restart_count": 0,
"oom_killed": false,
"memory_limit": 805306368,
"nanocpus": 1000000000,
"ports": {},
"settings": []
},
{
"service": "staging-cleaner",
"id": "23b814fb71a813bedb09712be57c736e19460c2c25d2b2b4b0e66facb0bfdab9",
"image": "lyakhonov-messenger:lab5",
"image_id": "sha256:2153c7be14d77d6d6e0337a445cca1feb814bef892dfaae459d9a28ce31494a4",
"started_at": "2026-11-20T03:58:31.667560755Z",
"restart_count": 0,
"oom_killed": false,
"memory_limit": 268435456,
"nanocpus": 250000000,
"ports": {},
"settings": [
"JOB_MAX_ATTEMPTS=5",
"JOB_TIMEOUT_SECONDS=60",
"LAB5_FAULT_INJECTION=0",
"JOB_LEASE_SECONDS=90",
"STAGING_RETENTION_SECONDS=86400"
]
},
{
"service": "worker",
"id": "1f724278797561aea476251a8902eac6377039c3e30cbc336d501409af118ae2",
"image": "lyakhonov-messenger:lab5",
"image_id": "sha256:2153c7be14d77d6d6e0337a445cca1feb814bef892dfaae459d9a28ce31494a4",
"started_at": "2026-11-20T03:58:31.445500705Z",
"restart_count": 0,
"oom_killed": false,
"memory_limit": 805306368,
"nanocpus": 750000000,
"ports": {},
"settings": [
"STAGING_RETENTION_SECONDS=86400",
"LAB5_FAULT_INJECTION=0",
"JOB_MAX_ATTEMPTS=5",
"JOB_TIMEOUT_SECONDS=60",
"JOB_LEASE_SECONDS=90"
]
},
{
"service": "worker",
"id": "e36e30c0bc23ffdc3c2c4fe39b57ea98597764dfa313c509bd1734d74b801b44",
"image": "lyakhonov-messenger:lab5",
"image_id": "sha256:2153c7be14d77d6d6e0337a445cca1feb814bef892dfaae459d9a28ce31494a4",
"started_at": "2026-11-20T03:58:31.518418339Z",
"restart_count": 0,
"oom_killed": false,
"memory_limit": 805306368,
"nanocpus": 750000000,
"ports": {},
"settings": [
"JOB_TIMEOUT_SECONDS=60",
"LAB5_FAULT_INJECTION=0",
"JOB_MAX_ATTEMPTS=5",
"JOB_LEASE_SECONDS=90",
"STAGING_RETENTION_SECONDS=86400"
]
}
]
}
+336
View File
@@ -0,0 +1,336 @@
[
{
"target": "b3f8a331a59832dde80002af9f29c5893381e780803283476c687168ede15842",
"before": [
{
"id": "b3f8a331a59832dde80002af9f29c5893381e780803283476c687168ede15842",
"name": "/lyakhonov-lab5-api-1",
"started_at": "2026-11-20T03:59:21.0995573Z",
"running": true
},
{
"id": "a0acb99b68a1f803792742460827528137ac3ab96ec76a68de550f930a4a9368",
"name": "/lyakhonov-lab5-api-2",
"started_at": "2026-11-20T03:59:04.166647284Z",
"running": true
},
{
"id": "b94a25ac1bb3df998e3d0c27beae4b97d655bbc0a7ae520bd60c736cd40462c9",
"name": "/lyakhonov-lab5-broker-1",
"started_at": "2026-11-20T03:58:31.88055044Z",
"running": true
},
{
"id": "fdca00783fcb86e75d3ec4c84494d1571548333d585459191b78992f707729ad",
"name": "/lyakhonov-lab5-bucket-init-1",
"started_at": "2026-11-20T03:59:01.428198308Z",
"running": false
},
{
"id": "10408d41f3b50b0a5e8ad4e21b849fa97548c03f4a535b27c8c919163b9c30b2",
"name": "/lyakhonov-lab5-db-1",
"started_at": "2026-11-20T03:58:30.504381937Z",
"running": true
},
{
"id": "bdedd08309bb0db9dc94235a148fc0938180449b1431059178488d0c6f985049",
"name": "/lyakhonov-lab5-dispatcher-1",
"started_at": "2026-11-20T03:58:31.312524166Z",
"running": true
},
{
"id": "934fcb61b954722ec6f9d3ce84d3399f5a35a30e8368e0ed44a939319ea9ff4f",
"name": "/lyakhonov-lab5-lb-1",
"started_at": "2026-11-20T03:58:30.862509137Z",
"running": true
},
{
"id": "39b8b11f3c7c9e1c3fb778e780dc8d123e4b955669ddee8c85420eefcb3abaca",
"name": "/lyakhonov-lab5-migrate-1",
"started_at": "2026-11-20T03:59:01.96581278Z",
"running": false
},
{
"id": "c3962c31749b802835f909ce1b4efbe34149e88d9bc678ca3b82f9fdbcc97af1",
"name": "/lyakhonov-lab5-redis-1",
"started_at": "2026-11-20T03:58:30.614258194Z",
"running": true
},
{
"id": "0b09dce985685e130ed8774a277a3ff254e8a633ff1dfeed7fd2daf80b78c4e8",
"name": "/lyakhonov-lab5-s3-1",
"started_at": "2026-11-20T03:58:31.091098179Z",
"running": true
},
{
"id": "23b814fb71a813bedb09712be57c736e19460c2c25d2b2b4b0e66facb0bfdab9",
"name": "/lyakhonov-lab5-staging-cleaner-1",
"started_at": "2026-11-20T03:58:31.667560755Z",
"running": true
},
{
"id": "1f724278797561aea476251a8902eac6377039c3e30cbc336d501409af118ae2",
"name": "/lyakhonov-lab5-worker-1",
"started_at": "2026-11-20T03:58:31.445500705Z",
"running": true
},
{
"id": "e36e30c0bc23ffdc3c2c4fe39b57ea98597764dfa313c509bd1734d74b801b44",
"name": "/lyakhonov-lab5-worker-2",
"started_at": "2026-11-20T03:58:31.518418339Z",
"running": true
}
],
"after": [
{
"id": "b3f8a331a59832dde80002af9f29c5893381e780803283476c687168ede15842",
"name": "/lyakhonov-lab5-api-1",
"started_at": "2026-11-20T03:59:21.0995573Z",
"running": false
},
{
"id": "a0acb99b68a1f803792742460827528137ac3ab96ec76a68de550f930a4a9368",
"name": "/lyakhonov-lab5-api-2",
"started_at": "2026-11-20T03:59:04.166647284Z",
"running": true
},
{
"id": "b94a25ac1bb3df998e3d0c27beae4b97d655bbc0a7ae520bd60c736cd40462c9",
"name": "/lyakhonov-lab5-broker-1",
"started_at": "2026-11-20T03:58:31.88055044Z",
"running": true
},
{
"id": "fdca00783fcb86e75d3ec4c84494d1571548333d585459191b78992f707729ad",
"name": "/lyakhonov-lab5-bucket-init-1",
"started_at": "2026-11-20T03:59:01.428198308Z",
"running": false
},
{
"id": "10408d41f3b50b0a5e8ad4e21b849fa97548c03f4a535b27c8c919163b9c30b2",
"name": "/lyakhonov-lab5-db-1",
"started_at": "2026-11-20T03:58:30.504381937Z",
"running": true
},
{
"id": "bdedd08309bb0db9dc94235a148fc0938180449b1431059178488d0c6f985049",
"name": "/lyakhonov-lab5-dispatcher-1",
"started_at": "2026-11-20T03:58:31.312524166Z",
"running": true
},
{
"id": "934fcb61b954722ec6f9d3ce84d3399f5a35a30e8368e0ed44a939319ea9ff4f",
"name": "/lyakhonov-lab5-lb-1",
"started_at": "2026-11-20T03:58:30.862509137Z",
"running": true
},
{
"id": "39b8b11f3c7c9e1c3fb778e780dc8d123e4b955669ddee8c85420eefcb3abaca",
"name": "/lyakhonov-lab5-migrate-1",
"started_at": "2026-11-20T03:59:01.96581278Z",
"running": false
},
{
"id": "c3962c31749b802835f909ce1b4efbe34149e88d9bc678ca3b82f9fdbcc97af1",
"name": "/lyakhonov-lab5-redis-1",
"started_at": "2026-11-20T03:58:30.614258194Z",
"running": true
},
{
"id": "0b09dce985685e130ed8774a277a3ff254e8a633ff1dfeed7fd2daf80b78c4e8",
"name": "/lyakhonov-lab5-s3-1",
"started_at": "2026-11-20T03:58:31.091098179Z",
"running": true
},
{
"id": "23b814fb71a813bedb09712be57c736e19460c2c25d2b2b4b0e66facb0bfdab9",
"name": "/lyakhonov-lab5-staging-cleaner-1",
"started_at": "2026-11-20T03:58:31.667560755Z",
"running": true
},
{
"id": "1f724278797561aea476251a8902eac6377039c3e30cbc336d501409af118ae2",
"name": "/lyakhonov-lab5-worker-1",
"started_at": "2026-11-20T03:58:31.445500705Z",
"running": true
},
{
"id": "e36e30c0bc23ffdc3c2c4fe39b57ea98597764dfa313c509bd1734d74b801b44",
"name": "/lyakhonov-lab5-worker-2",
"started_at": "2026-11-20T03:58:31.518418339Z",
"running": true
}
],
"successes": 182,
"errors": [],
"recovery_seconds": 1.011
},
{
"target": "a0acb99b68a1f803792742460827528137ac3ab96ec76a68de550f930a4a9368",
"before": [
{
"id": "b3f8a331a59832dde80002af9f29c5893381e780803283476c687168ede15842",
"name": "/lyakhonov-lab5-api-1",
"started_at": "2026-11-20T04:00:04.137137202Z",
"running": true
},
{
"id": "a0acb99b68a1f803792742460827528137ac3ab96ec76a68de550f930a4a9368",
"name": "/lyakhonov-lab5-api-2",
"started_at": "2026-11-20T03:59:04.166647284Z",
"running": true
},
{
"id": "b94a25ac1bb3df998e3d0c27beae4b97d655bbc0a7ae520bd60c736cd40462c9",
"name": "/lyakhonov-lab5-broker-1",
"started_at": "2026-11-20T03:58:31.88055044Z",
"running": true
},
{
"id": "fdca00783fcb86e75d3ec4c84494d1571548333d585459191b78992f707729ad",
"name": "/lyakhonov-lab5-bucket-init-1",
"started_at": "2026-11-20T03:59:01.428198308Z",
"running": false
},
{
"id": "10408d41f3b50b0a5e8ad4e21b849fa97548c03f4a535b27c8c919163b9c30b2",
"name": "/lyakhonov-lab5-db-1",
"started_at": "2026-11-20T03:58:30.504381937Z",
"running": true
},
{
"id": "bdedd08309bb0db9dc94235a148fc0938180449b1431059178488d0c6f985049",
"name": "/lyakhonov-lab5-dispatcher-1",
"started_at": "2026-11-20T03:58:31.312524166Z",
"running": true
},
{
"id": "934fcb61b954722ec6f9d3ce84d3399f5a35a30e8368e0ed44a939319ea9ff4f",
"name": "/lyakhonov-lab5-lb-1",
"started_at": "2026-11-20T03:58:30.862509137Z",
"running": true
},
{
"id": "39b8b11f3c7c9e1c3fb778e780dc8d123e4b955669ddee8c85420eefcb3abaca",
"name": "/lyakhonov-lab5-migrate-1",
"started_at": "2026-11-20T03:59:01.96581278Z",
"running": false
},
{
"id": "c3962c31749b802835f909ce1b4efbe34149e88d9bc678ca3b82f9fdbcc97af1",
"name": "/lyakhonov-lab5-redis-1",
"started_at": "2026-11-20T03:58:30.614258194Z",
"running": true
},
{
"id": "0b09dce985685e130ed8774a277a3ff254e8a633ff1dfeed7fd2daf80b78c4e8",
"name": "/lyakhonov-lab5-s3-1",
"started_at": "2026-11-20T03:58:31.091098179Z",
"running": true
},
{
"id": "23b814fb71a813bedb09712be57c736e19460c2c25d2b2b4b0e66facb0bfdab9",
"name": "/lyakhonov-lab5-staging-cleaner-1",
"started_at": "2026-11-20T03:58:31.667560755Z",
"running": true
},
{
"id": "1f724278797561aea476251a8902eac6377039c3e30cbc336d501409af118ae2",
"name": "/lyakhonov-lab5-worker-1",
"started_at": "2026-11-20T03:58:31.445500705Z",
"running": true
},
{
"id": "e36e30c0bc23ffdc3c2c4fe39b57ea98597764dfa313c509bd1734d74b801b44",
"name": "/lyakhonov-lab5-worker-2",
"started_at": "2026-11-20T03:58:31.518418339Z",
"running": true
}
],
"after": [
{
"id": "b3f8a331a59832dde80002af9f29c5893381e780803283476c687168ede15842",
"name": "/lyakhonov-lab5-api-1",
"started_at": "2026-11-20T04:00:04.137137202Z",
"running": true
},
{
"id": "a0acb99b68a1f803792742460827528137ac3ab96ec76a68de550f930a4a9368",
"name": "/lyakhonov-lab5-api-2",
"started_at": "2026-11-20T03:59:04.166647284Z",
"running": false
},
{
"id": "b94a25ac1bb3df998e3d0c27beae4b97d655bbc0a7ae520bd60c736cd40462c9",
"name": "/lyakhonov-lab5-broker-1",
"started_at": "2026-11-20T03:58:31.88055044Z",
"running": true
},
{
"id": "fdca00783fcb86e75d3ec4c84494d1571548333d585459191b78992f707729ad",
"name": "/lyakhonov-lab5-bucket-init-1",
"started_at": "2026-11-20T03:59:01.428198308Z",
"running": false
},
{
"id": "10408d41f3b50b0a5e8ad4e21b849fa97548c03f4a535b27c8c919163b9c30b2",
"name": "/lyakhonov-lab5-db-1",
"started_at": "2026-11-20T03:58:30.504381937Z",
"running": true
},
{
"id": "bdedd08309bb0db9dc94235a148fc0938180449b1431059178488d0c6f985049",
"name": "/lyakhonov-lab5-dispatcher-1",
"started_at": "2026-11-20T03:58:31.312524166Z",
"running": true
},
{
"id": "934fcb61b954722ec6f9d3ce84d3399f5a35a30e8368e0ed44a939319ea9ff4f",
"name": "/lyakhonov-lab5-lb-1",
"started_at": "2026-11-20T03:58:30.862509137Z",
"running": true
},
{
"id": "39b8b11f3c7c9e1c3fb778e780dc8d123e4b955669ddee8c85420eefcb3abaca",
"name": "/lyakhonov-lab5-migrate-1",
"started_at": "2026-11-20T03:59:01.96581278Z",
"running": false
},
{
"id": "c3962c31749b802835f909ce1b4efbe34149e88d9bc678ca3b82f9fdbcc97af1",
"name": "/lyakhonov-lab5-redis-1",
"started_at": "2026-11-20T03:58:30.614258194Z",
"running": true
},
{
"id": "0b09dce985685e130ed8774a277a3ff254e8a633ff1dfeed7fd2daf80b78c4e8",
"name": "/lyakhonov-lab5-s3-1",
"started_at": "2026-11-20T03:58:31.091098179Z",
"running": true
},
{
"id": "23b814fb71a813bedb09712be57c736e19460c2c25d2b2b4b0e66facb0bfdab9",
"name": "/lyakhonov-lab5-staging-cleaner-1",
"started_at": "2026-11-20T03:58:31.667560755Z",
"running": true
},
{
"id": "1f724278797561aea476251a8902eac6377039c3e30cbc336d501409af118ae2",
"name": "/lyakhonov-lab5-worker-1",
"started_at": "2026-11-20T03:58:31.445500705Z",
"running": true
},
{
"id": "e36e30c0bc23ffdc3c2c4fe39b57ea98597764dfa313c509bd1734d74b801b44",
"name": "/lyakhonov-lab5-worker-2",
"started_at": "2026-11-20T03:58:31.518418339Z",
"running": true
}
],
"successes": 176,
"errors": [
"POST /api/v1/chats/6ba7728e-901a-4ce8-99ec-ff8a6495b5fa/messages: expected [201], received 503"
],
"recovery_seconds": 1.932
}
]
+1
View File
@@ -0,0 +1 @@
PASS: both real API containers independently stopped and restored
+176
View File
@@ -0,0 +1,176 @@
{
"command": [
"C:\\Users\\User\\AppData\\Local\\Programs\\Python\\Python313\\python.exe",
"-X",
"utf8",
"tests/resilience.py",
"--mode",
"failover",
"--base-url",
"http://127.0.0.1:8085",
"--action-script",
"C:\\Users\\User\\Desktop\\vysoko-nagr 5\\scripts\\stop-one.cmd"
],
"exit_code": 0,
"output": "Executing explicit failover hook; hook output suppressed to avoid leaking secrets.\n{\"observed_instances_before\": 2, \"successful_writes\": 88, \"failed_attempts\": 4, \"first_recovery_seconds\": 2.856}\nPASS: failover preserved confirmed data and existing session. Hook scope needs operator evidence.\n",
"before": [
{
"id": "b3f8a331a59832dde80002af9f29c5893381e780803283476c687168ede15842",
"name": "/lyakhonov-lab5-api-1",
"started_at": "2026-11-20T03:58:31.589874697Z",
"running": true
},
{
"id": "a0acb99b68a1f803792742460827528137ac3ab96ec76a68de550f930a4a9368",
"name": "/lyakhonov-lab5-api-2",
"started_at": "2026-11-20T03:58:31.785178375Z",
"running": true
},
{
"id": "b94a25ac1bb3df998e3d0c27beae4b97d655bbc0a7ae520bd60c736cd40462c9",
"name": "/lyakhonov-lab5-broker-1",
"started_at": "2026-11-20T03:58:31.88055044Z",
"running": true
},
{
"id": "fdca00783fcb86e75d3ec4c84494d1571548333d585459191b78992f707729ad",
"name": "/lyakhonov-lab5-bucket-init-1",
"started_at": "2026-11-20T03:58:36.540744301Z",
"running": false
},
{
"id": "10408d41f3b50b0a5e8ad4e21b849fa97548c03f4a535b27c8c919163b9c30b2",
"name": "/lyakhonov-lab5-db-1",
"started_at": "2026-11-20T03:58:30.504381937Z",
"running": true
},
{
"id": "bdedd08309bb0db9dc94235a148fc0938180449b1431059178488d0c6f985049",
"name": "/lyakhonov-lab5-dispatcher-1",
"started_at": "2026-11-20T03:58:31.312524166Z",
"running": true
},
{
"id": "934fcb61b954722ec6f9d3ce84d3399f5a35a30e8368e0ed44a939319ea9ff4f",
"name": "/lyakhonov-lab5-lb-1",
"started_at": "2026-11-20T03:58:30.862509137Z",
"running": true
},
{
"id": "39b8b11f3c7c9e1c3fb778e780dc8d123e4b955669ddee8c85420eefcb3abaca",
"name": "/lyakhonov-lab5-migrate-1",
"started_at": "2026-11-20T03:58:37.048579415Z",
"running": false
},
{
"id": "c3962c31749b802835f909ce1b4efbe34149e88d9bc678ca3b82f9fdbcc97af1",
"name": "/lyakhonov-lab5-redis-1",
"started_at": "2026-11-20T03:58:30.614258194Z",
"running": true
},
{
"id": "0b09dce985685e130ed8774a277a3ff254e8a633ff1dfeed7fd2daf80b78c4e8",
"name": "/lyakhonov-lab5-s3-1",
"started_at": "2026-11-20T03:58:31.091098179Z",
"running": true
},
{
"id": "23b814fb71a813bedb09712be57c736e19460c2c25d2b2b4b0e66facb0bfdab9",
"name": "/lyakhonov-lab5-staging-cleaner-1",
"started_at": "2026-11-20T03:58:31.667560755Z",
"running": true
},
{
"id": "1f724278797561aea476251a8902eac6377039c3e30cbc336d501409af118ae2",
"name": "/lyakhonov-lab5-worker-1",
"started_at": "2026-11-20T03:58:31.445500705Z",
"running": true
},
{
"id": "e36e30c0bc23ffdc3c2c4fe39b57ea98597764dfa313c509bd1734d74b801b44",
"name": "/lyakhonov-lab5-worker-2",
"started_at": "2026-11-20T03:58:31.518418339Z",
"running": true
}
],
"after": [
{
"id": "b3f8a331a59832dde80002af9f29c5893381e780803283476c687168ede15842",
"name": "/lyakhonov-lab5-api-1",
"started_at": "2026-11-20T03:58:31.589874697Z",
"running": true
},
{
"id": "a0acb99b68a1f803792742460827528137ac3ab96ec76a68de550f930a4a9368",
"name": "/lyakhonov-lab5-api-2",
"started_at": "2026-11-20T03:58:31.785178375Z",
"running": false
},
{
"id": "b94a25ac1bb3df998e3d0c27beae4b97d655bbc0a7ae520bd60c736cd40462c9",
"name": "/lyakhonov-lab5-broker-1",
"started_at": "2026-11-20T03:58:31.88055044Z",
"running": true
},
{
"id": "fdca00783fcb86e75d3ec4c84494d1571548333d585459191b78992f707729ad",
"name": "/lyakhonov-lab5-bucket-init-1",
"started_at": "2026-11-20T03:58:36.540744301Z",
"running": false
},
{
"id": "10408d41f3b50b0a5e8ad4e21b849fa97548c03f4a535b27c8c919163b9c30b2",
"name": "/lyakhonov-lab5-db-1",
"started_at": "2026-11-20T03:58:30.504381937Z",
"running": true
},
{
"id": "bdedd08309bb0db9dc94235a148fc0938180449b1431059178488d0c6f985049",
"name": "/lyakhonov-lab5-dispatcher-1",
"started_at": "2026-11-20T03:58:31.312524166Z",
"running": true
},
{
"id": "934fcb61b954722ec6f9d3ce84d3399f5a35a30e8368e0ed44a939319ea9ff4f",
"name": "/lyakhonov-lab5-lb-1",
"started_at": "2026-11-20T03:58:30.862509137Z",
"running": true
},
{
"id": "39b8b11f3c7c9e1c3fb778e780dc8d123e4b955669ddee8c85420eefcb3abaca",
"name": "/lyakhonov-lab5-migrate-1",
"started_at": "2026-11-20T03:58:37.048579415Z",
"running": false
},
{
"id": "c3962c31749b802835f909ce1b4efbe34149e88d9bc678ca3b82f9fdbcc97af1",
"name": "/lyakhonov-lab5-redis-1",
"started_at": "2026-11-20T03:58:30.614258194Z",
"running": true
},
{
"id": "0b09dce985685e130ed8774a277a3ff254e8a633ff1dfeed7fd2daf80b78c4e8",
"name": "/lyakhonov-lab5-s3-1",
"started_at": "2026-11-20T03:58:31.091098179Z",
"running": true
},
{
"id": "23b814fb71a813bedb09712be57c736e19460c2c25d2b2b4b0e66facb0bfdab9",
"name": "/lyakhonov-lab5-staging-cleaner-1",
"started_at": "2026-11-20T03:58:31.667560755Z",
"running": true
},
{
"id": "1f724278797561aea476251a8902eac6377039c3e30cbc336d501409af118ae2",
"name": "/lyakhonov-lab5-worker-1",
"started_at": "2026-11-20T03:58:31.445500705Z",
"running": true
},
{
"id": "e36e30c0bc23ffdc3c2c4fe39b57ea98597764dfa313c509bd1734d74b801b44",
"name": "/lyakhonov-lab5-worker-2",
"started_at": "2026-11-20T03:58:31.518418339Z",
"running": true
}
]
}
+240
View File
@@ -0,0 +1,240 @@
{
"commit": "e376ede0a22aca6a8b1cc80059194dd1635861e5",
"python": "3.13.7",
"docker": {
"Client": {
"Version": "28.5.1",
"ApiVersion": "1.51",
"DefaultAPIVersion": "1.51",
"GitCommit": "e180ab8",
"GoVersion": "go1.24.8",
"Os": "windows",
"Arch": "amd64",
"BuildTime": "Wed Oct 8 12:19:16 2025",
"Context": "desktop-linux"
},
"Server": {
"Platform": {
"Name": "Docker Desktop 4.49.0 (208700)"
},
"Components": [
{
"Name": "Engine",
"Version": "28.5.1",
"Details": {
"ApiVersion": "1.51",
"Arch": "amd64",
"BuildTime": "Wed Oct 8 12:17:24 2025",
"Experimental": "false",
"GitCommit": "f8215cc",
"GoVersion": "go1.24.8",
"KernelVersion": "6.6.87.2-microsoft-standard-WSL2",
"MinAPIVersion": "1.24",
"Os": "linux"
}
},
{
"Name": "containerd",
"Version": "1.7.27",
"Details": {
"GitCommit": "05044ec0a9a75232cad458027ca83437aae3f4da"
}
},
{
"Name": "runc",
"Version": "1.2.5",
"Details": {
"GitCommit": "v1.2.5-0-g59923ef"
}
},
{
"Name": "docker-init",
"Version": "0.19.0",
"Details": {
"GitCommit": "de40ad0"
}
}
],
"Version": "28.5.1",
"ApiVersion": "1.51",
"MinAPIVersion": "1.24",
"GitCommit": "f8215cc",
"GoVersion": "go1.24.8",
"Os": "linux",
"Arch": "amd64",
"KernelVersion": "6.6.87.2-microsoft-standard-WSL2",
"BuildTime": "2025-10-08T12:17:24.000000000+00:00"
}
},
"compose": "Docker Compose version v2.40.3-desktop.1",
"engine": {
"memory_bytes": 8126664704,
"cpus": 16
},
"services": [
{
"service": "api",
"id": "86d8b62b07da61b7b8539094d65f6712ffc0a342cd811b9ec12b6c302fb9e992",
"image": "lyakhonov-messenger:lab5",
"image_id": "sha256:2153c7be14d77d6d6e0337a445cca1feb814bef892dfaae459d9a28ce31494a4",
"started_at": "2026-11-20T03:42:15.518481555Z",
"memory_limit": 671088640,
"nanocpus": 500000000,
"ports": {},
"settings": [
"JOB_TIMEOUT_SECONDS=5",
"JOB_LEASE_SECONDS=10",
"JOB_MAX_ATTEMPTS=5",
"LAB5_FAULT_INJECTION=1",
"STAGING_RETENTION_SECONDS=86400"
]
},
{
"service": "api",
"id": "75c9985d99c323b3db7e20f01ecc7d50e8ee32e1a10ddccc17984eb0c49d0902",
"image": "lyakhonov-messenger:lab5",
"image_id": "sha256:2153c7be14d77d6d6e0337a445cca1feb814bef892dfaae459d9a28ce31494a4",
"started_at": "2026-11-20T03:42:15.729148361Z",
"memory_limit": 671088640,
"nanocpus": 500000000,
"ports": {},
"settings": [
"JOB_TIMEOUT_SECONDS=5",
"JOB_LEASE_SECONDS=10",
"JOB_MAX_ATTEMPTS=5",
"LAB5_FAULT_INJECTION=1",
"STAGING_RETENTION_SECONDS=86400"
]
},
{
"service": "broker",
"id": "b94a25ac1bb3df998e3d0c27beae4b97d655bbc0a7ae520bd60c736cd40462c9",
"image": "rabbitmq:4.1.0-alpine",
"image_id": "sha256:8a73e9185f8420247c5b3c19231df18dfac28a8d5706203e13b291934044966d",
"started_at": "2026-11-20T03:42:16.413919787Z",
"memory_limit": 536870912,
"nanocpus": 750000000,
"ports": {},
"settings": []
},
{
"service": "db",
"id": "10408d41f3b50b0a5e8ad4e21b849fa97548c03f4a535b27c8c919163b9c30b2",
"image": "postgres:16.6-alpine",
"image_id": "sha256:1d04b9ba1d4996401f2552b51beda8187f175c0645c091e4781134fc9c9a3eef",
"started_at": "2026-11-20T03:39:52.15355593Z",
"memory_limit": 536870912,
"nanocpus": 1000000000,
"ports": {},
"settings": []
},
{
"service": "dispatcher",
"id": "357e0877d3d2ad9692375f8063842b02b920271612671a418e383ff6af93e21a",
"image": "lyakhonov-messenger:lab5",
"image_id": "sha256:2153c7be14d77d6d6e0337a445cca1feb814bef892dfaae459d9a28ce31494a4",
"started_at": "2026-11-20T03:45:44.20441819Z",
"memory_limit": 268435456,
"nanocpus": 500000000,
"ports": {},
"settings": [
"STAGING_RETENTION_SECONDS=86400",
"JOB_LEASE_SECONDS=10",
"JOB_TIMEOUT_SECONDS=5",
"LAB5_FAULT_INJECTION=1",
"JOB_MAX_ATTEMPTS=5"
]
},
{
"service": "lb",
"id": "934fcb61b954722ec6f9d3ce84d3399f5a35a30e8368e0ed44a939319ea9ff4f",
"image": "haproxy:3.0.6-alpine",
"image_id": "sha256:c22c8710886104a48b920306f063401f0d11811858e3c6b9d87d88a7556b2e61",
"started_at": "2026-11-20T03:39:59.703127904Z",
"memory_limit": 134217728,
"nanocpus": 500000000,
"ports": {
"8080/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "8085"
}
]
},
"settings": []
},
{
"service": "redis",
"id": "c3962c31749b802835f909ce1b4efbe34149e88d9bc678ca3b82f9fdbcc97af1",
"image": "redis:7.4.1-alpine",
"image_id": "sha256:c1e88455c85225310bbea54816e9c3f4b5295815e6dbf80c34d40afc6df28275",
"started_at": "2026-11-20T03:39:52.151204203Z",
"memory_limit": 134217728,
"nanocpus": 250000000,
"ports": {},
"settings": []
},
{
"service": "s3",
"id": "0b09dce985685e130ed8774a277a3ff254e8a633ff1dfeed7fd2daf80b78c4e8",
"image": "lyakhonov-storage:lab5",
"image_id": "sha256:88795615d5dbc1a5618ff618334251801720cb8ba30ca34d65d6b0ad508a2afe",
"started_at": "2026-11-20T03:39:52.148504843Z",
"memory_limit": 805306368,
"nanocpus": 1000000000,
"ports": {},
"settings": []
},
{
"service": "staging-cleaner",
"id": "654fa215c1b1d66c82b01a3c34e37e989671fdf4059f1b6a4fca3aada84c2311",
"image": "lyakhonov-messenger:lab5",
"image_id": "sha256:2153c7be14d77d6d6e0337a445cca1feb814bef892dfaae459d9a28ce31494a4",
"started_at": "2026-11-20T03:41:58.299334822Z",
"memory_limit": 268435456,
"nanocpus": 250000000,
"ports": {},
"settings": [
"JOB_LEASE_SECONDS=10",
"JOB_MAX_ATTEMPTS=5",
"LAB5_FAULT_INJECTION=1",
"JOB_TIMEOUT_SECONDS=5",
"STAGING_RETENTION_SECONDS=86400"
]
},
{
"service": "worker",
"id": "66a77000f79c87a2e56fe362e46cf1a57bc2eb96cd8aa3eb60135f145655b1fa",
"image": "lyakhonov-messenger:lab5",
"image_id": "sha256:2153c7be14d77d6d6e0337a445cca1feb814bef892dfaae459d9a28ce31494a4",
"started_at": "2026-11-20T03:45:59.755318954Z",
"memory_limit": 805306368,
"nanocpus": 750000000,
"ports": {},
"settings": [
"LAB5_FAULT_INJECTION=1",
"STAGING_RETENTION_SECONDS=86400",
"JOB_LEASE_SECONDS=10",
"JOB_TIMEOUT_SECONDS=5",
"JOB_MAX_ATTEMPTS=5"
]
},
{
"service": "worker",
"id": "66e1949130cc05c7e83c8267a114318e9d53f5ff86d8b399be55e823b7597bfa",
"image": "lyakhonov-messenger:lab5",
"image_id": "sha256:2153c7be14d77d6d6e0337a445cca1feb814bef892dfaae459d9a28ce31494a4",
"started_at": "2026-11-20T03:45:58.61301125Z",
"memory_limit": 805306368,
"nanocpus": 750000000,
"ports": {},
"settings": [
"JOB_LEASE_SECONDS=10",
"LAB5_FAULT_INJECTION=1",
"STAGING_RETENTION_SECONDS=86400",
"JOB_TIMEOUT_SECONDS=5",
"JOB_MAX_ATTEMPTS=5"
]
}
]
}
Binary file not shown.

After

Width:  |  Height:  |  Size: 60 KiB

+35
View File
@@ -0,0 +1,35 @@
{
"attachments": [
{
"state": "ready",
"count": 384
}
],
"jobs": [
{
"state": "ready",
"pipeline_version": 1,
"count": 380
},
{
"state": "superseded",
"pipeline_version": 1,
"count": 4
},
{
"state": "ready",
"pipeline_version": 2,
"count": 7
}
],
"replays": 2,
"load_observation_errors": [
{
"id": "63d3337b-5ac0-478b-9e30-cde11dd2fd07",
"state": "ready",
"published_pipeline_version": 1,
"target_pipeline_version": 1
}
],
"violations": 0
}
+2
View File
@@ -0,0 +1,2 @@
PASS: negative_upload_acl_and_24_concurrent_messages
PASS: accepted_survives_api_broker_restart
+126
View File
@@ -0,0 +1,126 @@
{
"head": "8f112e092a10d72a98c3d9d4554c52b81ebff2b3",
"branch": "solution/BVT2301-lyakhonov",
"status": "",
"files": {
".dockerignore": "9c307884eda8387a781e8942b4df571ae0eee950c822aff044e7ed3d21e325f9",
".env.example": "292e0f2d8d4db97ec3cd9826db8f8bd37fcf310bb27cbc341645e36de5046bdf",
".gitattributes": "f3c03226a7748b6a723a20549727f38b6fdea151f177fd7c1901c9af7151640a",
".github/pull_request_template.md": "416abfd7d727759a69eed876b415079816e6fcf458e261dcac78cc719709d66f",
".github/workflows/application.yml": "0d45cb1d8fa2a45ef8a368892b833b26d300c9ccc7310bf7930c2a3fd9227164",
".github/workflows/contracts.yml": "57acaf40811dddc83f27bc52bff3e22e60f817ef1b71d764678562ec56f5ca97",
".gitignore": "fd2c5f54cd9dde6efd64b3977cd10d1400f83609939585778a2acce1b087581d",
"CONTRIBUTING.md": "08f247085938bd1efc4b8f7f48e3d520b1dc11ce569f4259491e8f01b9abd02c",
"COURSE.md": "1e3c65e345b7f89d08ed86a3b50061935ee8157907cb4043cfa40689781f54e0",
"Dockerfile": "c2743d8778c97cfd43d991d2a6b4a92e4560672af4c4eae86565cd1fa9c21f78",
"Dockerfile.example": "37050a40f15e29ee7f5eed7b2123fea9e6531d68b5735256e4c41c60255cffc9",
"Dockerfile.s3": "384837c64e421e67f81355cafa0af0b32157fe54451b886e471f69af8e0a0285",
"MAINTAINERS.md": "86153124dc51f97e29b9f7fd17d0a7100571bf584ae8167f162cd9728451c124",
"Makefile": "15525fe37647b398715597764a4ff6bfbcd7b46515e5a983ff013ec01dfe302a",
"README.md": "db1ff101968c21d6ada8972c1f4708936457af2fc1fa37ff7918137a83de3860",
"REPORT.md": "a5311b5fbbb1c21871ecc2a6ea16267453fc22c5c5121f03677e48524016885b",
"compose.example.yaml": "f7c1ae414a65cabb4ec334293d237bedbf8b1a694bfd7a72cfd28a2667222d7c",
"compose.yaml": "4f6ee1613db8937a39d73aa45e23a4c3d9931ae990d7e8cf503bac4bf266db6c",
"contracts/README.md": "4c04faede4a2ffa35183455b51da21764b7fa3997c0a4b3963614b82586eed28",
"contracts/examples.json": "2816da2e63058d55bdcbeceb92b231ea2509c86df8c5a0aa908be83bd0599469",
"contracts/infrastructure.json": "18a6b38deab39878da174f01e54addc4c7de556f9b3b7f37d96ec1ef0dd240b7",
"contracts/openapi.json": "61c7dbac7bd8d57423a2883b4b7b1277e8e35918d25c37e2cd02eaf6817936f0",
"evidence/README.md": "4ae3ab8da9fe3af5442f6b2e60c55d7d34de7bf0addffcc6a55f981baf0fe5cf",
"evidence/attachments.txt": "f5890fcb8a2ddc7b165633adc0a4c34100d9cc3d4261bb217af58e6aa2730a99",
"evidence/audit.txt": "d531211f514c58865dc2dfe19764cab7d54d41606fe9dc39e7e47de8aec8cb78",
"evidence/bootstrap-repeat.txt": "f7e10da821041ce9968ca4b0218c936f154ed02414443abaa4f8b1c0ab03d8c5",
"evidence/check.txt": "695ccac9f75e5d2118641ba2b3f386e916796271477d7bc5e98700d67371624d",
"evidence/clean-export.json": "34ef3e5865d6f8edd80ea14503117534da193eb43d5a5f8ff68abf28b86ac8ff",
"evidence/cpu.json": "aafd0ff20c15b4e30532823185578cdd86aa00050231e1ba72d868221a5abf44",
"evidence/docker-resources.json": "d44b532980090157607205f726b7799fd8a8da612a722a6d1a0b829618f8e1de",
"evidence/failover-1.txt": "e354ceccdbbf099a9adb922fdda0cc8576d7cbe9a3cb5a47dddd396a90559c16",
"evidence/failover-2.txt": "3cfe80f5864aa30972075db20fb2c0c02bc3dc3a74a9e4b975b816a4797b8c07",
"evidence/figures/reconcile-cost.png": "b84d7d37da4e9791941f1288f14f1155a687824a76cf3cf89a82410ed890dce9",
"evidence/figures/reconcile-cost.svg": "3c27e170f99738946899995808e5fdcb04e0ed27c090fd7c943a7592b94e20da",
"evidence/figures/upload-memory.png": "5c3a8e0e008741b67d949b1eb2b976bb684bb0fcde1bb8bd7a7e05c679c19885",
"evidence/figures/upload-memory.svg": "c45b7952a662ae6938f7299b9a9b876d08b3301aabfabe5ce496b85d7d70110c",
"evidence/figures/upload-throughput.png": "32bcd3c589d7e21a8b6d9cfe339806df8847e9af4ab105c551645110b1c0576f",
"evidence/figures/upload-throughput.svg": "9fc4c2946a74f047f5f0c83291ba77f05653e3344c34e9c99f0eea7d994deeed",
"evidence/final-check-test.txt": "cc1c058c861dc83a1202ed2b81675a4042a46a0c203d45f27ce5c99004aa18b3",
"evidence/hardware.json": "52bcfcbf973798f88ca4a441af5a7b0122e69a21355a802c92dcc2a5544ae912",
"evidence/level4.json": "3752d90c6e5d4e5cb7c5b8db6124873e9b87af642f3ea98a82240241937540d7",
"evidence/make-check-test.txt": "cc1c058c861dc83a1202ed2b81675a4042a46a0c203d45f27ce5c99004aa18b3",
"evidence/operations.json": "c222ef078951ad6e3a40515bd8a56188d0a0c2b1c1de8ba92f9f98976a235216",
"evidence/operations.txt": "b6bfd6e303838f66a333904a6fae16920a66e13cad90709e595859d79c0ab78a",
"evidence/persistence.txt": "e13f00023e004d83b2dfa575242fd3823985ac04e9e4107fb714acf0ccee07bd",
"evidence/reconcile.json": "a2150e0ed2951ba01e75c00c7257c8e285875aa58b3145354beab5a634f69b1a",
"evidence/repro-build.txt": "0300c2aa5019aaaa611960d82580bdfd8f53c540c494c00a2f40b73ce2b895bd",
"evidence/runtime.json": "d810634b8aed4c25c52ef9a0ad1a8fa7d73f76d1083b10a52ac260149d772616",
"evidence/s3-source-hashes.json": "9d0d1f414944cd6f0662067b9b2aa1c7fab7755baaa7b5560cd8740666e10f64",
"evidence/smoke.txt": "85fe65743939225bcec55093d4338aefd64679b5e457f5a6c8c07adff32d0743",
"evidence/sources-manifest.json": "44e11ad93dd156b2ebdfd99e91f2766400ffe4c5573701bebe37ee7b69b0a785",
"evidence/summary-output.txt": "2f7e52f1ac2a00d5999813149db612ba51caab3d043330974b598e1ed1528e09",
"evidence/summary.json": "4182e194ed6d12effd557bd5263b9f5a7fecfc5c6c8510b6214c183b4f808d2d",
"evidence/transfer.md": "3f874f17971915ba929aa3c31fdc79762d98baebfdf387cfcd327e78bb81d852",
"evidence/upload-load-output.txt": "bdeaae801cf295bb97b87ac3b8ef7878a7a0679d36bb43d5a1dc49d84b5da6d7",
"evidence/upload-load.json": "d965adbcfb4313e8529537129a65126ca17c8511758c91dd792b3b249b681e7d",
"evidence/upload-summary.csv": "9426de7d7c84be13bb85ef528fcea0da6cda9980e16445b19920f9129b768679",
"evidence/validate.txt": "69f17e4bbfdcc30ca307ad250746fef7007e94193586ea01e13e4040e1048e97",
"examples/requests.http": "53eea65721ef1c3e18470dbb95c894611c08856bab650fa0cfc0721f042cae91",
"infra/README.md": "33a4f7b870fd0b2bed98d46daf26d45dd7436176739672925246f8e3fe7c2278",
"infra/bucket.sh": "f7aed7c75255555c1b773adf2686d3206b113e5f0af863b96c833a63470370f6",
"infra/haproxy.cfg": "b359e64c9c1b923b85826db8c111a59fce4e26f788a784662b9a5046e65c226b",
"infra/reconciliation.md": "a3855637ffbdbfa06ef5f03744a068b9088a51e025f373330467f12a9aa27303",
"infra/s3-entrypoint.sh": "9b8220e117638e6a16c75cc6c824718209e7d5a767ed0b28f7038b58d676ec8c",
"infra/s3-policy.json": "463b042e97c4982be9b44ca22708c0d758d3f764c1cc7bb49710356a8549821b",
"lab.json": "30fd674b572fb0bf3a6845ce62987305db7f5b06d87f20aae72a1e30e566b185",
"lab4.env.example": "8c6da0b5707bb7e00c94fb3f626378412d335c0d6af2e29323e2e88323dc918c",
"migrations/001_initial.sql": "d4c044482ba61b6a59b35cb02cff16b650fa0fb813242c0678d45a3564e86340",
"migrations/002_idempotency.sql": "b3938061613446d1676dfdf41af1b8417dd0396d2a65e4d3d6b263d311ccdbce",
"migrations/003_attachments.sql": "4137877de095ca8cb590582bfa59758c31248f013e9b99ddcf6a2e2bedaff125",
"requirements-dev.txt": "e70f5e9db859ef3439dc6ae647890a18cd7a2752889598bbd19c822f31b7c499",
"requirements-research.txt": "1ff1ed1bc02424e20028427bd35d1b272c9700126033add35adf4566650dc067",
"requirements.lock.txt": "580f40ed0e8de26de95ac957e5b048a81d586c6d9861df5dfecd99700f57b072",
"requirements.txt": "dc14f80eca7ded138ec7fff542192d8013b74c458c3dd3234b11b6a391f75bf0",
"scripts/actions.py": "c58c1c5a72d474e38907440e0dea9914196bb0697cd1235c4b36e6335b151fdd",
"scripts/audit_solution.py": "609c740570364bec39f7d26bf85176537aea8e007fb21af5e0bedd12e6c60942",
"scripts/bootstrap.py": "db88a2aeba07281cd5ae8a001f0455bf8b5e19639bb06462513687fc59717aca",
"scripts/check_contract.py": "61e300fe5c1074360418e24b4653b12f96808247a2beaf2a64859aa360f81493",
"scripts/plot_results.py": "fecbeb33d73e7d3cbdeda41701f3be40dd6d04f974df1e85bd5c9a2152182c64",
"scripts/restart.cmd": "e008c8fa1ce5cacf582e502179ec78e15d45fe90dda1f4c929b7a01052fe3b11",
"scripts/restart.example.sh": "0328246ba75defbced992104e986fde973f63e3830d83251eced5953263e944b",
"scripts/restart.sh": "fcea33ea66beeb9b2ca6964a00c817a45afb7626eb9e4deb92d03adfc78a70b2",
"scripts/run_upload_load.py": "d1959fe3756fecbaa1923c972dcd41678634100b5f59a10bcab97851cb9d25cf",
"scripts/stop-one.cmd": "95e787774e6ffb007dc53c94a24c91d4a6ff3c2ae2bb15198cf7d4ccb06664ea",
"scripts/stop-one.example.sh": "1bcf34394520b89d95b7605ec56675be799eea920e83cfbba306d5dc0a6d9811",
"scripts/stop-one.sh": "82a0c50fd834c9ce330ec4b6b808c64c7d76dda7352ae4210a3322c9e0f2e125",
"scripts/validate_openapi.py": "cd7a33221b1860c5d2330e52afa6cb222d375db671ae9ab379ba51a0d3a77946",
"scripts/verify_clean_export.py": "a28a9388c416e101792b7587a784d127b2e7c78dd56da0bf9fa40d384533c52c",
"scripts/wait_ready.py": "29e9965053ad2cba45dc68a4cc462a7ccd2c6cbd9da9ed89351721f926f5643c",
"src/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
"src/app.py": "0cb5d0151e73166aed98acfe151415a93f18221cf27ebd8e39f433cda30b8f13",
"src/cache.py": "bfc8f1aa90bee4625b3887a3487be085560b7a2705cc94dcb557dd6c03062028",
"src/config.py": "aafa2db508658d2d5467d2c57ed5f4dea11609ab5928f86abc1e35fc8ba923d7",
"src/main.py": "3f49c442758f1a4c3a156a4555f2b3f6d8dff0529fc62cb763f11eaaa2d2760b",
"src/migrate.py": "48c2819b34e22ee099a97d8742a65c87bc0abf9cd617cf6b6caae8a1ad145af5",
"src/models.py": "afc5b651059a440904e1c4ac509ac8e24796bceac5869a6421e42d388f2fe6d6",
"src/objects.py": "75f15c13be0b5eecf441a437a8250a0d6367b7b098b288a2cd1994c0b1a4321a",
"src/reconcile.py": "228a7994ce5b4110d7391734b0885c01ece754912c285c7f530427ec2674f133",
"src/routes/__init__.py": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
"src/routes/attachments.py": "5518b8a264b8b0454e30606123119e83382159f2f031864e33a3e48a62496c84",
"src/routes/chats.py": "46ef834fce05037c2ecab26192ed58c28be81afc6a1db1375560f11bb9d63c12",
"src/routes/common.py": "fa2df76c819abe9a99b8b380a50b2aa4556aa43ac84afa95cac574aab8468a7e",
"src/routes/health.py": "a2d7aef51d4fff4f4c8523a4b1d1b894747f945ac3dd4d26b521d6a228cb88be",
"src/routes/messages.py": "7dc016d1252f07538c06b7c155d3efb8af02ac2a2a9867267168a74e7cf0bd3c",
"src/routes/users.py": "f5d4c7e4c4e5b1abfde7869a46e8a81a935b32f4809ddb8b2a4cb13175a24f50",
"src/storage.py": "81f5bcb0bc6ce356c76f1ea0b90d74566d436ca6f2dcc35e80cc0ae512588979",
"student-tests/README.md": "eb43baa6868c409f71905c7ab11b0bb187a8e9a87fc4842909949b270107e354",
"student-tests/test_attachments.py": "e26fece8adc6a63bcccfe6c1de53e3899f0c43d0c8c9fd6502c988403a9a95e5",
"student-tests/test_operations.py": "7a62d819afdaea80767cb2ff4e8141eebce9e564ec20241c7d3f5b645d742999",
"student-tests/test_reconcile.py": "f1e0f7461f57fa0aad2a16e118fe86ed5852ec1d86caac07ea81a829c7f2f787",
"student-tests/upload_load.py": "022eea2772fcbf780042b3959c516788929dfde4968dcd9f7caa2531999c52e9",
"tests/README.md": "89afb3063ec0ccd7cb68fdac1de57513f9cc81b77bad96f202daaca2b66a5e82",
"tests/client.py": "b318084e2a4c380db91a55d082190bf33979fa556a4c4ca87e01f46ae275775c",
"tests/fixtures/README.md": "0eaa4e8837032d1786fc0c4b1576656ff3f4d1931fdd51b80e5c053f88ab3872",
"tests/fixtures/sample.png": "99ea7533c441f79cd630d15ce4d58d1ec4e06f6f0efb3b77a5c088305cd1bd75",
"tests/image_probe.py": "ef48d8882ab138b9699a173e7419e5814c22a10b01b6b0ddbb50ea49481a5baa",
"tests/load.py": "9a9aff05e109630e243c3b092d7bd564344e4872b29e38b6618647a08460a72e",
"tests/resilience.py": "4ba30b9c81a0664127ddab2b0bea5e76aa2087be8bb25aa13cd5a8e69be23fdd",
"tests/smoke.py": "354e168e1e644145c3ff50bbbe189fd217cce5659aa125f588098025ffab0fdf"
}
}
+775
View File
@@ -0,0 +1,775 @@
{
"command": [
"C:\\Users\\User\\AppData\\Local\\Programs\\Python\\Python313\\python.exe",
"-X",
"utf8",
"tests/load.py",
"--base-url",
"http://127.0.0.1:8085",
"--duration",
"30",
"--concurrency",
"4",
"--output",
"evidence/load-messages.json"
],
"exit_code": 0,
"samples": [
{
"at_seconds": 3.241,
"containers": [
{
"BlockIO": "0B / 0B",
"CPUPerc": "34.76%",
"Container": "b3f8a331a59832dde80002af9f29c5893381e780803283476c687168ede15842",
"ID": "b3f8a331a598",
"MemPerc": "16.93%",
"MemUsage": "108.3MiB / 640MiB",
"Name": "lyakhonov-lab5-api-1",
"NetIO": "182MB / 182MB",
"PIDs": "14"
},
{
"BlockIO": "0B / 0B",
"CPUPerc": "48.21%",
"Container": "a0acb99b68a1f803792742460827528137ac3ab96ec76a68de550f930a4a9368",
"ID": "a0acb99b68a1",
"MemPerc": "19.08%",
"MemUsage": "122.1MiB / 640MiB",
"Name": "lyakhonov-lab5-api-2",
"NetIO": "137MB / 137MB",
"PIDs": "14"
},
{
"BlockIO": "0B / 160kB",
"CPUPerc": "1.63%",
"Container": "b94a25ac1bb3df998e3d0c27beae4b97d655bbc0a7ae520bd60c736cd40462c9",
"ID": "b94a25ac1bb3",
"MemPerc": "15.37%",
"MemUsage": "78.71MiB / 512MiB",
"Name": "lyakhonov-lab5-broker-1",
"NetIO": "288kB / 253kB",
"PIDs": "57"
},
{
"BlockIO": "0B / 1.02MB",
"CPUPerc": "33.80%",
"Container": "10408d41f3b50b0a5e8ad4e21b849fa97548c03f4a535b27c8c919163b9c30b2",
"ID": "10408d41f3b5",
"MemPerc": "10.18%",
"MemUsage": "52.11MiB / 512MiB",
"Name": "lyakhonov-lab5-db-1",
"NetIO": "6.3MB / 8.09MB",
"PIDs": "18"
},
{
"BlockIO": "0B / 0B",
"CPUPerc": "0.77%",
"Container": "bdedd08309bb0db9dc94235a148fc0938180449b1431059178488d0c6f985049",
"ID": "bdedd08309bb",
"MemPerc": "16.69%",
"MemUsage": "42.74MiB / 256MiB",
"Name": "lyakhonov-lab5-dispatcher-1",
"NetIO": "1.56MB / 1.1MB",
"PIDs": "5"
},
{
"BlockIO": "0B / 0B",
"CPUPerc": "10.37%",
"Container": "934fcb61b954722ec6f9d3ce84d3399f5a35a30e8368e0ed44a939319ea9ff4f",
"ID": "934fcb61b954",
"MemPerc": "10.75%",
"MemUsage": "13.76MiB / 128MiB",
"Name": "lyakhonov-lab5-lb-1",
"NetIO": "317MB / 317MB",
"PIDs": "17"
},
{
"BlockIO": "0B / 0B",
"CPUPerc": "0.62%",
"Container": "c3962c31749b802835f909ce1b4efbe34149e88d9bc678ca3b82f9fdbcc97af1",
"ID": "c3962c31749b",
"MemPerc": "2.61%",
"MemUsage": "3.34MiB / 128MiB",
"Name": "lyakhonov-lab5-redis-1",
"NetIO": "13kB / 10.4kB",
"PIDs": "6"
},
{
"BlockIO": "24.6kB / 701MB",
"CPUPerc": "0.84%",
"Container": "0b09dce985685e130ed8774a277a3ff254e8a633ff1dfeed7fd2daf80b78c4e8",
"ID": "0b09dce98568",
"MemPerc": "50.14%",
"MemUsage": "385MiB / 768MiB",
"Name": "lyakhonov-lab5-s3-1",
"NetIO": "701MB / 316MB",
"PIDs": "22"
},
{
"BlockIO": "0B / 0B",
"CPUPerc": "0.00%",
"Container": "23b814fb71a813bedb09712be57c736e19460c2c25d2b2b4b0e66facb0bfdab9",
"ID": "23b814fb71a8",
"MemPerc": "22.69%",
"MemUsage": "58.09MiB / 256MiB",
"Name": "lyakhonov-lab5-staging-cleaner-1",
"NetIO": "479kB / 521kB",
"PIDs": "5"
},
{
"BlockIO": "0B / 5.12MB",
"CPUPerc": "0.03%",
"Container": "1f724278797561aea476251a8902eac6377039c3e30cbc336d501409af118ae2",
"ID": "1f7242787975",
"MemPerc": "8.57%",
"MemUsage": "65.83MiB / 768MiB",
"Name": "lyakhonov-lab5-worker-1",
"NetIO": "159MB / 196MB",
"PIDs": "5"
},
{
"BlockIO": "0B / 10.3MB",
"CPUPerc": "0.03%",
"Container": "e36e30c0bc23ffdc3c2c4fe39b57ea98597764dfa313c509bd1734d74b801b44",
"ID": "e36e30c0bc23",
"MemPerc": "8.32%",
"MemUsage": "63.93MiB / 768MiB",
"Name": "lyakhonov-lab5-worker-2",
"NetIO": "157MB / 193MB",
"PIDs": "5"
}
]
},
{
"at_seconds": 8.631,
"containers": [
{
"BlockIO": "0B / 0B",
"CPUPerc": "28.24%",
"Container": "b3f8a331a59832dde80002af9f29c5893381e780803283476c687168ede15842",
"ID": "b3f8a331a598",
"MemPerc": "16.97%",
"MemUsage": "108.6MiB / 640MiB",
"Name": "lyakhonov-lab5-api-1",
"NetIO": "182MB / 183MB",
"PIDs": "15"
},
{
"BlockIO": "0B / 0B",
"CPUPerc": "50.33%",
"Container": "a0acb99b68a1f803792742460827528137ac3ab96ec76a68de550f930a4a9368",
"ID": "a0acb99b68a1",
"MemPerc": "19.13%",
"MemUsage": "122.5MiB / 640MiB",
"Name": "lyakhonov-lab5-api-2",
"NetIO": "137MB / 137MB",
"PIDs": "14"
},
{
"BlockIO": "0B / 160kB",
"CPUPerc": "53.78%",
"Container": "b94a25ac1bb3df998e3d0c27beae4b97d655bbc0a7ae520bd60c736cd40462c9",
"ID": "b94a25ac1bb3",
"MemPerc": "15.38%",
"MemUsage": "78.73MiB / 512MiB",
"Name": "lyakhonov-lab5-broker-1",
"NetIO": "288kB / 253kB",
"PIDs": "57"
},
{
"BlockIO": "0B / 1.02MB",
"CPUPerc": "24.36%",
"Container": "10408d41f3b50b0a5e8ad4e21b849fa97548c03f4a535b27c8c919163b9c30b2",
"ID": "10408d41f3b5",
"MemPerc": "10.65%",
"MemUsage": "54.51MiB / 512MiB",
"Name": "lyakhonov-lab5-db-1",
"NetIO": "7.27MB / 8.97MB",
"PIDs": "19"
},
{
"BlockIO": "0B / 0B",
"CPUPerc": "0.88%",
"Container": "bdedd08309bb0db9dc94235a148fc0938180449b1431059178488d0c6f985049",
"ID": "bdedd08309bb",
"MemPerc": "16.69%",
"MemUsage": "42.74MiB / 256MiB",
"Name": "lyakhonov-lab5-dispatcher-1",
"NetIO": "1.58MB / 1.11MB",
"PIDs": "5"
},
{
"BlockIO": "0B / 0B",
"CPUPerc": "11.03%",
"Container": "934fcb61b954722ec6f9d3ce84d3399f5a35a30e8368e0ed44a939319ea9ff4f",
"ID": "934fcb61b954",
"MemPerc": "11.15%",
"MemUsage": "14.27MiB / 128MiB",
"Name": "lyakhonov-lab5-lb-1",
"NetIO": "318MB / 318MB",
"PIDs": "17"
},
{
"BlockIO": "0B / 0B",
"CPUPerc": "0.65%",
"Container": "c3962c31749b802835f909ce1b4efbe34149e88d9bc678ca3b82f9fdbcc97af1",
"ID": "c3962c31749b",
"MemPerc": "2.61%",
"MemUsage": "3.34MiB / 128MiB",
"Name": "lyakhonov-lab5-redis-1",
"NetIO": "13kB / 10.4kB",
"PIDs": "6"
},
{
"BlockIO": "24.6kB / 701MB",
"CPUPerc": "0.74%",
"Container": "0b09dce985685e130ed8774a277a3ff254e8a633ff1dfeed7fd2daf80b78c4e8",
"ID": "0b09dce98568",
"MemPerc": "50.14%",
"MemUsage": "385MiB / 768MiB",
"Name": "lyakhonov-lab5-s3-1",
"NetIO": "701MB / 316MB",
"PIDs": "22"
},
{
"BlockIO": "0B / 0B",
"CPUPerc": "0.00%",
"Container": "23b814fb71a813bedb09712be57c736e19460c2c25d2b2b4b0e66facb0bfdab9",
"ID": "23b814fb71a8",
"MemPerc": "22.69%",
"MemUsage": "58.09MiB / 256MiB",
"Name": "lyakhonov-lab5-staging-cleaner-1",
"NetIO": "479kB / 521kB",
"PIDs": "5"
},
{
"BlockIO": "0B / 5.12MB",
"CPUPerc": "0.04%",
"Container": "1f724278797561aea476251a8902eac6377039c3e30cbc336d501409af118ae2",
"ID": "1f7242787975",
"MemPerc": "8.57%",
"MemUsage": "65.83MiB / 768MiB",
"Name": "lyakhonov-lab5-worker-1",
"NetIO": "159MB / 196MB",
"PIDs": "5"
},
{
"BlockIO": "0B / 10.3MB",
"CPUPerc": "0.05%",
"Container": "e36e30c0bc23ffdc3c2c4fe39b57ea98597764dfa313c509bd1734d74b801b44",
"ID": "e36e30c0bc23",
"MemPerc": "8.32%",
"MemUsage": "63.93MiB / 768MiB",
"Name": "lyakhonov-lab5-worker-2",
"NetIO": "157MB / 193MB",
"PIDs": "5"
}
]
},
{
"at_seconds": 13.955,
"containers": [
{
"BlockIO": "0B / 0B",
"CPUPerc": "46.72%",
"Container": "b3f8a331a59832dde80002af9f29c5893381e780803283476c687168ede15842",
"ID": "b3f8a331a598",
"MemPerc": "16.99%",
"MemUsage": "108.8MiB / 640MiB",
"Name": "lyakhonov-lab5-api-1",
"NetIO": "183MB / 183MB",
"PIDs": "15"
},
{
"BlockIO": "0B / 0B",
"CPUPerc": "48.40%",
"Container": "a0acb99b68a1f803792742460827528137ac3ab96ec76a68de550f930a4a9368",
"ID": "a0acb99b68a1",
"MemPerc": "19.24%",
"MemUsage": "123.1MiB / 640MiB",
"Name": "lyakhonov-lab5-api-2",
"NetIO": "138MB / 138MB",
"PIDs": "15"
},
{
"BlockIO": "0B / 160kB",
"CPUPerc": "42.48%",
"Container": "b94a25ac1bb3df998e3d0c27beae4b97d655bbc0a7ae520bd60c736cd40462c9",
"ID": "b94a25ac1bb3",
"MemPerc": "24.05%",
"MemUsage": "123.1MiB / 512MiB",
"Name": "lyakhonov-lab5-broker-1",
"NetIO": "288kB / 253kB",
"PIDs": "107"
},
{
"BlockIO": "0B / 1.02MB",
"CPUPerc": "30.00%",
"Container": "10408d41f3b50b0a5e8ad4e21b849fa97548c03f4a535b27c8c919163b9c30b2",
"ID": "10408d41f3b5",
"MemPerc": "11.38%",
"MemUsage": "58.29MiB / 512MiB",
"Name": "lyakhonov-lab5-db-1",
"NetIO": "8.2MB / 9.81MB",
"PIDs": "20"
},
{
"BlockIO": "0B / 0B",
"CPUPerc": "0.88%",
"Container": "bdedd08309bb0db9dc94235a148fc0938180449b1431059178488d0c6f985049",
"ID": "bdedd08309bb",
"MemPerc": "16.69%",
"MemUsage": "42.74MiB / 256MiB",
"Name": "lyakhonov-lab5-dispatcher-1",
"NetIO": "1.61MB / 1.13MB",
"PIDs": "5"
},
{
"BlockIO": "0B / 0B",
"CPUPerc": "13.29%",
"Container": "934fcb61b954722ec6f9d3ce84d3399f5a35a30e8368e0ed44a939319ea9ff4f",
"ID": "934fcb61b954",
"MemPerc": "11.87%",
"MemUsage": "15.2MiB / 128MiB",
"Name": "lyakhonov-lab5-lb-1",
"NetIO": "318MB / 319MB",
"PIDs": "17"
},
{
"BlockIO": "0B / 0B",
"CPUPerc": "0.46%",
"Container": "c3962c31749b802835f909ce1b4efbe34149e88d9bc678ca3b82f9fdbcc97af1",
"ID": "c3962c31749b",
"MemPerc": "2.61%",
"MemUsage": "3.34MiB / 128MiB",
"Name": "lyakhonov-lab5-redis-1",
"NetIO": "13kB / 10.4kB",
"PIDs": "6"
},
{
"BlockIO": "24.6kB / 701MB",
"CPUPerc": "0.66%",
"Container": "0b09dce985685e130ed8774a277a3ff254e8a633ff1dfeed7fd2daf80b78c4e8",
"ID": "0b09dce98568",
"MemPerc": "50.14%",
"MemUsage": "385MiB / 768MiB",
"Name": "lyakhonov-lab5-s3-1",
"NetIO": "701MB / 316MB",
"PIDs": "22"
},
{
"BlockIO": "0B / 0B",
"CPUPerc": "0.00%",
"Container": "23b814fb71a813bedb09712be57c736e19460c2c25d2b2b4b0e66facb0bfdab9",
"ID": "23b814fb71a8",
"MemPerc": "22.69%",
"MemUsage": "58.09MiB / 256MiB",
"Name": "lyakhonov-lab5-staging-cleaner-1",
"NetIO": "479kB / 521kB",
"PIDs": "5"
},
{
"BlockIO": "0B / 5.12MB",
"CPUPerc": "0.03%",
"Container": "1f724278797561aea476251a8902eac6377039c3e30cbc336d501409af118ae2",
"ID": "1f7242787975",
"MemPerc": "8.57%",
"MemUsage": "65.83MiB / 768MiB",
"Name": "lyakhonov-lab5-worker-1",
"NetIO": "159MB / 196MB",
"PIDs": "5"
},
{
"BlockIO": "0B / 10.3MB",
"CPUPerc": "0.04%",
"Container": "e36e30c0bc23ffdc3c2c4fe39b57ea98597764dfa313c509bd1734d74b801b44",
"ID": "e36e30c0bc23",
"MemPerc": "8.32%",
"MemUsage": "63.93MiB / 768MiB",
"Name": "lyakhonov-lab5-worker-2",
"NetIO": "157MB / 193MB",
"PIDs": "5"
}
]
},
{
"at_seconds": 19.25,
"containers": [
{
"BlockIO": "0B / 0B",
"CPUPerc": "39.37%",
"Container": "b3f8a331a59832dde80002af9f29c5893381e780803283476c687168ede15842",
"ID": "b3f8a331a598",
"MemPerc": "17.00%",
"MemUsage": "108.8MiB / 640MiB",
"Name": "lyakhonov-lab5-api-1",
"NetIO": "184MB / 184MB",
"PIDs": "15"
},
{
"BlockIO": "0B / 0B",
"CPUPerc": "49.09%",
"Container": "a0acb99b68a1f803792742460827528137ac3ab96ec76a68de550f930a4a9368",
"ID": "a0acb99b68a1",
"MemPerc": "19.17%",
"MemUsage": "122.7MiB / 640MiB",
"Name": "lyakhonov-lab5-api-2",
"NetIO": "138MB / 139MB",
"PIDs": "15"
},
{
"BlockIO": "0B / 160kB",
"CPUPerc": "0.23%",
"Container": "b94a25ac1bb3df998e3d0c27beae4b97d655bbc0a7ae520bd60c736cd40462c9",
"ID": "b94a25ac1bb3",
"MemPerc": "15.37%",
"MemUsage": "78.71MiB / 512MiB",
"Name": "lyakhonov-lab5-broker-1",
"NetIO": "288kB / 253kB",
"PIDs": "57"
},
{
"BlockIO": "0B / 1.57MB",
"CPUPerc": "21.35%",
"Container": "10408d41f3b50b0a5e8ad4e21b849fa97548c03f4a535b27c8c919163b9c30b2",
"ID": "10408d41f3b5",
"MemPerc": "11.24%",
"MemUsage": "57.52MiB / 512MiB",
"Name": "lyakhonov-lab5-db-1",
"NetIO": "9.04MB / 10.6MB",
"PIDs": "20"
},
{
"BlockIO": "0B / 0B",
"CPUPerc": "0.67%",
"Container": "bdedd08309bb0db9dc94235a148fc0938180449b1431059178488d0c6f985049",
"ID": "bdedd08309bb",
"MemPerc": "16.69%",
"MemUsage": "42.74MiB / 256MiB",
"Name": "lyakhonov-lab5-dispatcher-1",
"NetIO": "1.63MB / 1.14MB",
"PIDs": "5"
},
{
"BlockIO": "0B / 0B",
"CPUPerc": "16.23%",
"Container": "934fcb61b954722ec6f9d3ce84d3399f5a35a30e8368e0ed44a939319ea9ff4f",
"ID": "934fcb61b954",
"MemPerc": "11.01%",
"MemUsage": "14.09MiB / 128MiB",
"Name": "lyakhonov-lab5-lb-1",
"NetIO": "319MB / 319MB",
"PIDs": "17"
},
{
"BlockIO": "0B / 0B",
"CPUPerc": "0.49%",
"Container": "c3962c31749b802835f909ce1b4efbe34149e88d9bc678ca3b82f9fdbcc97af1",
"ID": "c3962c31749b",
"MemPerc": "2.61%",
"MemUsage": "3.34MiB / 128MiB",
"Name": "lyakhonov-lab5-redis-1",
"NetIO": "13kB / 10.4kB",
"PIDs": "6"
},
{
"BlockIO": "24.6kB / 701MB",
"CPUPerc": "0.79%",
"Container": "0b09dce985685e130ed8774a277a3ff254e8a633ff1dfeed7fd2daf80b78c4e8",
"ID": "0b09dce98568",
"MemPerc": "50.14%",
"MemUsage": "385.1MiB / 768MiB",
"Name": "lyakhonov-lab5-s3-1",
"NetIO": "701MB / 316MB",
"PIDs": "22"
},
{
"BlockIO": "0B / 0B",
"CPUPerc": "0.00%",
"Container": "23b814fb71a813bedb09712be57c736e19460c2c25d2b2b4b0e66facb0bfdab9",
"ID": "23b814fb71a8",
"MemPerc": "22.69%",
"MemUsage": "58.09MiB / 256MiB",
"Name": "lyakhonov-lab5-staging-cleaner-1",
"NetIO": "479kB / 521kB",
"PIDs": "5"
},
{
"BlockIO": "0B / 5.12MB",
"CPUPerc": "0.04%",
"Container": "1f724278797561aea476251a8902eac6377039c3e30cbc336d501409af118ae2",
"ID": "1f7242787975",
"MemPerc": "8.57%",
"MemUsage": "65.83MiB / 768MiB",
"Name": "lyakhonov-lab5-worker-1",
"NetIO": "159MB / 196MB",
"PIDs": "5"
},
{
"BlockIO": "0B / 10.3MB",
"CPUPerc": "0.05%",
"Container": "e36e30c0bc23ffdc3c2c4fe39b57ea98597764dfa313c509bd1734d74b801b44",
"ID": "e36e30c0bc23",
"MemPerc": "8.32%",
"MemUsage": "63.93MiB / 768MiB",
"Name": "lyakhonov-lab5-worker-2",
"NetIO": "157MB / 193MB",
"PIDs": "5"
}
]
},
{
"at_seconds": 24.605,
"containers": [
{
"BlockIO": "0B / 0B",
"CPUPerc": "49.61%",
"Container": "b3f8a331a59832dde80002af9f29c5893381e780803283476c687168ede15842",
"ID": "b3f8a331a598",
"MemPerc": "17.00%",
"MemUsage": "108.8MiB / 640MiB",
"Name": "lyakhonov-lab5-api-1",
"NetIO": "184MB / 185MB",
"PIDs": "14"
},
{
"BlockIO": "0B / 0B",
"CPUPerc": "31.04%",
"Container": "a0acb99b68a1f803792742460827528137ac3ab96ec76a68de550f930a4a9368",
"ID": "a0acb99b68a1",
"MemPerc": "19.17%",
"MemUsage": "122.7MiB / 640MiB",
"Name": "lyakhonov-lab5-api-2",
"NetIO": "139MB / 140MB",
"PIDs": "14"
},
{
"BlockIO": "0B / 160kB",
"CPUPerc": "75.54%",
"Container": "b94a25ac1bb3df998e3d0c27beae4b97d655bbc0a7ae520bd60c736cd40462c9",
"ID": "b94a25ac1bb3",
"MemPerc": "31.73%",
"MemUsage": "162.4MiB / 512MiB",
"Name": "lyakhonov-lab5-broker-1",
"NetIO": "288kB / 253kB",
"PIDs": "107"
},
{
"BlockIO": "0B / 1.57MB",
"CPUPerc": "32.34%",
"Container": "10408d41f3b50b0a5e8ad4e21b849fa97548c03f4a535b27c8c919163b9c30b2",
"ID": "10408d41f3b5",
"MemPerc": "11.36%",
"MemUsage": "58.14MiB / 512MiB",
"Name": "lyakhonov-lab5-db-1",
"NetIO": "10.5MB / 11.9MB",
"PIDs": "20"
},
{
"BlockIO": "0B / 0B",
"CPUPerc": "0.94%",
"Container": "bdedd08309bb0db9dc94235a148fc0938180449b1431059178488d0c6f985049",
"ID": "bdedd08309bb",
"MemPerc": "16.69%",
"MemUsage": "42.74MiB / 256MiB",
"Name": "lyakhonov-lab5-dispatcher-1",
"NetIO": "1.65MB / 1.16MB",
"PIDs": "5"
},
{
"BlockIO": "0B / 0B",
"CPUPerc": "12.43%",
"Container": "934fcb61b954722ec6f9d3ce84d3399f5a35a30e8368e0ed44a939319ea9ff4f",
"ID": "934fcb61b954",
"MemPerc": "11.71%",
"MemUsage": "14.98MiB / 128MiB",
"Name": "lyakhonov-lab5-lb-1",
"NetIO": "320MB / 320MB",
"PIDs": "17"
},
{
"BlockIO": "0B / 0B",
"CPUPerc": "0.66%",
"Container": "c3962c31749b802835f909ce1b4efbe34149e88d9bc678ca3b82f9fdbcc97af1",
"ID": "c3962c31749b",
"MemPerc": "2.61%",
"MemUsage": "3.34MiB / 128MiB",
"Name": "lyakhonov-lab5-redis-1",
"NetIO": "13kB / 10.4kB",
"PIDs": "6"
},
{
"BlockIO": "24.6kB / 701MB",
"CPUPerc": "0.64%",
"Container": "0b09dce985685e130ed8774a277a3ff254e8a633ff1dfeed7fd2daf80b78c4e8",
"ID": "0b09dce98568",
"MemPerc": "50.14%",
"MemUsage": "385MiB / 768MiB",
"Name": "lyakhonov-lab5-s3-1",
"NetIO": "701MB / 316MB",
"PIDs": "22"
},
{
"BlockIO": "0B / 0B",
"CPUPerc": "0.00%",
"Container": "23b814fb71a813bedb09712be57c736e19460c2c25d2b2b4b0e66facb0bfdab9",
"ID": "23b814fb71a8",
"MemPerc": "22.69%",
"MemUsage": "58.09MiB / 256MiB",
"Name": "lyakhonov-lab5-staging-cleaner-1",
"NetIO": "479kB / 521kB",
"PIDs": "5"
},
{
"BlockIO": "0B / 5.12MB",
"CPUPerc": "0.03%",
"Container": "1f724278797561aea476251a8902eac6377039c3e30cbc336d501409af118ae2",
"ID": "1f7242787975",
"MemPerc": "8.57%",
"MemUsage": "65.83MiB / 768MiB",
"Name": "lyakhonov-lab5-worker-1",
"NetIO": "159MB / 196MB",
"PIDs": "5"
},
{
"BlockIO": "0B / 10.3MB",
"CPUPerc": "0.04%",
"Container": "e36e30c0bc23ffdc3c2c4fe39b57ea98597764dfa313c509bd1734d74b801b44",
"ID": "e36e30c0bc23",
"MemPerc": "8.32%",
"MemUsage": "63.93MiB / 768MiB",
"Name": "lyakhonov-lab5-worker-2",
"NetIO": "157MB / 193MB",
"PIDs": "5"
}
]
},
{
"at_seconds": 29.874,
"containers": [
{
"BlockIO": "0B / 0B",
"CPUPerc": "36.39%",
"Container": "b3f8a331a59832dde80002af9f29c5893381e780803283476c687168ede15842",
"ID": "b3f8a331a598",
"MemPerc": "17.01%",
"MemUsage": "108.8MiB / 640MiB",
"Name": "lyakhonov-lab5-api-1",
"NetIO": "185MB / 186MB",
"PIDs": "14"
},
{
"BlockIO": "0B / 0B",
"CPUPerc": "48.11%",
"Container": "a0acb99b68a1f803792742460827528137ac3ab96ec76a68de550f930a4a9368",
"ID": "a0acb99b68a1",
"MemPerc": "19.17%",
"MemUsage": "122.7MiB / 640MiB",
"Name": "lyakhonov-lab5-api-2",
"NetIO": "140MB / 140MB",
"PIDs": "14"
},
{
"BlockIO": "0B / 160kB",
"CPUPerc": "4.78%",
"Container": "b94a25ac1bb3df998e3d0c27beae4b97d655bbc0a7ae520bd60c736cd40462c9",
"ID": "b94a25ac1bb3",
"MemPerc": "19.12%",
"MemUsage": "97.92MiB / 512MiB",
"Name": "lyakhonov-lab5-broker-1",
"NetIO": "288kB / 254kB",
"PIDs": "60"
},
{
"BlockIO": "0B / 20.3MB",
"CPUPerc": "27.03%",
"Container": "10408d41f3b50b0a5e8ad4e21b849fa97548c03f4a535b27c8c919163b9c30b2",
"ID": "10408d41f3b5",
"MemPerc": "11.51%",
"MemUsage": "58.93MiB / 512MiB",
"Name": "lyakhonov-lab5-db-1",
"NetIO": "11.6MB / 12.9MB",
"PIDs": "20"
},
{
"BlockIO": "0B / 0B",
"CPUPerc": "0.47%",
"Container": "bdedd08309bb0db9dc94235a148fc0938180449b1431059178488d0c6f985049",
"ID": "bdedd08309bb",
"MemPerc": "16.69%",
"MemUsage": "42.74MiB / 256MiB",
"Name": "lyakhonov-lab5-dispatcher-1",
"NetIO": "1.68MB / 1.17MB",
"PIDs": "5"
},
{
"BlockIO": "0B / 0B",
"CPUPerc": "13.59%",
"Container": "934fcb61b954722ec6f9d3ce84d3399f5a35a30e8368e0ed44a939319ea9ff4f",
"ID": "934fcb61b954",
"MemPerc": "11.22%",
"MemUsage": "14.36MiB / 128MiB",
"Name": "lyakhonov-lab5-lb-1",
"NetIO": "321MB / 321MB",
"PIDs": "17"
},
{
"BlockIO": "0B / 0B",
"CPUPerc": "0.47%",
"Container": "c3962c31749b802835f909ce1b4efbe34149e88d9bc678ca3b82f9fdbcc97af1",
"ID": "c3962c31749b",
"MemPerc": "2.61%",
"MemUsage": "3.34MiB / 128MiB",
"Name": "lyakhonov-lab5-redis-1",
"NetIO": "13kB / 10.4kB",
"PIDs": "6"
},
{
"BlockIO": "24.6kB / 701MB",
"CPUPerc": "0.59%",
"Container": "0b09dce985685e130ed8774a277a3ff254e8a633ff1dfeed7fd2daf80b78c4e8",
"ID": "0b09dce98568",
"MemPerc": "50.14%",
"MemUsage": "385MiB / 768MiB",
"Name": "lyakhonov-lab5-s3-1",
"NetIO": "701MB / 316MB",
"PIDs": "22"
},
{
"BlockIO": "0B / 0B",
"CPUPerc": "0.98%",
"Container": "23b814fb71a813bedb09712be57c736e19460c2c25d2b2b4b0e66facb0bfdab9",
"ID": "23b814fb71a8",
"MemPerc": "22.69%",
"MemUsage": "58.09MiB / 256MiB",
"Name": "lyakhonov-lab5-staging-cleaner-1",
"NetIO": "480kB / 522kB",
"PIDs": "5"
},
{
"BlockIO": "0B / 5.12MB",
"CPUPerc": "0.03%",
"Container": "1f724278797561aea476251a8902eac6377039c3e30cbc336d501409af118ae2",
"ID": "1f7242787975",
"MemPerc": "8.57%",
"MemUsage": "65.83MiB / 768MiB",
"Name": "lyakhonov-lab5-worker-1",
"NetIO": "159MB / 196MB",
"PIDs": "5"
},
{
"BlockIO": "0B / 10.3MB",
"CPUPerc": "0.05%",
"Container": "e36e30c0bc23ffdc3c2c4fe39b57ea98597764dfa313c509bd1734d74b801b44",
"ID": "e36e30c0bc23",
"MemPerc": "8.32%",
"MemUsage": "63.93MiB / 768MiB",
"Name": "lyakhonov-lab5-worker-2",
"NetIO": "157MB / 193MB",
"PIDs": "5"
}
]
}
]
}
+17
View File
@@ -0,0 +1,17 @@
{
"lab": 5,
"workload": "closed-loop POST messages; no automatic retries",
"requested_duration_seconds": 30.0,
"elapsed_seconds": 30.112,
"concurrency": 4,
"successful_requests": 2507,
"failed_requests": 0,
"error_ratio": 0.0,
"successful_rps": 83.256,
"successful_latency_ms": {
"p50": 25.341,
"p95": 146.956,
"p99": 251.292
},
"note": "Latency percentiles cover successes only. Timeouts/errors are counted separately; closed-loop has coordinated omission and client overhead."
}
+17
View File
@@ -0,0 +1,17 @@
{
"lab": 5,
"workload": "closed-loop POST messages; no automatic retries",
"requested_duration_seconds": 30.0,
"elapsed_seconds": 30.112,
"concurrency": 4,
"successful_requests": 2507,
"failed_requests": 0,
"error_ratio": 0.0,
"successful_rps": 83.256,
"successful_latency_ms": {
"p50": 25.341,
"p95": 146.956,
"p99": 251.292
},
"note": "Latency percentiles cover successes only. Timeouts/errors are counted separately; closed-loop has coordinated omission and client overhead."
}
File diff suppressed because it is too large Load Diff
+6
View File
@@ -0,0 +1,6 @@
{"profile": "320x200", "bytes_per_image": 111817, "repeat": 1, "concurrency": 2, "requested_duration": 20, "elapsed_seconds": 20.093, "warmup_completed": 1, "completed": 80, "successful_rps": 3.982, "failures": [], "error_fraction": 0.0, "p50": 0.401, "p95": 0.7265, "p99": 0.7436, "upload_p95": 0.0781}
{"profile": "320x200", "bytes_per_image": 111817, "repeat": 2, "concurrency": 2, "requested_duration": 20, "elapsed_seconds": 20.24, "warmup_completed": 1, "completed": 73, "successful_rps": 3.607, "failures": [], "error_fraction": 0.0, "p50": 0.4219, "p95": 0.7366, "p99": 0.7857, "upload_p95": 0.0893}
{"profile": "320x200", "bytes_per_image": 111817, "repeat": 3, "concurrency": 2, "requested_duration": 20, "elapsed_seconds": 20.004, "warmup_completed": 1, "completed": 71, "successful_rps": 3.549, "failures": [], "error_fraction": 0.0, "p50": 0.4389, "p95": 0.7694, "p99": 0.82, "upload_p95": 0.089}
{"profile": "1024x768", "bytes_per_image": 2360847, "repeat": 1, "concurrency": 2, "requested_duration": 20, "elapsed_seconds": 20.567, "warmup_completed": 1, "completed": 45, "successful_rps": 2.188, "failures": [], "error_fraction": 0.0, "p50": 0.8308, "p95": 1.1487, "p99": 1.1615, "upload_p95": 0.2497}
{"profile": "1024x768", "bytes_per_image": 2360847, "repeat": 2, "concurrency": 2, "requested_duration": 20, "elapsed_seconds": 20.396, "warmup_completed": 1, "completed": 32, "successful_rps": 1.569, "failures": ["Failure: GET /api/v1/attachments/63d3337b-5ac0-478b-9e30-cde11dd2fd07: connection/TLS failure (URLError)"], "error_fraction": 0.030303030303030304, "p50": 0.79, "p95": 1.1397, "p99": 1.2381, "upload_p95": 0.1837}
{"profile": "1024x768", "bytes_per_image": 2360847, "repeat": 3, "concurrency": 2, "requested_duration": 20, "elapsed_seconds": 20.969, "warmup_completed": 1, "completed": 40, "successful_rps": 1.908, "failures": [], "error_fraction": 0.0, "p50": 1.0675, "p95": 1.2299, "p99": 1.3224, "upload_p95": 0.2471}
BIN
View File
Binary file not shown.

After

Width:  |  Height:  |  Size: 46 KiB

+7
View File
@@ -0,0 +1,7 @@
profile,repeat,completed,successful_rps,p50,p95,p99,error_fraction
320x200,1,80,3.982,0.401,0.7265,0.7436,0.0
320x200,2,73,3.607,0.4219,0.7366,0.7857,0.0
320x200,3,71,3.549,0.4389,0.7694,0.82,0.0
1024x768,1,45,2.188,0.8308,1.1487,1.1615,0.0
1024x768,2,32,1.569,0.79,1.1397,1.2381,0.030303030303030304
1024x768,3,40,1.908,1.0675,1.2299,1.3224,0.0
1 profile repeat completed successful_rps p50 p95 p99 error_fraction
2 320x200 1 80 3.982 0.401 0.7265 0.7436 0.0
3 320x200 2 73 3.607 0.4219 0.7366 0.7857 0.0
4 320x200 3 71 3.549 0.4389 0.7694 0.82 0.0
5 1024x768 1 45 2.188 0.8308 1.1487 1.1615 0.0
6 1024x768 2 32 1.569 0.79 1.1397 1.2381 0.030303030303030304
7 1024x768 3 40 1.908 1.0675 1.2299 1.3224 0.0
+37
View File
@@ -0,0 +1,37 @@
Container lyakhonov-lab5-redis-1 Running
Container lyakhonov-lab5-s3-1 Running
Container lyakhonov-lab5-db-1 Running
Container lyakhonov-lab5-broker-1 Running
Container lyakhonov-lab5-dispatcher-1 Running
Container lyakhonov-lab5-staging-cleaner-1 Running
Container lyakhonov-lab5-worker-1 Running
Container lyakhonov-lab5-worker-2 Running
Container lyakhonov-lab5-api-1 Running
Container lyakhonov-lab5-api-2 Running
Container lyakhonov-lab5-lb-1 Running
Container lyakhonov-lab5-bucket-init-1 Starting
Container lyakhonov-lab5-db-1 Waiting
Container lyakhonov-lab5-bucket-init-1 Started
Container lyakhonov-lab5-db-1 Healthy
Container lyakhonov-lab5-migrate-1 Starting
Container lyakhonov-lab5-migrate-1 Started
Container lyakhonov-lab5-migrate-1 Waiting
Container lyakhonov-lab5-bucket-init-1 Waiting
Container lyakhonov-lab5-broker-1 Waiting
Container lyakhonov-lab5-migrate-1 Waiting
Container lyakhonov-lab5-broker-1 Waiting
Container lyakhonov-lab5-bucket-init-1 Waiting
Container lyakhonov-lab5-bucket-init-1 Waiting
Container lyakhonov-lab5-migrate-1 Waiting
Container lyakhonov-lab5-bucket-init-1 Waiting
Container lyakhonov-lab5-migrate-1 Waiting
Container lyakhonov-lab5-broker-1 Healthy
Container lyakhonov-lab5-broker-1 Healthy
Container lyakhonov-lab5-migrate-1 Exited
Container lyakhonov-lab5-migrate-1 Exited
Container lyakhonov-lab5-migrate-1 Exited
Container lyakhonov-lab5-migrate-1 Exited
Container lyakhonov-lab5-bucket-init-1 Exited
Container lyakhonov-lab5-bucket-init-1 Exited
Container lyakhonov-lab5-bucket-init-1 Exited
Container lyakhonov-lab5-bucket-init-1 Exited
+80
View File
@@ -0,0 +1,80 @@
Container lyakhonov-lab5-redis-1 Running
Container lyakhonov-lab5-broker-1 Running
Container lyakhonov-lab5-db-1 Running
Container lyakhonov-lab5-s3-1 Running
Container lyakhonov-lab5-migrate-1 Recreate
Container lyakhonov-lab5-migrate-1 Recreated
Container lyakhonov-lab5-staging-cleaner-1 Recreate
Container lyakhonov-lab5-dispatcher-1 Recreate
Container lyakhonov-lab5-worker-2 Recreate
Container lyakhonov-lab5-api-2 Recreate
Container lyakhonov-lab5-api-1 Recreate
Container lyakhonov-lab5-worker-1 Recreate
Container lyakhonov-lab5-worker-2 Recreated
Container lyakhonov-lab5-worker-1 Recreated
Container lyakhonov-lab5-dispatcher-1 Recreated
Container lyakhonov-lab5-api-2 Recreated
Container lyakhonov-lab5-api-1 Recreated
Container lyakhonov-lab5-lb-1 Running
Container lyakhonov-lab5-staging-cleaner-1 Recreated
Container lyakhonov-lab5-bucket-init-1 Starting
Container lyakhonov-lab5-db-1 Waiting
Container lyakhonov-lab5-bucket-init-1 Started
Container lyakhonov-lab5-db-1 Healthy
Container lyakhonov-lab5-migrate-1 Starting
Container lyakhonov-lab5-migrate-1 Started
Container lyakhonov-lab5-bucket-init-1 Waiting
Container lyakhonov-lab5-broker-1 Waiting
Container lyakhonov-lab5-migrate-1 Waiting
Container lyakhonov-lab5-bucket-init-1 Waiting
Container lyakhonov-lab5-migrate-1 Waiting
Container lyakhonov-lab5-bucket-init-1 Waiting
Container lyakhonov-lab5-migrate-1 Waiting
Container lyakhonov-lab5-bucket-init-1 Waiting
Container lyakhonov-lab5-broker-1 Waiting
Container lyakhonov-lab5-migrate-1 Waiting
Container lyakhonov-lab5-broker-1 Healthy
Container lyakhonov-lab5-broker-1 Healthy
Container lyakhonov-lab5-migrate-1 Exited
Container lyakhonov-lab5-migrate-1 Exited
Container lyakhonov-lab5-migrate-1 Exited
Container lyakhonov-lab5-migrate-1 Exited
Container lyakhonov-lab5-bucket-init-1 Exited
Container lyakhonov-lab5-staging-cleaner-1 Starting
Container lyakhonov-lab5-bucket-init-1 Exited
Container lyakhonov-lab5-worker-2 Starting
Container lyakhonov-lab5-bucket-init-1 Exited
Container lyakhonov-lab5-bucket-init-1 Exited
Container lyakhonov-lab5-dispatcher-1 Starting
Container lyakhonov-lab5-api-1 Starting
Container lyakhonov-lab5-api-1 Started
Container lyakhonov-lab5-api-2 Starting
Container lyakhonov-lab5-staging-cleaner-1 Started
Container lyakhonov-lab5-dispatcher-1 Started
Container lyakhonov-lab5-worker-2 Started
Container lyakhonov-lab5-worker-1 Starting
Container lyakhonov-lab5-api-2 Started
Container lyakhonov-lab5-worker-1 Started
Container lyakhonov-lab5-db-1 Waiting
Container lyakhonov-lab5-worker-2 Waiting
Container lyakhonov-lab5-worker-1 Waiting
Container lyakhonov-lab5-bucket-init-1 Waiting
Container lyakhonov-lab5-migrate-1 Waiting
Container lyakhonov-lab5-s3-1 Waiting
Container lyakhonov-lab5-broker-1 Waiting
Container lyakhonov-lab5-lb-1 Waiting
Container lyakhonov-lab5-dispatcher-1 Waiting
Container lyakhonov-lab5-staging-cleaner-1 Waiting
Container lyakhonov-lab5-api-1 Waiting
Container lyakhonov-lab5-api-2 Waiting
Container lyakhonov-lab5-redis-1 Waiting
Container lyakhonov-lab5-lb-1 Healthy
Container lyakhonov-lab5-redis-1 Healthy
Container lyakhonov-lab5-db-1 Healthy
Container lyakhonov-lab5-migrate-1 Exited
Container lyakhonov-lab5-s3-1 Healthy
Container lyakhonov-lab5-broker-1 Healthy
Container lyakhonov-lab5-bucket-init-1 Exited
Container lyakhonov-lab5-api-1 Healthy
Container lyakhonov-lab5-api-2 Healthy
container lyakhonov-lab5-worker-2 has no healthcheck configured
+176
View File
@@ -0,0 +1,176 @@
{
"command": [
"C:\\Users\\User\\AppData\\Local\\Programs\\Python\\Python313\\python.exe",
"-X",
"utf8",
"tests/resilience.py",
"--mode",
"persistence",
"--base-url",
"http://127.0.0.1:8085",
"--action-script",
"C:\\Users\\User\\Desktop\\vysoko-nagr 5\\scripts\\restart.cmd"
],
"exit_code": 0,
"output": "Executing explicit persistence hook; hook output suppressed to avoid leaking secrets.\nPASS: persistence preserved confirmed data and existing session. Hook scope needs operator evidence.\n",
"before": [
{
"id": "b3f8a331a59832dde80002af9f29c5893381e780803283476c687168ede15842",
"name": "/lyakhonov-lab5-api-1",
"started_at": "2026-11-20T03:56:56.938529239Z",
"running": true
},
{
"id": "a0acb99b68a1f803792742460827528137ac3ab96ec76a68de550f930a4a9368",
"name": "/lyakhonov-lab5-api-2",
"started_at": "2026-11-20T03:56:57.198039404Z",
"running": true
},
{
"id": "b94a25ac1bb3df998e3d0c27beae4b97d655bbc0a7ae520bd60c736cd40462c9",
"name": "/lyakhonov-lab5-broker-1",
"started_at": "2026-11-20T03:56:31.315056049Z",
"running": true
},
{
"id": "fdca00783fcb86e75d3ec4c84494d1571548333d585459191b78992f707729ad",
"name": "/lyakhonov-lab5-bucket-init-1",
"started_at": "2026-11-20T03:58:21.664983091Z",
"running": false
},
{
"id": "10408d41f3b50b0a5e8ad4e21b849fa97548c03f4a535b27c8c919163b9c30b2",
"name": "/lyakhonov-lab5-db-1",
"started_at": "2026-11-20T03:39:52.15355593Z",
"running": true
},
{
"id": "bdedd08309bb0db9dc94235a148fc0938180449b1431059178488d0c6f985049",
"name": "/lyakhonov-lab5-dispatcher-1",
"started_at": "2026-11-20T03:56:56.914519489Z",
"running": true
},
{
"id": "934fcb61b954722ec6f9d3ce84d3399f5a35a30e8368e0ed44a939319ea9ff4f",
"name": "/lyakhonov-lab5-lb-1",
"started_at": "2026-11-20T03:39:59.703127904Z",
"running": true
},
{
"id": "39b8b11f3c7c9e1c3fb778e780dc8d123e4b955669ddee8c85420eefcb3abaca",
"name": "/lyakhonov-lab5-migrate-1",
"started_at": "2026-11-20T03:58:22.174853427Z",
"running": false
},
{
"id": "c3962c31749b802835f909ce1b4efbe34149e88d9bc678ca3b82f9fdbcc97af1",
"name": "/lyakhonov-lab5-redis-1",
"started_at": "2026-11-20T03:39:52.151204203Z",
"running": true
},
{
"id": "0b09dce985685e130ed8774a277a3ff254e8a633ff1dfeed7fd2daf80b78c4e8",
"name": "/lyakhonov-lab5-s3-1",
"started_at": "2026-11-20T03:39:52.148504843Z",
"running": true
},
{
"id": "23b814fb71a813bedb09712be57c736e19460c2c25d2b2b4b0e66facb0bfdab9",
"name": "/lyakhonov-lab5-staging-cleaner-1",
"started_at": "2026-11-20T03:56:56.92548889Z",
"running": true
},
{
"id": "1f724278797561aea476251a8902eac6377039c3e30cbc336d501409af118ae2",
"name": "/lyakhonov-lab5-worker-1",
"started_at": "2026-11-20T03:56:57.356659637Z",
"running": true
},
{
"id": "e36e30c0bc23ffdc3c2c4fe39b57ea98597764dfa313c509bd1734d74b801b44",
"name": "/lyakhonov-lab5-worker-2",
"started_at": "2026-11-20T03:56:56.927116397Z",
"running": true
}
],
"after": [
{
"id": "b3f8a331a59832dde80002af9f29c5893381e780803283476c687168ede15842",
"name": "/lyakhonov-lab5-api-1",
"started_at": "2026-11-20T03:58:31.589874697Z",
"running": true
},
{
"id": "a0acb99b68a1f803792742460827528137ac3ab96ec76a68de550f930a4a9368",
"name": "/lyakhonov-lab5-api-2",
"started_at": "2026-11-20T03:58:31.785178375Z",
"running": true
},
{
"id": "b94a25ac1bb3df998e3d0c27beae4b97d655bbc0a7ae520bd60c736cd40462c9",
"name": "/lyakhonov-lab5-broker-1",
"started_at": "2026-11-20T03:58:31.88055044Z",
"running": true
},
{
"id": "fdca00783fcb86e75d3ec4c84494d1571548333d585459191b78992f707729ad",
"name": "/lyakhonov-lab5-bucket-init-1",
"started_at": "2026-11-20T03:58:21.664983091Z",
"running": false
},
{
"id": "10408d41f3b50b0a5e8ad4e21b849fa97548c03f4a535b27c8c919163b9c30b2",
"name": "/lyakhonov-lab5-db-1",
"started_at": "2026-11-20T03:58:30.504381937Z",
"running": true
},
{
"id": "bdedd08309bb0db9dc94235a148fc0938180449b1431059178488d0c6f985049",
"name": "/lyakhonov-lab5-dispatcher-1",
"started_at": "2026-11-20T03:58:31.312524166Z",
"running": true
},
{
"id": "934fcb61b954722ec6f9d3ce84d3399f5a35a30e8368e0ed44a939319ea9ff4f",
"name": "/lyakhonov-lab5-lb-1",
"started_at": "2026-11-20T03:58:30.862509137Z",
"running": true
},
{
"id": "39b8b11f3c7c9e1c3fb778e780dc8d123e4b955669ddee8c85420eefcb3abaca",
"name": "/lyakhonov-lab5-migrate-1",
"started_at": "2026-11-20T03:58:22.174853427Z",
"running": false
},
{
"id": "c3962c31749b802835f909ce1b4efbe34149e88d9bc678ca3b82f9fdbcc97af1",
"name": "/lyakhonov-lab5-redis-1",
"started_at": "2026-11-20T03:58:30.614258194Z",
"running": true
},
{
"id": "0b09dce985685e130ed8774a277a3ff254e8a633ff1dfeed7fd2daf80b78c4e8",
"name": "/lyakhonov-lab5-s3-1",
"started_at": "2026-11-20T03:58:31.091098179Z",
"running": true
},
{
"id": "23b814fb71a813bedb09712be57c736e19460c2c25d2b2b4b0e66facb0bfdab9",
"name": "/lyakhonov-lab5-staging-cleaner-1",
"started_at": "2026-11-20T03:58:31.667560755Z",
"running": true
},
{
"id": "1f724278797561aea476251a8902eac6377039c3e30cbc336d501409af118ae2",
"name": "/lyakhonov-lab5-worker-1",
"started_at": "2026-11-20T03:58:31.445500705Z",
"running": true
},
{
"id": "e36e30c0bc23ffdc3c2c4fe39b57ea98597764dfa313c509bd1734d74b801b44",
"name": "/lyakhonov-lab5-worker-2",
"started_at": "2026-11-20T03:58:31.518418339Z",
"running": true
}
]
}
+56
View File
@@ -0,0 +1,56 @@
PASS: negative_upload_acl_and_24_concurrent_messages
PASS: accepted_survives_api_broker_restart
PASS: before_publish
PASS: after_publish
PASS: before_effect
PASS: after_original
PASS: after_variants
PASS: after_commit
PASS: before_publish
PASS: after_publish
PASS: before_effect
PASS: after_original
PASS: after_variants
PASS: after_commit
PASS: before_publish
PASS: after_publish
PASS: before_effect
PASS: after_original
PASS: after_variants
PASS: after_commit
Traceback (most recent call last):
File "C:\Users\User\Desktop\vysoko-nagr 5\student-tests\pipeline.py", line 234, in <module>
Experiment(parser.parse_args()).main()
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^
File "C:\Users\User\Desktop\vysoko-nagr 5\student-tests\pipeline.py", line 222, in main
self.versions()
~~~~~~~~~~~~~^^
File "C:\Users\User\Desktop\vysoko-nagr 5\student-tests\pipeline.py", line 135, in versions
objects = self.probe('objects', id=att['id'])
File "C:\Users\User\Desktop\vysoko-nagr 5\student-tests\pipeline.py", line 35, in probe
check(result.returncode == 0, 'probe failed: ' + result.stderr)
~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\User\Desktop\vysoko-nagr 5\tests\client.py", line 24, in check
raise Failure(message)
client.Failure: probe failed: Traceback (most recent call last):
File "<stdin>", line 54, in <module>
File "<stdin>", line 35, in run
File "/usr/local/lib/python3.11/site-packages/botocore/paginate.py", line 272, in __iter__
response = self._make_request(current_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/botocore/context.py", line 123, in wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/botocore/paginate.py", line 360, in _make_request
return self._method(**current_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/botocore/client.py", line 602, in _api_call
return self._make_api_call(operation_name, kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/botocore/context.py", line 123, in wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/botocore/client.py", line 1078, in _make_api_call
raise error_class(parsed_response, operation_name)
botocore.exceptions.ClientError: An error occurred (AccessDenied) when calling the ListObjectsV2 operation: Access Denied.
+8
View File
@@ -0,0 +1,8 @@
PASS: stale_running_worker_and_reordered_duplicates
PASS: upgrade_ready_after_staging_cleanup
PASS: stale_running_worker_and_reordered_duplicates
PASS: upgrade_ready_after_staging_cleanup
PASS: stale_running_worker_and_reordered_duplicates
PASS: upgrade_ready_after_staging_cleanup
PASS: permanent_error_and_explicit_replay
PASS: transient_error_and_explicit_replay
+56
View File
@@ -0,0 +1,56 @@
PASS: negative_upload_acl_and_24_concurrent_messages
PASS: accepted_survives_api_broker_restart
PASS: before_publish
PASS: after_publish
PASS: before_effect
PASS: after_original
PASS: after_variants
PASS: after_commit
PASS: before_publish
PASS: after_publish
PASS: before_effect
PASS: after_original
PASS: after_variants
PASS: after_commit
PASS: before_publish
PASS: after_publish
PASS: before_effect
PASS: after_original
PASS: after_variants
PASS: after_commit
Traceback (most recent call last):
File "C:\Users\User\Desktop\vysoko-nagr 5\student-tests\pipeline.py", line 234, in <module>
Experiment(parser.parse_args()).main()
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^
File "C:\Users\User\Desktop\vysoko-nagr 5\student-tests\pipeline.py", line 222, in main
self.versions()
~~~~~~~~~~~~~^^
File "C:\Users\User\Desktop\vysoko-nagr 5\student-tests\pipeline.py", line 135, in versions
objects = self.probe('objects', id=att['id'])
File "C:\Users\User\Desktop\vysoko-nagr 5\student-tests\pipeline.py", line 35, in probe
check(result.returncode == 0, 'probe failed: ' + result.stderr)
~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\User\Desktop\vysoko-nagr 5\tests\client.py", line 24, in check
raise Failure(message)
client.Failure: probe failed: Traceback (most recent call last):
File "<stdin>", line 54, in <module>
File "<stdin>", line 35, in run
File "/usr/local/lib/python3.11/site-packages/botocore/paginate.py", line 272, in __iter__
response = self._make_request(current_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/botocore/context.py", line 123, in wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/botocore/paginate.py", line 360, in _make_request
return self._method(**current_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/botocore/client.py", line 602, in _api_call
return self._make_api_call(operation_name, kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/botocore/context.py", line 123, in wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/botocore/client.py", line 1078, in _make_api_call
raise error_class(parsed_response, operation_name)
botocore.exceptions.ClientError: An error occurred (AccessDenied) when calling the ListObjectsV2 operation: Access Denied.
File diff suppressed because it is too large Load Diff
+37
View File
@@ -0,0 +1,37 @@
Executing explicit persistence hook; hook output suppressed to avoid leaking secrets.
PASS: persistence preserved confirmed data and existing session. Hook scope needs operator evidence.
Container lyakhonov-lab5-db-1 Waiting
Container lyakhonov-lab5-bucket-init-1 Starting
Container lyakhonov-lab5-bucket-init-1 Started
Container lyakhonov-lab5-db-1 Healthy
Container lyakhonov-lab5-migrate-1 Starting
Container lyakhonov-lab5-migrate-1 Started
Container lyakhonov-lab5-migrate-1 Waiting
Container lyakhonov-lab5-bucket-init-1 Waiting
Container lyakhonov-lab5-migrate-1 Exited
Container lyakhonov-lab5-bucket-init-1 Exited
Executing explicit failover hook; hook output suppressed to avoid leaking secrets.
{"observed_instances_before": 2, "successful_writes": 88, "failed_attempts": 4, "first_recovery_seconds": 2.856}
PASS: failover preserved confirmed data and existing session. Hook scope needs operator evidence.
Container lyakhonov-lab5-bucket-init-1 Starting
Container lyakhonov-lab5-db-1 Waiting
Container lyakhonov-lab5-bucket-init-1 Started
Container lyakhonov-lab5-db-1 Healthy
Container lyakhonov-lab5-migrate-1 Starting
Container lyakhonov-lab5-migrate-1 Started
Container lyakhonov-lab5-bucket-init-1 Waiting
Container lyakhonov-lab5-migrate-1 Waiting
Container lyakhonov-lab5-migrate-1 Exited
Container lyakhonov-lab5-bucket-init-1 Exited
Container lyakhonov-lab5-api-2 Starting
Container lyakhonov-lab5-api-2 Started
Traceback (most recent call last):
File "C:\Users\User\Desktop\vysoko-nagr 5\student-tests\resilience_driver.py", line 82, in <module>
targeted()
~~~~~~~~^^
File "C:\Users\User\Desktop\vysoko-nagr 5\student-tests\resilience_driver.py", line 62, in targeted
messages = list(page['items'])
~~~~^^^^^^^^^
TypeError: 'NoneType' object is not subscriptable
+37
View File
@@ -0,0 +1,37 @@
Executing explicit persistence hook; hook output suppressed to avoid leaking secrets.
PASS: persistence preserved confirmed data and existing session. Hook scope needs operator evidence.
Container lyakhonov-lab5-db-1 Waiting
Container lyakhonov-lab5-bucket-init-1 Starting
Container lyakhonov-lab5-bucket-init-1 Started
Container lyakhonov-lab5-db-1 Healthy
Container lyakhonov-lab5-migrate-1 Starting
Container lyakhonov-lab5-migrate-1 Started
Container lyakhonov-lab5-migrate-1 Waiting
Container lyakhonov-lab5-bucket-init-1 Waiting
Container lyakhonov-lab5-migrate-1 Exited
Container lyakhonov-lab5-bucket-init-1 Exited
Executing explicit failover hook; hook output suppressed to avoid leaking secrets.
{"observed_instances_before": 2, "successful_writes": 88, "failed_attempts": 4, "first_recovery_seconds": 2.856}
PASS: failover preserved confirmed data and existing session. Hook scope needs operator evidence.
Container lyakhonov-lab5-bucket-init-1 Starting
Container lyakhonov-lab5-db-1 Waiting
Container lyakhonov-lab5-bucket-init-1 Started
Container lyakhonov-lab5-db-1 Healthy
Container lyakhonov-lab5-migrate-1 Starting
Container lyakhonov-lab5-migrate-1 Started
Container lyakhonov-lab5-bucket-init-1 Waiting
Container lyakhonov-lab5-migrate-1 Waiting
Container lyakhonov-lab5-migrate-1 Exited
Container lyakhonov-lab5-bucket-init-1 Exited
Container lyakhonov-lab5-api-2 Starting
Container lyakhonov-lab5-api-2 Started
Traceback (most recent call last):
File "C:\Users\User\Desktop\vysoko-nagr 5\student-tests\resilience_driver.py", line 82, in <module>
targeted()
~~~~~~~~^^
File "C:\Users\User\Desktop\vysoko-nagr 5\student-tests\resilience_driver.py", line 62, in targeted
messages = list(page['items'])
~~~~^^^^^^^^^
TypeError: 'NoneType' object is not subscriptable
+1
View File
@@ -0,0 +1 @@
PASS: lab5 public API scenario; infrastructure and grading evidence remain separate.
+1
View File
@@ -0,0 +1 @@
PASS: offline skeleton structure, local refs and Python syntax; application NOT tested.
+5
View File
@@ -0,0 +1,5 @@
..
----------------------------------------------------------------------
Ran 2 tests in 0.142s
OK
+1
View File
@@ -0,0 +1 @@
PASS: full OpenAPI 3.1 and JSON Schema validation; application NOT tested.
+2
View File
@@ -0,0 +1,2 @@
-r requirements-dev.txt
matplotlib==3.10.7
+1 -1
View File
@@ -41,7 +41,7 @@ def main():
assert not path.startswith('secrets/') and path != '.env', 'Tracked private state'
content = (ROOT / path).read_bytes()
assert not any(value and value in content for value in secret_values), 'Local secret leaked in ' + path
assert b'-----BEGIN PRIVATE KEY-----' not in content, 'Private key found'
assert (b'-----BEGIN ' + b'PRIVATE KEY-----') not in content, 'Private key found in ' + path
authors = git(ROOT, 'log', '276dbda..HEAD', '--format=%h|%an|%ae|%cn|%ce').splitlines()
for row in authors:
assert row.split('|')[1:] == ['Sergey Lyakhonov', 'lyserg119@gmail.com'] * 2, 'Wrong author/committer'
+2
View File
@@ -14,6 +14,7 @@ def output(*args):
ids = output('docker', 'compose', '-p', 'lyakhonov-lab5', 'ps', '-q').split()
containers = json.loads(output('docker', 'inspect', *ids))
result = dict(commit=output('git', 'rev-parse', 'HEAD'), python=platform.python_version(),
working_tree_dirty=bool(output('git', 'status', '--porcelain')),
docker=json.loads(output('docker', 'version', '--format', '{{json .}}')),
compose=output('docker', 'compose', 'version'),
engine=json.loads(output('docker', 'info', '--format', '{"memory_bytes":{{.MemTotal}},"cpus":{{.NCPU}}}')),
@@ -21,6 +22,7 @@ result = dict(commit=output('git', 'rev-parse', 'HEAD'), python=platform.python_
for row in containers:
result['services'].append(dict(service=row['Config']['Labels']['com.docker.compose.service'], id=row['Id'],
image=row['Config']['Image'], image_id=row['Image'], started_at=row['State']['StartedAt'],
restart_count=row['RestartCount'], oom_killed=row['State'].get('OOMKilled', False),
memory_limit=row['HostConfig']['Memory'], nanocpus=row['HostConfig']['NanoCpus'],
ports=row['HostConfig']['PortBindings'],
settings=[x for x in row['Config']['Env'] if x.startswith(('JOB_', 'WORKER_', 'LAB5_FAULT_', 'STAGING_RETENTION_'))]))
+36
View File
@@ -0,0 +1,36 @@
"""Финальные агрегаты собственного стенда без пользовательских данных и секретов."""
import json
from pathlib import Path
import subprocess
import re
ROOT = Path(__file__).resolve().parents[1]
load = json.loads((ROOT / 'evidence/load-pipeline.json').read_text(encoding='utf-8'))
failed_ids = sorted(set(re.findall(r'[0-9a-f]{8}(?:-[0-9a-f]{4}){3}-[0-9a-f]{12}',
' '.join(error for row in load for error in row['failures']))))
script = 'FAILED_IDS=' + repr(failed_ids) + '\n' + '''
import json
from src.storage import storage
storage.pool.open(wait=True)
try:
with storage.pool.connection() as conn:
result = {
'attachments': conn.execute('SELECT state,count(*) AS count FROM attachments GROUP BY state').fetchall(),
'jobs': conn.execute('SELECT state,pipeline_version,count(*) AS count FROM attachment_jobs GROUP BY state,pipeline_version ORDER BY pipeline_version,state').fetchall(),
'replays': conn.execute('SELECT count(*) AS count FROM attachment_replays').fetchone()['count'],
'load_observation_errors': conn.execute('SELECT id,state,published_pipeline_version,target_pipeline_version FROM attachments WHERE id=ANY(%s::uuid[])', (FAILED_IDS,)).fetchall(),
'violations': conn.execute("""SELECT count(*) AS count FROM attachments a
WHERE state <> 'ready' OR published_pipeline_version <> target_pipeline_version
OR (SELECT count(*) FROM attachment_variants v WHERE v.attachment_id=a.id
AND v.pipeline_version=a.published_pipeline_version) <> 3""").fetchone()['count']
}
print(json.dumps(result, default=str))
finally:
storage.pool.close()
'''
output = subprocess.check_output(['docker','compose','-p','lyakhonov-lab5','exec','-T','--index','1','api','python','-'],
input=script, cwd=ROOT, text=True, encoding='utf-8')
result = json.loads(output)
(ROOT / 'evidence/final-state.json').write_text(json.dumps(result, indent=2), encoding='utf-8')
assert result['violations'] == 0, 'Incomplete or inconsistent current manifests'
print(output)
+8 -5
View File
@@ -30,27 +30,30 @@ def main():
(directory / 'repro-override.json').write_text(json.dumps(override), encoding='utf-8')
compose = ['docker', 'compose', '-p', name, '-f', 'compose.yaml', '-f', 'repro-override.json']
events = []
def run(args):
def run(args, required=True):
result = subprocess.run(args, cwd=directory, env=env, text=True, encoding='utf-8', capture_output=True)
# Только безопасные последние строки: ни inspect .Config.Env, ни secret files.
events.append(dict(command=args, exit_code=result.returncode, output=(result.stdout + result.stderr)[-5000:]))
if result.returncode:
if result.returncode and required:
raise RuntimeError('reproduction failed: ' + ' '.join(args))
try:
run([sys.executable, '-X', 'utf8', 'scripts/bootstrap.py'])
run([sys.executable, '-X', 'utf8', 'scripts/check_contract.py'])
run(['docker', 'build', '-t', images[0], '.'])
run(['docker', 'build', '-t', images[1], '-f', 'Dockerfile.s3', '.'])
run([*compose, 'up', '-d', '--wait'])
run([*compose, 'up', '-d'])
run([sys.executable, '-X', 'utf8', 'scripts/wait_ready.py', '--project', name, '--base-url', f'http://127.0.0.1:{port}'])
run([sys.executable, '-X', 'utf8', 'tests/smoke.py', '--base-url', f'http://127.0.0.1:{port}'])
run([*compose, 'ps'])
finally:
run([*compose, 'down', '--volumes', '--remove-orphans'])
run([*compose, 'down', '--volumes', '--remove-orphans'], required=False)
for tag in images:
run(['docker', 'image', 'rm', tag])
run(['docker', 'image', 'rm', tag], required=False)
result = dict(project=name, directory=str(directory), port=port,
commit=subprocess.check_output(['git', 'rev-parse', 'HEAD'], cwd=ROOT, text=True).strip(), events=events)
(ROOT / 'evidence/reproduction.json').write_text(json.dumps(result, ensure_ascii=False, indent=2), encoding='utf-8')
if any(event['exit_code'] for event in events):
raise SystemExit('Reproduction or cleanup failed; see evidence/reproduction.json')
print('PASS: clean export, fresh secrets, isolated project; temporary Docker resources removed')
+43
View File
@@ -0,0 +1,43 @@
"""Таблица отчёта из JSON; без ручного переноса значений."""
import csv
import json
from pathlib import Path
import re
ROOT = Path(__file__).resolve().parents[1]
load = json.loads((ROOT / 'evidence/load-pipeline.json').read_text(encoding='utf-8'))
faults = json.loads((ROOT / 'evidence/pipeline.json').read_text(encoding='utf-8'))
text = ['| Профиль | Bytes/image | Завершено за 3 повтора | Успешных image/s (min–max) | p50 ready, s | p95 ready, s | p99 ready, s | Ошибки |',
'| --- | --- | --- | --- | --- | --- | --- | --- |']
for profile in sorted({r['profile'] for r in load}):
rows = [r for r in load if r['profile'] == profile]
def span(key):
return f"{min(r[key] for r in rows):.3f}–{max(r[key] for r in rows):.3f}"
text.append(f"| {profile} | {rows[0]['bytes_per_image']} | {sum(r['completed'] for r in rows)} | {span('successful_rps')} | {span('p50')} | {span('p95')} | {span('p99')} | {sum(len(r['failures']) for r in rows)} |")
def mib(value):
number, unit = re.match(r'([0-9.]+)([A-Za-z]+)', value.strip()).groups()
return float(number) * {'B':1/1048576,'KiB':1/1024,'MiB':1,'GiB':1024,'kB':1000/1048576,'MB':1000000/1048576,'GB':1000000000/1048576}[unit]
snapshots = [s for r in load for s in r['stats']]
peak_cpu = max(sum(float(c['CPUPerc'].strip('%')) for c in s['containers']) for s in snapshots)
peak_memory = max(sum(mib(c['MemUsage'].split('/')[0]) for c in s['containers']) for s in snapshots)
text.extend(['', f'В собранных snapshots максимальная сумма CPU контейнеров: **{peak_cpu:.1f}%** (100% = один CPU); сумма cgroup memory: **{peak_memory:.1f} MiB**. Это максимум редких снимков, не непрерывно измеренный пик.', ''])
points = ('before_publish','after_publish','before_effect','after_original','after_variants','after_commit')
text.extend(['| Точка crash | Повторов | Полная длительность сценария, s (min–max) |', '| --- | --- | --- |'])
for point in points:
rows = [r for r in faults if r['scenario'] == point]
text.append(f"| {point} | {len(rows)} | {min(r['seconds'] for r in rows):.3f}–{max(r['seconds'] for r in rows):.3f} |")
text.extend(['', 'Во всех сохранённых crash/version/replay-сценариях проверки инвариантов прошли. Увеличение входного изображения снижает throughput и повышает время до ready в измеренном профиле. Повторы показывают разброс, а не статистически надёжную оценку хвостов: выборка и длительность малы.'])
path = ROOT / 'REPORT.md'
report = path.read_text(encoding='utf-8')
begin, end = '<!-- MEASUREMENTS BEGIN -->', '<!-- MEASUREMENTS END -->'
block = begin + '\n\n' + '\n'.join(text) + '\n\n' + end
if begin in report:
report = report[:report.index(begin)] + block + report[report.index(end)+len(end):]
else:
report = report.replace('<!-- MEASUREMENTS -->', block)
path.write_text(report, encoding='utf-8')
with (ROOT / 'evidence/measurements.csv').open('w', newline='', encoding='utf-8') as target:
writer = csv.DictWriter(target, fieldnames=['profile','repeat','completed','successful_rps','p50','p95','p99','error_fraction'])
writer.writeheader()
writer.writerows({key:row[key] for key in writer.fieldnames} for row in load)
print('\n'.join(text))
+44
View File
@@ -0,0 +1,44 @@
"""Явная готовность API, stores и процессов; smoke проверяет обработку задания."""
import argparse
import json
import subprocess
import time
import urllib.error
import urllib.request
def main():
parser = argparse.ArgumentParser()
parser.add_argument('--project', default='lyakhonov-lab5')
parser.add_argument('--base-url', default='http://127.0.0.1:8085')
args = parser.parse_args()
deadline = time.monotonic()+120
observed = set()
while time.monotonic() < deadline:
ids = subprocess.check_output(['docker','compose','-p',args.project,'ps','-q'], text=True).split()
if not ids:
time.sleep(1)
continue
rows = json.loads(subprocess.check_output(['docker','inspect',*ids], text=True))
services = {}
for row in rows:
name = row['Config']['Labels']['com.docker.compose.service']
services.setdefault(name, []).append(row['State'])
running = all(services.get(name) and all(s['Running'] for s in services[name])
for name in ('api','db','s3','broker','dispatcher','worker','staging-cleaner','lb'))
healthy = all(services.get(name) and all(s.get('Health',{}).get('Status') == 'healthy' for s in services[name])
for name in ('db','broker','api'))
try:
with urllib.request.urlopen(args.base_url+'/health/ready', timeout=2) as response:
observed.add(response.headers.get('X-Instance-Id'))
except (urllib.error.URLError, TimeoutError, OSError):
pass
if running and healthy and len(services.get('api', [])) >= 2 and len(observed - {None}) >= 2:
print('PASS: two ready API instances, healthy DB/broker, required background containers running')
return
time.sleep(.5)
raise SystemExit('Readiness deadline exceeded')
if __name__ == '__main__':
main()
+22
View File
@@ -0,0 +1,22 @@
"""Публичная нагрузка сообщений с отдельными cgroup CPU/memory snapshots."""
import json
from pathlib import Path
import subprocess
import sys
import time
ROOT = Path(__file__).resolve().parents[1]
command = [sys.executable, '-X', 'utf8', 'tests/load.py', '--base-url', 'http://127.0.0.1:8085',
'--duration', '30', '--concurrency', '4', '--output', 'evidence/load-messages.json']
with (ROOT / 'evidence/load-messages-run.txt').open('w', encoding='utf-8') as output:
process = subprocess.Popen(command, cwd=ROOT, stdout=output, stderr=subprocess.STDOUT)
samples = []
start = time.monotonic()
while process.poll() is None:
ids = subprocess.check_output(['docker', 'compose', '-p', 'lyakhonov-lab5', 'ps', '-q'], cwd=ROOT, text=True).split()
stats = subprocess.check_output(['docker', 'stats', '--no-stream', '--format', '{{json .}}', *ids], text=True)
samples.append(dict(at_seconds=round(time.monotonic()-start, 3), containers=[json.loads(x) for x in stats.splitlines()]))
time.sleep(2)
code = process.wait()
(ROOT / 'evidence/load-messages-resources.json').write_text(json.dumps(dict(command=command, exit_code=code, samples=samples), indent=2), encoding='utf-8')
raise SystemExit(code)
+1 -1
View File
@@ -51,7 +51,7 @@ def main(args):
c = Client(args.base_url)
begin = time.monotonic()
att = c.call('POST', '/api/v1/chats/' + chat['id'] + '/attachments?filename=load.png', 202,
raw=raw, actor=alice, headers={'Content-Type': 'image/png'})['json']
raw=raw, actor=alice, headers={'Content-Type': 'image/png'}, schema='Attachment')['json']
accepted = time.monotonic()
ready = c.wait_ready(alice, att)
check(len(ready['variants']) == 3 and ready['sha256'] == hashlib.sha256(raw).hexdigest(), 'bad load result')
+1
View File
@@ -212,6 +212,7 @@ class Experiment:
upload(huge, 413)
att = self.upload()
self.invariant(att)
check(self.probe('anonymous', id=att['id']) == 403, 'bucket allows anonymous reads')
self.c.call('GET', '/api/v1/attachments/' + att['id'], 404, actor=self.eve)
self.c.call('GET', '/api/v1/attachments/' + att['id'] + '/content', 404, actor=self.eve)
key = os.urandom(16).hex()
+11
View File
@@ -10,6 +10,17 @@ from src.storage import storage
def run(args):
action = args['action']
if action == 'anonymous':
import boto3
from botocore import UNSIGNED
from botocore.config import Config
from botocore.exceptions import ClientError
s3 = boto3.client('s3', endpoint_url='http://s3:9000', config=Config(signature_version=UNSIGNED))
try:
s3.get_object(Bucket=BUCKET, Key=f"originals/{args['id']}")
except ClientError as exc:
return exc.response['ResponseMetadata']['HTTPStatusCode']
return 200
if action == 'sql':
with storage.pool.connection() as conn:
cursor = conn.execute(args['query'], args.get('params', []))
+2 -2
View File
@@ -58,11 +58,11 @@ def targeted():
errors.append(str(exc))
time.sleep(.05)
check(first is not None and first <= 10, 'slow API failover')
page = c.call('GET', '/api/v1/chats/' + chat['id'] + '/messages?limit=100', actor=alice)['json']
page = c.call('GET', '/api/v1/chats/' + chat['id'] + '/messages?limit=100', actor=alice, schema='MessagePage')['json']
messages = list(page['items'])
while page['next_cursor']:
from urllib.parse import quote
page = c.call('GET', '/api/v1/chats/' + chat['id'] + '/messages?limit=100&cursor=' + quote(page['next_cursor'], safe=''), actor=alice)['json']
page = c.call('GET', '/api/v1/chats/' + chat['id'] + '/messages?limit=100&cursor=' + quote(page['next_cursor'], safe=''), actor=alice, schema='MessagePage')['json']
messages.extend(page['items'])
found = {m['id'] for m in messages}
check(all(m['id'] in found for m in responses), 'acknowledged message lost')