lab3: результаты Docker-стенда и трека 1, отчёт

- доказательства уровней 3–4 (прогон 2 на GitHub runner)
- трек 1: 129 прогонов серий A–E, анализ, графики, подтверждённое улучшение
- Dockerfile: базовые образы закреплены по digest
- собственные тесты перенесены в student-tests/

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
2026-10-23 18:06:45 +03:00
co-authored by Claude Opus 5.5
parent 0a3718134b
commit 7366f430ca
24 changed files with 699 additions and 75 deletions
+2 -2
View File
@@ -1,7 +1,7 @@
# ============================================================
# Stage 1: builder — компилируем статический бинарник
# ============================================================
FROM golang:1.26-alpine AS builder
FROM golang:1.26-alpine@sha256:27f2d3b83cfc5803c8078f8e730af0f7c431bf067afaec8f60a36fb763187cba AS builder
WORKDIR /src
@@ -25,7 +25,7 @@ RUN CGO_ENABLED=0 GOOS=linux go build \
# ============================================================
# Stage 2: runtime — минимальный образ только с бинарником
# ============================================================
FROM alpine:3.20
FROM alpine:3.20@sha256:d9e853e87e55526f6b2917df91a2115c36dd7c696a35be12163d44e6e2a4b6bc
# ca-certificates — для HTTPS в lab2+
# tzdata — для корректной работы с временными зонами
+118 -66
View File
@@ -2,21 +2,21 @@
- Автор, группа: Вейнмайер Андрей Андреевич, БВТ2303
- Целевая оценка: 5 (уровни 3, 4 и трек 1 «Цена масштабирования»)
- Commit/PR: TODO после публикации
- Commit/PR: ветка `solution/bvt2303-weinmaier` в https://gitea.privcloud.tech/WeinmaierAndrew/mtusi2026lab3, PR в mtusi2026/mtusi2026lab3
- Основа: собственная lab2 — https://gitea.privcloud.tech/WeinmaierAndrew/mtusi2026lab2
- Использованные источники:
- Контракт: contracts/openapi.json, contracts/README.md (раздел «Балансировка и повторная отправка»)
- Go: net/http (Server.Shutdown), log/slog, sync/atomic, crypto/sha256
- Библиотеки: github.com/jackc/pgx/v5, github.com/redis/go-redis/v9, golang.org/x/crypto/argon2
- Документация: HAProxy 3.0 (server-template, resolvers, http-check, retry-on), Docker Compose services/deploy, PostgreSQL INSERT … ON CONFLICT
- AI-ассистент использован для переноса кода lab2, реализации идемпотентности, конфигурации LB и скриптов; код проверен вручную и тестами.
- AI-ассистент (Claude) использован для переноса кода lab2, реализации идемпотентности, конфигурации LB, скриптов, генератора нагрузки и анализа. Все результаты ниже — реальные прогоны, ссылки на них приведены.
## Запуск из чистого clone
### Версии
| Компонент | Образ / версия |
| --- | --- |
| API builder / runtime | golang:1.26-alpine / alpine:3.20 (multi-stage, бинарник static, USER 1001) |
| API builder / runtime | golang:1.26-alpine / alpine:3.20, закреплены по digest в Dockerfile (multi-stage, static, USER 1001) |
| LB | haproxy:3.0.5-alpine |
| БД | postgres:16.4-alpine |
| Сессии + кэш | redis:7.4.1-alpine (AOF, appendfsync everysec) |
@@ -96,105 +96,157 @@ migrate (one-shot) ──► postgres — до старта api
**Соответствие .env.example:** APP_HOST/APP_PORT/APP_ENV/SESSION_TTL_SECONDS/IDEMPOTENCY_TTL_SECONDS — как есть; DATABASE_URL_FILE и CACHE_URL_FILE — docker secrets `/run/secrets/*`; SESSION_STORE=redis (сессии в Redis с lab2); API_REPLICAS → `deploy.replicas`; DRAIN_DELAY/SHUTDOWN_TIMEOUT — добавлены.
## Где запускался стенд
На машине разработки Docker Desktop не запускается: в BIOS выключена аппаратная виртуализация (`VirtualizationFirmwareEnabled=False`, backend `hasNoVirtualization=true`). Поэтому все Docker-проверки выполнены на **GitHub-hosted runner** workflow [.github/workflows/lab3-stand.yml](.github/workflows/lab3-stand.yml) — тот же compose.yaml и те же скрипты, что и в инструкции выше:
| Прогон | Что | Ссылка |
| --- | --- | --- |
| 1 (commit fe4b4cf) | уровни 3–4 (найден баг rolling update), трек 1: серии A, B, D | https://github.com/CharaWein/2026_lab3/actions/runs/39970452644 |
| 2 (commit 0a37181) | уровни 3–4 после исправления — **доказательства ниже из этого прогона**; трек 1: серии C, E | https://github.com/CharaWein/2026_lab3/actions/runs/39972671424 |
Runner: 2 vCPU (AMD EPYC 7763 / 9V74, Intel Xeon 6973P — модель разная для разных job, записана в `evidence/track1/runner_*.txt`), 8 GB RAM, Docker 28.0.4, Compose v2.38.2 (`evidence/runner.txt`). Каждая серия трека 1 выполнялась целиком на одном runner, поэтому сравнения **внутри** серии корректны, а абсолютные RPS **между** сериями сравнивать нельзя.
До Docker-прогона логика приложения дополнительно проверялась нативно (PostgreSQL 17, fakeredis, 2 процесса API за временным прокси) — `evidence/local_native_check.txt`, `evidence/idempotency_concurrent_native.json`.
## Доказательства критериев
### Что уже проверено
Docker Desktop на машине разработки не запускает движок (`backend state: hasNoVirtualization=true` — выключена аппаратная виртуализация / нет WSL2), поэтому логика приложения проверена **нативно**: PostgreSQL 17 (initdb), fakeredis (TCP) вместо Redis, 2 процесса API с разными `INSTANCE_ID` за временным round-robin прокси (заменитель HAProxy только для этой проверки). Это доказывает корректность кода, но **не** инфраструктуры Compose/HAProxy.
### Уровень 3
| Критерий README | Команда/сценарий | Наблюдаемый результат | Файл |
| --- | --- | --- | --- |
| Публичный smoke | tests/smoke.py | PASS: lab3 public API scenario | evidence/local_native_check.txt |
| Негативные проверки lab2 | student-tests/negative.py | PASS | evidence/local_native_check.txt |
| Отказ реплики, ≥2 реплик до отказа | tests/resilience.py --mode failover | PASS, observed 2, 21 успешных записей, 7 ошибок переходного периода, первая запись после hook за 3.7 s, дублей нет | evidence/local_native_check.txt |
| Конкурентный повтор одного ключа через разные реплики | student-tests/idempotency_concurrent.py (10 раундов × 16 параллельно) | PASS: 160/160 → 201 с одинаковым Message, 1 сообщение на ключ, 2 реплики, 409 на другой body, ключ изолирован по чату/пользователю, посторонний — 404 | evidence/idempotency_concurrent_native.json |
| compose.yaml корректен | docker compose --env-file .env config --quiet | OK; 2 реплики, лимиты, опубликован только lb | — |
| Стенд в compose.yaml, одна последовательность запуска | `scripts/init-secrets.sh` → `docker compose up -d --build --wait` | lb, 2×api, postgres, redis healthy; migrate отработал однократно | evidence/docker_ps.txt |
| ≥2 реплики, одна точка входа, общая БД и сессии | `docker compose ps` | опубликованы только `127.0.0.1:8080` (lb) и `:8404` (stats); api — только `8080/tcp` внутри сети | evidence/docker_ps.txt |
| Запросы одной сессии обслуживают разные реплики | 20 запросов через LB; 40 запросов `/users/me` в failover-тесте | `259a4143c86a`×10, `904a0714df9b`×10; `observed_instances_before: 2` | evidence/instances.txt, evidence/failover_1.txt |
| Публичный smoke | `make test` | `PASS: lab3 public API scenario` | evidence/smoke.txt |
| Отказ одной реплики ≤10 s | `make test-failover ACTION_SCRIPT=scripts/stop-one.sh`, 2 прогона, между ними `restore.sh` | PASS ×2; 143 и 144 успешных записи, **0** ошибок, первая запись после hook за 3.39 s и 3.36 s; остановленный контейнер `Exited (0)` | evidence/failover_1.txt, failover_2.txt |
| Повтор POST с тем же ключом без дублей (конкурентно, через разные реплики) | `make test-idempotency`: 10 раундов × 16 параллельных запросов | 160/160 → 201 с одним Message, 1 сообщение на ключ, 2 реплики, `duplicates_found: 0`; другой body — 409; ключ изолирован по чату и пользователю | evidence/idempotency_concurrent.json |
| Persistence с прежним токеном | `make test-persistence ACTION_SCRIPT=scripts/restart.sh` | PASS; перезапущены postgres, redis, api, lb (uptime до/после в файле), volumes сохранены | evidence/persistence.txt |
### На Docker-стенде (заполнить после `sh scripts/collect-evidence.sh`)
Публичный failover-тест останавливает реплику, обслужившую первый запрос; в обоих прогонах это была `api-2`. Остановка **каждой** реплики по очереди показана в серии уровня 4 ниже.
### Уровень 4
| Критерий README | Команда/сценарий | Наблюдаемый результат | Файл |
| --- | --- | --- | --- |
| ≥2 X-Instance-Id через LB с одной сессией | collect-evidence: instances + make test-failover | TODO | evidence/instances.txt |
| Публичный smoke | make test | TODO | evidence/smoke.txt |
| Отказ любой одной реплики ≤10 s | make test-failover ×2 + restore | TODO | evidence/failover_1.txt, failover_2.txt |
| Persistence с прежним токеном | make test-persistence ACTION_SCRIPT=scripts/restart.sh | TODO | evidence/persistence.txt |
| Идемпотентность параллельно | make test-idempotency | TODO | evidence/idempotency_concurrent.json |
| 4: поочерёдный отказ каждой реплики, RPS/ошибки/восстановление | make test-failover-series | TODO | evidence/failover_series.json |
| 4: rolling update под нагрузкой | scripts/rolling-update.sh + tests/load.py | TODO | evidence/rolling_update*.{txt,json} |
| 4: лимиты, нет портов api, нет container_name | docker compose config, docker compose ps | TODO | evidence/docker_ps.txt |
| Health/readiness, timeouts, SIGTERM согласованы; LB исключает backend | drain 3 s + HAProxy check inter 1 s × fall 2; `docker stop` | после SIGTERM реплика отвечала ещё 0.75 s / 1.46 s, затем исчезла из ответов LB; **0 ошибок**. Период проверки 1 s, максимальное время обнаружения ≈2 s | evidence/failover_series.json |
| Поочерёдная остановка каждой реплики: RPS, ошибки, восстановление | `make test-failover-series` (4 потока, POST+GET) | таблица ниже | evidence/failover_series.json |
| Параллельная идемпотентность | см. уровень 3 | 0 дублей | evidence/idempotency_concurrent.json |
| CPU/RAM-лимиты, api без портов, нет container_name | compose.yaml, `docker stats` | api 0.5 CPU/256M, lb 0.5/128M, postgres 1.0/512M, redis 0.5/256M | evidence/docker_stats.txt, evidence/docker_ps.txt |
| Rolling update под нагрузкой | `scripts/rolling-update.sh` во время 90 s `tests/load.py` | api-1, api-2 → api-3, api-4 за 27 s; **33 461 запрос, 0 ошибок**, 371 RPS, p99 27.7 ms | evidence/rolling_update.txt, rolling_update_load.json |
| Миграции однократно и совместимы | сервис `migrate` + `docker compose run --rm migrate` перед заменой | `no change`; 0002 только добавляет таблицу (expand) | evidence/rolling_update.txt |
## Эксперименты и отказы
Методика (уровень 4), `student-tests/failover_series.py`: closed-loop нагрузка 4 потока через LB (POST сообщения с повтором того же ключа после неопределённого ответа + GET истории), прогрев 5 s; для каждой реплики по очереди `docker stop -t 15` → наблюдение 15 s → `docker start` → ожидание healthy и появления в ответах LB → 3 s паузы. Метрики: успешные RPS до/во время, число ошибок, время от начала остановки до последней ошибки, время, когда остановленная реплика последний раз ответила, время восстановления. В конце — полная история: нет дублей текста и ID, все подтверждённые сообщения на месте.
Rolling update (`scripts/rolling-update.sh`): build → migrate → для каждой старой реплики `up --scale api=N+1 --no-recreate` → ждать healthy → `docker stop` старой (drain) → `rm`. Во время замены 60 s нагрузки `tests/load.py`.
| Воздействие | Что ожидаем | Что наблюдали | Время восстановления / потеря данных |
| --- | --- | --- | --- |
| kill одного процесса API (нативно) | краткие ошибки, затем запись через вторую реплику | 7 ошибок, PASS | первая запись 3.7 s; потерь/дублей нет |
| docker stop реплики 1 под нагрузкой | 0–единицы ошибок благодаря drain | TODO | TODO |
| docker stop реплики 2 под нагрузкой | то же | TODO | TODO |
| rolling update | 0 ошибок | TODO | TODO |
| restart всего стенда | сессия и данные сохранены | TODO | TODO |
| `docker stop` реплики `259a4143c86a` под нагрузкой | 0–единицы ошибок благодаря drain | 347.8 RPS до → 361.9 RPS в окне 15 s, **0 ошибок**; stop занял 3.57 s | ошибок нет; после `docker start` healthy и в LB через 6.25 s; потерь нет |
| `docker stop` реплики `904a0714df9b` | то же | 345.8 → 357.9 RPS, **0 ошибок**; stop 4.12 s | ошибок нет; возврат через 6.81 s; потерь нет |
| Итог серии | нет потерь и дублей | 9 388 подтверждённых записей, 9 389 в истории (+1 — сообщение до серии), дублей 0, потерь 0 | — |
| Rolling update | 0 ошибок | 0 из 33 461 | замена 27 s |
| Restart всего стенда | данные и сессия сохранены | PASS с прежним токеном | ≈12 s до healthy |
| Прогон 1: rolling update | 0 ошибок | **найден баг**: `wait_healthy` перезаписывал `cid` внешнего цикла, удалялась новая реплика; сборка (72 s) не попадала в окно нагрузки | исправлено в 0a37181, проверено прогоном 2 |
## Трек 5.1: цена масштабирования
### Вопрос и гипотезы
Помогает ли добавление API-реплик, где точка насыщения стенда и почему рост реплик перестаёт помогать? Гипотезы записаны **до** измерений в [experiments/track1.json](experiments/track1.json):
Помогает ли добавление API-реплик, где точка насыщения и почему рост реплик перестаёт помогать? Гипотезы A–D записаны **до** измерений в [experiments/track1.json](experiments/track1.json). Серия E и её гипотеза добавлены **после** прогона 1, чтобы проверить, куда смещается насыщение после улучшения.
| Серия | Что меняем | Гипотеза |
| --- | --- | --- |
| A_fixed_total | 1×1.0 / 2×0.5 / 4×0.25 CPU API (сумма 1.0 CPU, 768M) | пиковый RPS не растёт (тот же бюджет), p95 немного хуже из-за накладных расходов процессов и пулов; выигрыш реплик — только отказоустойчивость |
| B_scale_out | 1/2/4/8 реплик по 0.5 CPU, БД 1.0, LB 0.5, Redis 0.5 | рост почти линейный, пока узкое место — CPU API; затем остановка на общей зависимости |
| C_shared_resources | 4×0.5 API; PG 1→2 CPU, LB 0.5→1, Redis 0.5→1 | RPS поднимает только рост ресурса той зависимости, которая насыщена в B |
| D_improvement | 4×0.5 API: baseline vs 3 кандидата | инвалидация кэша через SCAN (наследие lab2) делает O(keyspace/100) запросов к Redis на каждую запись; ключ с версией чата (`CACHE_INVALIDATION=version`, 1 INCR) поднимает RPS. Альтернативы: `DB_POOL_MAX=8`, `LB_BALANCE=leastconn` |
| A_fixed_total | 1×1.0 / 2×0.5 / 4×0.25 CPU API (сумма 1.0 CPU) | RPS не растёт, p95 чуть хуже; реплики дают только отказоустойчивость |
| B_scale_out | 1/2/4 реплики по 0.5 CPU | рост, пока узкое место — CPU API, затем упор в общую зависимость |
| C_shared_resources | 4×0.5 API; PG 1→2, LB 0.5→1, Redis 0.5→1 CPU | RPS поднимает только ресурс насыщенной зависимости |
| D_improvement | 4×0.5 API: baseline и 3 кандидата | SCAN-инвалидация кэша (наследие lab2) — O(keyspace/100) запросов к Redis на запись; `CACHE_INVALIDATION=version` (1 INCR) поднимет RPS |
| E_scale_out_after_fix | 1/2/4 × 0.5 CPU с `version` | после снятия упора в Redis реплики снова помогают до следующей общей зависимости |
### Методика (повторяемая)
### Методика
- Отдельный compose-проект `mtusi2026lab3-bench` (порт 18080, свои volumes) — рабочие данные стенда не трогаются. Конфигурация задаётся только переменными окружения compose (`API_REPLICAS`, `API_CPUS`, `API_MEMORY`, `PG_CPUS`, `LB_CPUS`, `REDIS_CPUS`, `DB_POOL_MAX`, `CACHE_INVALIDATION`, `LB_BALANCE`); образ API один и тот же.
- Нагрузка — [cmd/bench](cmd/bench/main.go) (Go, closed-loop): 50% POST сообщения с уникальным Idempotency-Key, 50% GET истории `limit=50`; 8 чатов × 2 участника; без повторов; таймаут 5 s. Уровни параллелизма 1/4/8/16/32/64, прогрев 5 s, измерение 30 s, 3 повтора (серия D: 16/32/64, 5 повторов). Поддерживается и open-loop (`-rate`) с отсчётом задержки от запланированного момента (поправка на coordinated omission).
- Фоновый keyspace Redis — 10 000 синтетических ключей `pad:*` (≈ активные сессии и прочие данные). Это параметр профиля: от него зависит цена SCAN.
- Во время каждого прогона ~1 раз в секунду: `docker stats` всех контейнеров (CPU нормируется на лимит роли) и `pg_stat_activity` (активные соединения); до/после — счётчики пула pgx каждой реплики (внутренний порт 9090, не публикуется и не проксируется LB, читается через `docker exec`).
- Правила анализа фиксированы в [scripts/track1_report.py](scripts/track1_report.py): медиана по повторам; насыщение — первый уровень, где RPS вырос < 10%; узкое место — роль с максимальной утилизацией CPU от лимита (≥ 0.85 — насыщена) + доля ожиданий пула; улучшение **подтверждено**, только если на уровнях ≥ точки насыщения min(RPS кандидата) > max(RPS baseline) по всем повторам, p95 не хуже и ошибок не больше.
- Отдельный compose-проект `mtusi2026lab3-bench` (порт 18080). Конфигурация задаётся только переменными окружения (`API_REPLICAS`, `API_CPUS`, `API_MEMORY`, `PG_CPUS`, `LB_CPUS`, `REDIS_CPUS`, `DB_POOL_MAX`, `CACHE_INVALIDATION`, `LB_BALANCE`), образ один.
- База: PostgreSQL 1.0 CPU / 512M, `max_connections=200`; Redis 0.5 CPU; LB 0.5 CPU; пул 20 на реплику; `CACHE_INVALIDATION=scan` (поведение lab2); фоновый keyspace Redis — 10 000 ключей `pad:*` (≈ активные сессии).
- Нагрузка [cmd/bench](cmd/bench/main.go): closed-loop, 50% POST сообщения (уникальный Idempotency-Key) / 50% GET истории `limit=50`, 8 чатов × 2 участника, без повторов, таймаут 5 s.
- **Фактический объём** (сокращён из-за времени работы runner): уровни параллелизма 4/16/64 (C: 16/64, D: 32/64), прогрев 3 s, измерение 15 s, **3 повтора** каждой точки — всего 129 прогонов. Полная методика (6 уровней, 30 s, 3–5 повторов) запускается `make track1`.
- Во время прогона раз в 1–2 s снимаются `docker stats` (CPU нормирован на лимит роли) и `pg_stat_activity`; до и после — счётчики пула pgx (внутренний порт 9090, не публикуется).
- Правила анализа в [scripts/track1_report.py](scripts/track1_report.py): медиана повторов; насыщение — первый уровень с ростом RPS < 10%; узкое место — роль с максимальной утилизацией лимита (≥ 0.85 — насыщена); улучшение подтверждено, если min(RPS кандидата) > max(RPS baseline) по всем повторам, p95 не хуже, ошибок не больше. Метрика «CPU хоста» (сумма util × лимит × число контейнеров по ролям) добавлена после прогона 2.
- Сырые данные: [evidence/track1/raw.jsonl](evidence/track1/raw.jsonl) (одна строка — один прогон, без токенов). Сводка: [summary.md](evidence/track1/summary.md), [summary.csv](evidence/track1/summary.csv). Графики RPS и p95 по каждой серии: [report.html](evidence/track1/report.html).
Запуск (Docker-стенд должен работать; основной стенд лучше остановить, чтобы не делить CPU):
Ошибок (`error_ratio`) не было ни в одном из 129 прогонов.
```sh
make track1-quick PYTHON=python # ~15 мин, 1 повтор — проверка, что всё работает
make track1 PYTHON=python # полная методика (~2–3 ч), продолжает после обрыва (--resume)
# Результаты: evidence/track1/raw.jsonl (сырые данные), summary.csv, summary.md, report.html (графики)
python scripts/track1.py --cleanup --series none # удалить bench-проект и его volumes
```
### Результаты (медианы 3 повторов)
Перед прогоном зафиксировать в этом разделе: CPU/RAM хоста и лимиты Docker Desktop (скрипт пишет их в каждую строку raw.jsonl), версии образов.
**A — фиксированный бюджет API 1.0 CPU**
### Проверка инструментов (без Docker)
| config | RPS c=4 / 16 / 64 | p95 c=16, ms | util Redis | util API |
| --- | --- | --- | --- | --- |
| 1×1.00 | 224 / **258** / 247 | 142 | 1.00 | 0.67 |
| 2×0.50 | 198 / 234 / **252** | 166 | 0.99 | 0.79 |
| 4×0.25 | 182 / 215 / **231** | 183 | 0.88 | 0.86 |
Нативно (PostgreSQL 17, fakeredis, 2 процесса API в режимах `scan` и `version`, round-robin прокси) проверено: smoke и конкурентная идемпотентность проходят в обоих режимах кэша; `bin/bench` выдаёт корректную смесь (≈50/50) и распределение по репликам; `/internal/stats` отдаёт счётчики пула; `track1_report.py` строит таблицы, графики и вердикт по синтетическому файлу (не сохранён в evidence — это не результат). **Реальных измерений трека пока нет.**
Гипотеза подтверждена частично: RPS не растёт (258 → 252 → 231), p95 растёт (142 → 166 → 183 ms при c=16). Но причина не в API: Redis упирается в свой лимит уже при одной реплике.
### Результаты
**B — рост числа реплик по 0.5 CPU**
TODO после `make track1`: перенести из evidence/track1/summary.md таблицы по сериям, графики из report.html и выводы:
| Серия | Наблюдение | Узкое место (утилизация) | Вывод |
| config | пик RPS | × к 1 реплике | узкое место на пике |
| --- | --- | --- | --- |
| A_fixed_total | TODO | TODO | TODO |
| B_scale_out | TODO | TODO | TODO: с какого N рост прекращается и почему |
| C_shared_resources | TODO | TODO | TODO: какой ресурс снимает насыщение |
| D_improvement | TODO | TODO | TODO: какое улучшение подтверждено (или ни одно) |
| 1×0.50 | 295 | 1.00 | **API 1.00** |
| 2×0.50 | 372 | 1.26 | **Redis 1.00** (API 0.77) |
| 4×0.50 | 357 | 1.21 | **Redis 0.97** (API 0.43) |
**Saturation point — 2 реплики.** С одной на две реплики RPS растёт на 26% (снимается упор в CPU API), дальше роста нет: Redis (0.5 CPU) загружен на 100% лимита, а CPU API простаивает (0.43). Рост реплик перестаёт помогать, потому что каждая запись делает SCAN по keyspace Redis, и общий Redis насыщается раньше API.
**C — проверка причины (4×0.5 API)**
| config | RPS c=16 / 64 | util Redis | вывод |
| --- | --- | --- | --- |
| базовая | 455 / 494 | 1.00 | — |
| PG 2 CPU | 463 / 501 | 1.00 | +1%, в пределах шума |
| LB 1 CPU | 453 / 486 | 0.99 | 0% |
| **Redis 1 CPU** | **492 / 538** | **0.55** | **+8–9%**, Redis перестаёт быть насыщенным |
RPS поднимает только ресурс Redis — гипотеза C подтверждена. Прирост ограничен (+9%), потому что дальше сказывается CPU хоста (см. E).
**D — подтверждённое улучшение (4×0.5 API)**
| кандидат | RPS c=32 / 64 | p95 c=32, ms | util Redis | подтверждено |
| --- | --- | --- | --- | --- |
| baseline (`scan`) | 214 / 222 | 346 | 1.00 | — |
| **`CACHE_INVALIDATION=version`** | **544 / 549** | **130** | **0.24** | **да: +148% RPS, −57% p95 при c=64; все 3 повтора лучше всех 3 повторов baseline** |
| `DB_POOL_MAX=8` | 208 / 234 | 347 | 1.00 | нет (+5%, внутри разброса) |
| `LB_BALANCE=leastconn` | 232 / 224 | 321 | 0.99 | нет (+1%) |
Изменение кода: ключ кэша истории включает версию чата, запись делает один `INCR` вместо `SCAN`+`DEL` ([message_cache.go](internal/repository/redis/message_cache.go)). Корректность сохранена: к моменту ответа на запись версия уже увеличена, и следующее чтение идёт по новому ключу (smoke и идемпотентность проходят в обоих режимах). Режим `version` — значение по умолчанию в compose.yaml.
**E — рост реплик после улучшения**
| config | пик RPS | p95 c=64, ms | util API / PG / Redis | CPU контейнеров, ядер из 2 |
| --- | --- | --- | --- | --- |
| 1×0.50 | 560 | 176 | **1.00** / 0.40 / 0.23 | 1.09 |
| 2×0.50 | **618** | 207 | 0.78 / 0.55 / 0.24 | 1.55 |
| 4×0.50 | 599 | 244 | 0.42 / 0.51 / 0.27 | 1.56 |
После улучшения одна реплика даёт почти вдвое больше, чем в B (на другом процессоре runner, поэтому сравнение приблизительное). Но вторая реплика добавляет лишь +10%, а четвёртая — ничего: RPS 618 → 599, p95 растёт (207 → 244 ms), активных соединений PostgreSQL в пике больше (29 → 45). Ни один контейнер не упирается в лимит; вместе они занимают ≈1.56 из 2 vCPU runner, остальное делят генератор нагрузки, dockerd и сетевой стек. Интерпретация: **следующий потолок — CPU узла**, и реплики на одном двухъядерном узле не добавляют вычислительной мощности. Это интерпретация, а не прямое измерение: CPU генератора нагрузки не измерялся.
### Выводы трека
1. При фиксированном CPU реплики не увеличивают пропускную способность и ухудшают p95 (A).
2. При росте ресурсов насыщение наступает на 2 репликах из-за общей зависимости — Redis (B); это подтверждено изменением только её ресурса (C).
3. Подтверждённое улучшение — инвалидация кэша по версии вместо SCAN: ×2.5 RPS и −57% p95 на той же конфигурации (D).
4. После улучшения точка насыщения смещается к CPU узла (E): дальше масштабировать нужно узлами, а не репликами на одном узле.
### Ограничения трека
- Один хост: генератор нагрузки, LB, API и БД делят физические ядра; лимиты Docker — это квоты CFS, а не выделенные ядра. Если пик упирается в CPU клиента, это видно по CPU хоста, и вывод о стенде делать нельзя.
- Closed-loop показывает пропускную способность при заданном параллелизме, но не задержку при фиксированной входящей нагрузке; для отдельных точек можно повторить с `-rate`.
- История растёт во время серии; GET читает первые 50 сообщений чата по индексу, поэтому стоимость чтения от объёма почти не зависит, но размер таблиц растёт.
- Утилизация из `docker stats` усредняется с шагом ~1–2 s; короткие всплески не видны.
- Runner 2 vCPU: сумма лимитов в конфигурациях 4×0.5 (3.5–4 CPU) больше, чем у хоста; лимиты Docker — квоты CFS. Поэтому «утилизация лимита < 1» не значит, что CPU свободен.
- Сокращённая методика: 3 уровня параллелизма, 15 s, 3 повтора; точка насыщения определена с шагом ×4 по параллелизму.
- Разные job — разные модели CPU; абсолютные RPS сравнимы только внутри серии (база C даёт 494 RPS против 357 у B 4×0.5 при одинаковой конфигурации — другой процессор).
- Аномалия: в 2 из 3 повторов `A 4×0.25 c=64` сборщик `docker stats` почти не получил замеров (утилизация занижена, RPS нормальный). Медиана утилизации в этой точке недостоверна; вывод по A сделан по c=4/16.
- Только closed-loop; задержки — успешных запросов (ошибок не было).
- История растёт во время серии; GET читает первые 50 сообщений по индексу, поэтому стоимость чтения от объёма почти не зависит.
## Ограничения и следующие шаги
- Выдерживается отказ одной API-реплики (процесс/контейнер). Не выдерживается: отказ LB, PostgreSQL, Redis, хоста — это SPOF (один узел, БД не реплицирована).
- Миграции совместимы с работающей версией только при подходе expand→contract; `0002` только добавляет таблицу, поэтому старые реплики продолжают работать во время rolling update. Деструктивные миграции так применять нельзя.
- Idempotency-ключи хранятся в PostgreSQL рядом с сообщением — атомарность без распределённых транзакций, ценой одной лишней записи на POST.
- Выдерживается отказ одной API-реплики (процесс/контейнер). Не выдерживается отказ LB, PostgreSQL, Redis или хоста — это SPOF (один узел, БД не реплицирована).
- Миграции совместимы с работающей версией только при подходе expand→contract; `0002` только добавляет таблицу. Деструктивные миграции так применять нельзя.
- Ключи идемпотентности хранятся в PostgreSQL рядом с сообщением — атомарность без распределённых транзакций ценой одной лишней записи на POST.
- Ошибки, сгенерированные самим HAProxy (502/503/504), не содержат X-Instance-Id — это допускается контрактом.
- Результаты Docker-стенда (таблицы TODO выше) ещё не получены из-за отсутствия виртуализации на машине разработки; после включения VT-x/WSL2 — запустить `sh scripts/collect-evidence.sh` и заполнить таблицы.
- Docker-стенд на машине разработки не запускается (нет VT-x), доказательства получены на GitHub runner. На любой машине с Docker всё воспроизводится теми же командами.
+8
View File
@@ -0,0 +1,8 @@
2026-10-23T14:49:09Z
Docker Compose version v2.38.2
NAME IMAGE COMMAND SERVICE CREATED STATUS PORTS
mtusi2026lab3-api-1 mtusi2026lab3-api:local "/app/api" api 13 seconds ago Up 6 seconds (healthy) 8080/tcp
mtusi2026lab3-api-2 mtusi2026lab3-api:local "/app/api" api 13 seconds ago Up 6 seconds (healthy) 8080/tcp
mtusi2026lab3-lb-1 haproxy:3.0.5-alpine "docker-entrypoint.s…" lb 13 seconds ago Up Less than a second 127.0.0.1:8080->8080/tcp, 127.0.0.1:8404->8404/tcp
mtusi2026lab3-postgres-1 postgres:16.4-alpine "docker-entrypoint.s…" postgres 13 seconds ago Up 13 seconds (healthy) 5432/tcp
mtusi2026lab3-redis-1 redis:7.4.1-alpine "docker-entrypoint.s…" redis 13 seconds ago Up 13 seconds (healthy) 6379/tcp
+7
View File
@@ -0,0 +1,7 @@
NAME IMAGE COMMAND SERVICE CREATED STATUS PORTS
mtusi2026lab3-api-3 mtusi2026lab3-api:local "/app/api" api About a minute ago Up About a minute (healthy) 8080/tcp
mtusi2026lab3-api-4 mtusi2026lab3-api:local "/app/api" api About a minute ago Up About a minute (healthy) 8080/tcp
mtusi2026lab3-lb-1 haproxy:3.0.5-alpine "docker-entrypoint.s…" lb 5 minutes ago Up 3 minutes 127.0.0.1:8080->8080/tcp, 127.0.0.1:8404->8404/tcp
mtusi2026lab3-migrate-1 migrate/migrate:v4.17.0 "/bin/sh -c 'exec mi…" migrate 5 minutes ago Exited (0) 3 minutes ago
mtusi2026lab3-postgres-1 postgres:16.4-alpine "docker-entrypoint.s…" postgres 5 minutes ago Up 4 minutes (healthy) 5432/tcp
mtusi2026lab3-redis-1 redis:7.4.1-alpine "docker-entrypoint.s…" redis 5 minutes ago Up 4 minutes (healthy) 6379/tcp
+5
View File
@@ -0,0 +1,5 @@
mtusi2026lab3-api-4 0.10% 39.38MiB / 256MiB
mtusi2026lab3-api-3 2.83% 48.86MiB / 256MiB
mtusi2026lab3-lb-1 0.12% 8.852MiB / 128MiB
mtusi2026lab3-postgres-1 0.07% 72.59MiB / 512MiB
mtusi2026lab3-redis-1 0.50% 9.191MiB / 256MiB
+8
View File
@@ -0,0 +1,8 @@
Executing explicit failover hook; hook output suppressed to avoid leaking secrets.
{"observed_instances_before": 2, "successful_writes": 143, "failed_attempts": 0, "first_recovery_seconds": 3.393}
PASS: failover preserved confirmed data and existing session. Hook scope needs operator evidence.
-- контейнеры api после stop-one:
mtusi2026lab3-api-1 259a4143c86a Up 27 seconds (healthy)
mtusi2026lab3-api-2 904a0714df9b Exited (0) 11 seconds ago
mtusi2026lab3-api-1 Up 35 seconds (healthy)
mtusi2026lab3-api-2 Up 6 seconds (healthy)
+8
View File
@@ -0,0 +1,8 @@
Executing explicit failover hook; hook output suppressed to avoid leaking secrets.
{"observed_instances_before": 2, "successful_writes": 144, "failed_attempts": 0, "first_recovery_seconds": 3.361}
PASS: failover preserved confirmed data and existing session. Hook scope needs operator evidence.
-- контейнеры api после stop-one:
mtusi2026lab3-api-1 259a4143c86a Up 50 seconds (healthy)
mtusi2026lab3-api-2 904a0714df9b Exited (0) 12 seconds ago
mtusi2026lab3-api-1 Up 58 seconds (healthy)
mtusi2026lab3-api-2 Up 6 seconds (healthy)
+64
View File
@@ -0,0 +1,64 @@
{
"concurrency": 4,
"replicas": 2,
"total": {
"seconds": 53.99,
"ok": 18773,
"errors": 0,
"ok_rps": 347.7
},
"confirmed_writes": 9388,
"stored_messages": 9389,
"duplicates": 0,
"lost_confirmed": 0,
"per_replica": [
{
"target_instance": "259a4143c86a",
"docker_stop_seconds": 3.57,
"before": {
"seconds": 5.0,
"ok": 1739,
"errors": 0,
"ok_rps": 347.8
},
"during_stop_and_observe": {
"seconds": 15.0,
"ok": 5428,
"errors": 0,
"ok_rps": 361.9
},
"errors_after_stop": 0,
"recovery_seconds": 0.0,
"target_last_served_after_stop_seconds": 0.75,
"other_instances_after": [
"904a0714df9b"
],
"restore_healthy_seconds": 6.24,
"restore_serving_via_lb_seconds": 6.25
},
{
"target_instance": "904a0714df9b",
"docker_stop_seconds": 4.12,
"before": {
"seconds": 5.0,
"ok": 1729,
"errors": 0,
"ok_rps": 345.8
},
"during_stop_and_observe": {
"seconds": 15.0,
"ok": 5370,
"errors": 0,
"ok_rps": 357.9
},
"errors_after_stop": 0,
"recovery_seconds": 0.0,
"target_last_served_after_stop_seconds": 1.46,
"other_instances_after": [
"259a4143c86a"
],
"restore_healthy_seconds": 6.81,
"restore_serving_via_lb_seconds": 6.81
}
]
}
+88
View File
@@ -0,0 +1,88 @@
{
"rounds": 10,
"parallel_per_round": 16,
"distinct_instances_seen": 2,
"duplicates_found": 0,
"per_round": [
{
"round": 0,
"requests": 16,
"status_201": 16,
"distinct_messages": 1,
"stored": 1,
"instances": 2
},
{
"round": 1,
"requests": 16,
"status_201": 16,
"distinct_messages": 1,
"stored": 1,
"instances": 2
},
{
"round": 2,
"requests": 16,
"status_201": 16,
"distinct_messages": 1,
"stored": 1,
"instances": 2
},
{
"round": 3,
"requests": 16,
"status_201": 16,
"distinct_messages": 1,
"stored": 1,
"instances": 2
},
{
"round": 4,
"requests": 16,
"status_201": 16,
"distinct_messages": 1,
"stored": 1,
"instances": 2
},
{
"round": 5,
"requests": 16,
"status_201": 16,
"distinct_messages": 1,
"stored": 1,
"instances": 2
},
{
"round": 6,
"requests": 16,
"status_201": 16,
"distinct_messages": 1,
"stored": 1,
"instances": 2
},
{
"round": 7,
"requests": 16,
"status_201": 16,
"distinct_messages": 1,
"stored": 1,
"instances": 2
},
{
"round": 8,
"requests": 16,
"status_201": 16,
"distinct_messages": 1,
"stored": 1,
"instances": 2
},
{
"round": 9,
"requests": 16,
"status_201": 16,
"distinct_messages": 1,
"stored": 1,
"instances": 2
}
]
}
+2
View File
@@ -0,0 +1,2 @@
259a4143c86a 10
904a0714df9b 10
+17
View File
@@ -0,0 +1,17 @@
{
"lab": 3,
"workload": "closed-loop POST messages; no automatic retries",
"requested_duration_seconds": 30.0,
"elapsed_seconds": 30.076,
"concurrency": 4,
"successful_requests": 11769,
"failed_requests": 0,
"error_ratio": 0.0,
"successful_rps": 391.312,
"successful_latency_ms": {
"p50": 9.744,
"p95": 15.681,
"p99": 22.066
},
"note": "Latency percentiles cover successes only. Timeouts/errors are counted separately; closed-loop has coordinated omission and client overhead."
}
+14
View File
@@ -0,0 +1,14 @@
-- до:
mtusi2026lab3-api-1 Up 58 seconds (healthy)
mtusi2026lab3-api-2 Up 6 seconds (healthy)
mtusi2026lab3-lb-1 Up 52 seconds
mtusi2026lab3-postgres-1 Up About a minute (healthy)
mtusi2026lab3-redis-1 Up About a minute (healthy)
Executing explicit persistence hook; hook output suppressed to avoid leaking secrets.
PASS: persistence preserved confirmed data and existing session. Hook scope needs operator evidence.
-- после:
mtusi2026lab3-api-1 Up 6 seconds (healthy)
mtusi2026lab3-api-2 Up 6 seconds (healthy)
mtusi2026lab3-lb-1 Up Less than a second
mtusi2026lab3-postgres-1 Up 12 seconds (healthy)
mtusi2026lab3-redis-1 Up 12 seconds (healthy)
+89
View File
@@ -0,0 +1,89 @@
-- до:
mtusi2026lab3-api-1 259a4143c86a Up About a minute (healthy)
mtusi2026lab3-api-2 904a0714df9b Up About a minute (healthy)
#1 [internal] load local bake definitions
#1 reading from stdin 380B done
#1 DONE 0.0s
#2 [internal] load build definition from Dockerfile
#2 transferring dockerfile: 2.22kB 0.0s done
#2 DONE 0.0s
#3 [internal] load metadata for docker.io/library/alpine:3.20
#3 ...
#4 [internal] load metadata for docker.io/library/golang:1.26-alpine
#4 DONE 0.2s
#3 [internal] load metadata for docker.io/library/alpine:3.20
#3 DONE 0.2s
#5 [internal] load .dockerignore
#5 transferring context: 212B 0.0s done
#5 DONE 0.0s
#6 [builder 1/6] FROM docker.io/library/golang:1.26-alpine@sha256:27f2d3b83cfc5803c8078f8e730af0f7c431bf067afaec8f60a36fb763187cba
#6 DONE 0.0s
#7 [stage-1 1/5] FROM docker.io/library/alpine:3.20@sha256:d9e853e87e55526f6b2917df91a2115c36dd7c696a35be12163d44e6e2a4b6bc
#7 DONE 0.0s
#8 [internal] load build context
#8 transferring context: 4.90kB 0.0s done
#8 DONE 0.0s
#9 [stage-1 2/5] RUN apk --no-cache add ca-certificates tzdata
#9 CACHED
#10 [builder 3/6] COPY go.mod go.sum ./
#10 CACHED
#11 [builder 6/6] RUN CGO_ENABLED=0 GOOS=linux go build -ldflags="-s -w" -trimpath -o /out/api ./cmd/api
#11 CACHED
#12 [builder 5/6] COPY . .
#12 CACHED
#13 [stage-1 4/5] WORKDIR /app
#13 CACHED
#14 [stage-1 3/5] RUN addgroup -g 1001 -S appgroup && adduser -u 1001 -S appuser -G appgroup
#14 CACHED
#15 [builder 2/6] WORKDIR /src
#15 CACHED
#16 [builder 4/6] RUN go mod download
#16 CACHED
#17 [stage-1 5/5] COPY --from=builder --chown=appuser:appgroup /out/api /app/api
#17 CACHED
#18 exporting to image
#18 exporting layers done
#18 writing image sha256:7963c3b2693515ae76dcf3c09b301780531b7a8fb5b79635f635351694eb6a56 done
#18 naming to docker.io/library/mtusi2026lab3-api:local done
#18 DONE 0.0s
#19 resolving provenance for metadata file
#19 DONE 0.0s
api Built
Container mtusi2026lab3-postgres-1 Running
no change
Container mtusi2026lab3-api-1 Running
Container mtusi2026lab3-api-2 Running
Container mtusi2026lab3-api-3 Creating
Container mtusi2026lab3-api-3 Created
Container mtusi2026lab3-api-3 Starting
Container mtusi2026lab3-api-3 Started
replaced /mtusi2026lab3-api-1
Container mtusi2026lab3-api-2 Running
Container mtusi2026lab3-api-3 Running
Container mtusi2026lab3-api-4 Creating
Container mtusi2026lab3-api-4 Created
Container mtusi2026lab3-api-4 Starting
Container mtusi2026lab3-api-4 Started
replaced /mtusi2026lab3-api-2
mtusi2026lab3-api-3 22525ed8c455 mtusi2026lab3-api:local Up 22 seconds (healthy)
mtusi2026lab3-api-4 c20f2f6e88d4 mtusi2026lab3-api:local Up 10 seconds (healthy)
-- замена заняла 27 s (внутри 90 s нагрузки)
+17
View File
@@ -0,0 +1,17 @@
{
"lab": 3,
"workload": "closed-loop POST messages; no automatic retries",
"requested_duration_seconds": 90.0,
"elapsed_seconds": 90.074,
"concurrency": 4,
"successful_requests": 33461,
"failed_requests": 0,
"error_ratio": 0.0,
"successful_rps": 371.484,
"successful_latency_ms": {
"p50": 9.922,
"p95": 17.746,
"p99": 27.682
},
"note": "Latency percentiles cover successes only. Timeouts/errors are counted separately; closed-loop has coordinated omission and client overhead."
}
+6
View File
@@ -0,0 +1,6 @@
2
total used free shared buff/cache available
Mem: 7938 1223 2825 93 4297 6715
Swap: 3071 0 3071
28.0.4
Docker Compose version v2.38.2
+1
View File
@@ -0,0 +1 @@
PASS: lab3 public API scenario; infrastructure and grading evidence remain separate.
+1
View File
@@ -1 +1,2 @@
run1=https://github.com/CharaWein/2026_lab3/actions/runs/39970452644 commit=fe4b4cf series=A_fixed_total,B_scale_out,D_improvement
run2=https://github.com/CharaWein/2026_lab3/actions/runs/39972671424 commit=0a37181 series=C_shared_resources,E_scale_out_after_fix; levels 3-4 evidence from run2
+51
View File
@@ -76,3 +76,54 @@
{"series": "D_improvement", "config": "leastconn", "concurrency": 64, "repeat": 0, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "4", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "1.00", "LB_CPUS": "0.50", "REDIS_CPUS": "0.50", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "scan", "LB_BALANCE": "leastconn"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8323969024"}, "bench": {"chats": 8, "concurrency": 64, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"6da49288d253": 869, "7ac067adaf65": 824, "d3722c53e810": 826, "ded1e0e9c432": 833}, "label": "D_improvement/leastconn", "latency_ms": {"max": 799.42, "p50": 418.691, "p95": 616.116, "p99": 745.163}, "mode": "closed", "ok": 3352, "ok_read_rps": 108.86666666666666, "ok_rps": 223.46666666666667, "ok_write_rps": 114.6, "rate": 0, "read_ms": {"max": 95.196, "p50": 29.791, "p95": 52.519, "p99": 67.112}, "requests": 3352, "timestamp": "2026-10-23T14:42:44Z", "warmup_s": 3, "write_ms": {"max": 799.42, "p50": 513.092, "p95": 648.06, "p99": 767.753}, "write_ratio": 0.5}, "resources": {"api": {"containers": 4, "cpu_pct_mean_per_container": 19.2, "cpu_pct_max_per_container": 21.0, "cpu_utilization_of_limit": 0.383, "mem_max_mib": 210.0}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 4.4, "cpu_pct_max_per_container": 4.8, "cpu_utilization_of_limit": 0.088, "mem_max_mib": 9.7}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 19.6, "cpu_pct_max_per_container": 23.4, "cpu_utilization_of_limit": 0.196, "mem_max_mib": 222.8}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 49.9, "cpu_pct_max_per_container": 51.0, "cpu_utilization_of_limit": 0.999, "mem_max_mib": 15.2}, "postgres_connections": {"active_max": 0, "active_mean": 0, "total_max": 65}}, "pool": {"acquires": 11718, "empty_acquire_ratio": 0.0027, "avg_acquire_wait_ms": 1.677, "pool_max_conns_total": 80}}
{"series": "D_improvement", "config": "leastconn", "concurrency": 64, "repeat": 1, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "4", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "1.00", "LB_CPUS": "0.50", "REDIS_CPUS": "0.50", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "scan", "LB_BALANCE": "leastconn"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8323969024"}, "bench": {"chats": 8, "concurrency": 64, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"6da49288d253": 815, "7ac067adaf65": 797, "d3722c53e810": 750, "ded1e0e9c432": 815}, "label": "D_improvement/leastconn", "latency_ms": {"max": 953.834, "p50": 428.862, "p95": 671.277, "p99": 863.492}, "mode": "closed", "ok": 3177, "ok_read_rps": 104.33333333333333, "ok_rps": 211.8, "ok_write_rps": 107.46666666666667, "rate": 0, "read_ms": {"max": 101.445, "p50": 32.01, "p95": 60.8, "p99": 82.726}, "requests": 3177, "timestamp": "2026-10-23T14:43:06Z", "warmup_s": 3, "write_ms": {"max": 953.834, "p50": 541.934, "p95": 731.866, "p99": 887.26}, "write_ratio": 0.5}, "resources": {"api": {"containers": 4, "cpu_pct_mean_per_container": 18.8, "cpu_pct_max_per_container": 21.5, "cpu_utilization_of_limit": 0.375, "mem_max_mib": 65.4}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 4.4, "cpu_pct_max_per_container": 4.8, "cpu_utilization_of_limit": 0.089, "mem_max_mib": 9.8}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 19.2, "cpu_pct_max_per_container": 22.2, "cpu_utilization_of_limit": 0.192, "mem_max_mib": 226.8}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 49.7, "cpu_pct_max_per_container": 50.3, "cpu_utilization_of_limit": 0.993, "mem_max_mib": 21.8}, "postgres_connections": {"active_max": 2, "active_mean": 0.4, "total_max": 65}}, "pool": {"acquires": 11171, "empty_acquire_ratio": 0.0, "avg_acquire_wait_ms": 0.002, "pool_max_conns_total": 80}}
{"series": "D_improvement", "config": "leastconn", "concurrency": 64, "repeat": 2, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "4", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "1.00", "LB_CPUS": "0.50", "REDIS_CPUS": "0.50", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "scan", "LB_BALANCE": "leastconn"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8323969024"}, "bench": {"chats": 8, "concurrency": 64, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"6da49288d253": 930, "7ac067adaf65": 942, "d3722c53e810": 939, "ded1e0e9c432": 986}, "label": "D_improvement/leastconn", "latency_ms": {"max": 727.596, "p50": 376.223, "p95": 573.296, "p99": 642.229}, "mode": "closed", "ok": 3797, "ok_read_rps": 125.4, "ok_rps": 253.13333333333333, "ok_write_rps": 127.73333333333333, "rate": 0, "read_ms": {"max": 95.122, "p50": 26.395, "p95": 48.755, "p99": 66.78}, "requests": 3797, "timestamp": "2026-10-23T14:43:27Z", "warmup_s": 3, "write_ms": {"max": 727.596, "p50": 454.803, "p95": 604.676, "p99": 665.068}, "write_ratio": 0.5}, "resources": {"api": {"containers": 4, "cpu_pct_mean_per_container": 20.7, "cpu_pct_max_per_container": 22.9, "cpu_utilization_of_limit": 0.415, "mem_max_mib": 59.8}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 4.7, "cpu_pct_max_per_container": 5.6, "cpu_utilization_of_limit": 0.095, "mem_max_mib": 9.8}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 21.1, "cpu_pct_max_per_container": 24.6, "cpu_utilization_of_limit": 0.211, "mem_max_mib": 231.9}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 49.7, "cpu_pct_max_per_container": 51.0, "cpu_utilization_of_limit": 0.995, "mem_max_mib": 21.2}, "postgres_connections": {"active_max": 2, "active_mean": 0.8, "total_max": 66}}, "pool": {"acquires": 13027, "empty_acquire_ratio": 0.0001, "avg_acquire_wait_ms": 0.022, "pool_max_conns_total": 80}}
{"series": "C_shared_resources", "config": "pg1_lb0.5_redis0.5", "concurrency": 16, "repeat": 0, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "4", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "1.00", "LB_CPUS": "0.50", "REDIS_CPUS": "0.50", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "scan", "LB_BALANCE": "roundrobin"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8322932736"}, "bench": {"chats": 8, "concurrency": 16, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"1502dda7098d": 1764, "592d00ce1975": 1763, "87fdaa0d39ef": 1765, "aaa2f5ed6e90": 1766}, "label": "C_shared_resources/pg1_lb0.5_redis0.5", "latency_ms": {"max": 160.335, "p50": 32.167, "p95": 80.126, "p99": 98.803}, "mode": "closed", "ok": 7058, "ok_read_rps": 232.46666666666667, "ok_rps": 470.53333333333336, "ok_write_rps": 238.06666666666666, "rate": 0, "read_ms": {"max": 80.302, "p50": 5.201, "p95": 16.317, "p99": 24.032}, "requests": 7058, "timestamp": "2026-10-23T14:49:36Z", "warmup_s": 3, "write_ms": {"max": 160.335, "p50": 58.789, "p95": 87.146, "p99": 110.176}, "write_ratio": 0.5}, "resources": {"api": {"containers": 4, "cpu_pct_mean_per_container": 18.1, "cpu_pct_max_per_container": 21.2, "cpu_utilization_of_limit": 0.361, "mem_max_mib": 144.7}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 5.6, "cpu_pct_max_per_container": 5.7, "cpu_utilization_of_limit": 0.111, "mem_max_mib": 10.8}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 23.3, "cpu_pct_max_per_container": 25.8, "cpu_utilization_of_limit": 0.233, "mem_max_mib": 88.9}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 50.1, "cpu_pct_max_per_container": 50.7, "cpu_utilization_of_limit": 1.001, "mem_max_mib": 11.9}, "postgres_connections": {"active_max": 1, "active_mean": 0.1, "total_max": 25}}, "pool": {"acquires": 24138, "empty_acquire_ratio": 0.0006, "avg_acquire_wait_ms": 0.035, "pool_max_conns_total": 80}}
{"series": "C_shared_resources", "config": "pg1_lb0.5_redis0.5", "concurrency": 16, "repeat": 1, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "4", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "1.00", "LB_CPUS": "0.50", "REDIS_CPUS": "0.50", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "scan", "LB_BALANCE": "roundrobin"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8322932736"}, "bench": {"chats": 8, "concurrency": 16, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"1502dda7098d": 1707, "592d00ce1975": 1705, "87fdaa0d39ef": 1709, "aaa2f5ed6e90": 1706}, "label": "C_shared_resources/pg1_lb0.5_redis0.5", "latency_ms": {"max": 230.273, "p50": 28.196, "p95": 80.561, "p99": 116.881}, "mode": "closed", "ok": 6827, "ok_read_rps": 226.6, "ok_rps": 455.1333333333333, "ok_write_rps": 228.53333333333333, "rate": 0, "read_ms": {"max": 52.366, "p50": 5.524, "p95": 16.366, "p99": 24.989}, "requests": 6827, "timestamp": "2026-10-23T14:49:57Z", "warmup_s": 3, "write_ms": {"max": 230.273, "p50": 60.174, "p95": 95.486, "p99": 142.96}, "write_ratio": 0.5}, "resources": {"api": {"containers": 4, "cpu_pct_mean_per_container": 18.0, "cpu_pct_max_per_container": 21.4, "cpu_utilization_of_limit": 0.36, "mem_max_mib": 254.8}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 5.4, "cpu_pct_max_per_container": 5.7, "cpu_utilization_of_limit": 0.108, "mem_max_mib": 10.7}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 23.9, "cpu_pct_max_per_container": 28.5, "cpu_utilization_of_limit": 0.239, "mem_max_mib": 92.4}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 49.3, "cpu_pct_max_per_container": 51.0, "cpu_utilization_of_limit": 0.987, "mem_max_mib": 11.1}, "postgres_connections": {"active_max": 16, "active_mean": 2.7, "total_max": 25}}, "pool": {"acquires": 23618, "empty_acquire_ratio": 0.0, "avg_acquire_wait_ms": 0.0, "pool_max_conns_total": 80}}
{"series": "C_shared_resources", "config": "pg1_lb0.5_redis0.5", "concurrency": 16, "repeat": 2, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "4", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "1.00", "LB_CPUS": "0.50", "REDIS_CPUS": "0.50", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "scan", "LB_BALANCE": "roundrobin"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8322932736"}, "bench": {"chats": 8, "concurrency": 16, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"1502dda7098d": 1673, "592d00ce1975": 1673, "87fdaa0d39ef": 1677, "aaa2f5ed6e90": 1679}, "label": "C_shared_resources/pg1_lb0.5_redis0.5", "latency_ms": {"max": 190.625, "p50": 35.192, "p95": 84.017, "p99": 106.295}, "mode": "closed", "ok": 6702, "ok_read_rps": 219.73333333333332, "ok_rps": 446.8, "ok_write_rps": 227.06666666666666, "rate": 0, "read_ms": {"max": 90.053, "p50": 5.546, "p95": 17.437, "p99": 26.036}, "requests": 6702, "timestamp": "2026-10-23T14:50:18Z", "warmup_s": 3, "write_ms": {"max": 190.625, "p50": 61.373, "p95": 93.086, "p99": 119.239}, "write_ratio": 0.5}, "resources": {"api": {"containers": 4, "cpu_pct_mean_per_container": 17.9, "cpu_pct_max_per_container": 21.0, "cpu_utilization_of_limit": 0.357, "mem_max_mib": 256.0}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 5.3, "cpu_pct_max_per_container": 5.5, "cpu_utilization_of_limit": 0.106, "mem_max_mib": 10.9}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 23.0, "cpu_pct_max_per_container": 24.5, "cpu_utilization_of_limit": 0.23, "mem_max_mib": 100.6}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 49.6, "cpu_pct_max_per_container": 50.7, "cpu_utilization_of_limit": 0.991, "mem_max_mib": 11.5}, "postgres_connections": {"active_max": 1, "active_mean": 0.4, "total_max": 27}}, "pool": {"acquires": 23187, "empty_acquire_ratio": 0.0001, "avg_acquire_wait_ms": 0.003, "pool_max_conns_total": 80}}
{"series": "C_shared_resources", "config": "pg1_lb0.5_redis0.5", "concurrency": 64, "repeat": 0, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "4", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "1.00", "LB_CPUS": "0.50", "REDIS_CPUS": "0.50", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "scan", "LB_BALANCE": "roundrobin"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8322932736"}, "bench": {"chats": 8, "concurrency": 64, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"1502dda7098d": 1850, "592d00ce1975": 1852, "87fdaa0d39ef": 1846, "aaa2f5ed6e90": 1854}, "label": "C_shared_resources/pg1_lb0.5_redis0.5", "latency_ms": {"max": 478.86, "p50": 61.639, "p95": 290.529, "p99": 357.652}, "mode": "closed", "ok": 7402, "ok_read_rps": 249.33333333333334, "ok_rps": 493.46666666666664, "ok_write_rps": 244.13333333333333, "rate": 0, "read_ms": {"max": 239.502, "p50": 14.858, "p95": 36.717, "p99": 62.556}, "requests": 7402, "timestamp": "2026-10-23T14:50:38Z", "warmup_s": 3, "write_ms": {"max": 478.86, "p50": 236.886, "p95": 330.947, "p99": 368.836}, "write_ratio": 0.5}, "resources": {"api": {"containers": 4, "cpu_pct_mean_per_container": 17.4, "cpu_pct_max_per_container": 19.5, "cpu_utilization_of_limit": 0.348, "mem_max_mib": 248.8}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 5.7, "cpu_pct_max_per_container": 6.1, "cpu_utilization_of_limit": 0.115, "mem_max_mib": 12.1}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 28.9, "cpu_pct_max_per_container": 38.1, "cpu_utilization_of_limit": 0.289, "mem_max_mib": 201.0}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 49.4, "cpu_pct_max_per_container": 50.2, "cpu_utilization_of_limit": 0.988, "mem_max_mib": 13.3}, "postgres_connections": {"active_max": 1, "active_mean": 0.1, "total_max": 71}}, "pool": {"acquires": 25090, "empty_acquire_ratio": 0.0018, "avg_acquire_wait_ms": 0.95, "pool_max_conns_total": 80}}
{"series": "C_shared_resources", "config": "pg1_lb0.5_redis0.5", "concurrency": 64, "repeat": 1, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "4", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "1.00", "LB_CPUS": "0.50", "REDIS_CPUS": "0.50", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "scan", "LB_BALANCE": "roundrobin"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8322932736"}, "bench": {"chats": 8, "concurrency": 64, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"1502dda7098d": 1843, "592d00ce1975": 1841, "87fdaa0d39ef": 1835, "aaa2f5ed6e90": 1831}, "label": "C_shared_resources/pg1_lb0.5_redis0.5", "latency_ms": {"max": 467.476, "p50": 173.538, "p95": 286.882, "p99": 318.978}, "mode": "closed", "ok": 7350, "ok_read_rps": 242.93333333333334, "ok_rps": 490, "ok_write_rps": 247.06666666666666, "rate": 0, "read_ms": {"max": 66.851, "p50": 14.844, "p95": 31.552, "p99": 43.658}, "requests": 7350, "timestamp": "2026-10-23T14:51:02Z", "warmup_s": 3, "write_ms": {"max": 467.476, "p50": 238.017, "p95": 300.506, "p99": 336.39}, "write_ratio": 0.5}, "resources": {"api": {"containers": 4, "cpu_pct_mean_per_container": 17.9, "cpu_pct_max_per_container": 20.7, "cpu_utilization_of_limit": 0.357, "mem_max_mib": 66.9}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 5.9, "cpu_pct_max_per_container": 6.1, "cpu_utilization_of_limit": 0.118, "mem_max_mib": 12.2}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 23.3, "cpu_pct_max_per_container": 26.1, "cpu_utilization_of_limit": 0.233, "mem_max_mib": 216.5}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 49.8, "cpu_pct_max_per_container": 51.2, "cpu_utilization_of_limit": 0.996, "mem_max_mib": 13.4}, "postgres_connections": {"active_max": 1, "active_mean": 0.1, "total_max": 76}}, "pool": {"acquires": 25452, "empty_acquire_ratio": 0.0004, "avg_acquire_wait_ms": 0.07, "pool_max_conns_total": 80}}
{"series": "C_shared_resources", "config": "pg1_lb0.5_redis0.5", "concurrency": 64, "repeat": 2, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "4", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "1.00", "LB_CPUS": "0.50", "REDIS_CPUS": "0.50", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "scan", "LB_BALANCE": "roundrobin"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8322932736"}, "bench": {"chats": 8, "concurrency": 64, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"1502dda7098d": 1885, "592d00ce1975": 1892, "87fdaa0d39ef": 1887, "aaa2f5ed6e90": 1893}, "label": "C_shared_resources/pg1_lb0.5_redis0.5", "latency_ms": {"max": 363.423, "p50": 43.192, "p95": 282.669, "p99": 315.756}, "mode": "closed", "ok": 7557, "ok_read_rps": 254.26666666666668, "ok_rps": 503.8, "ok_write_rps": 249.53333333333333, "rate": 0, "read_ms": {"max": 67.27, "p50": 14.611, "p95": 31.85, "p99": 42.69}, "requests": 7557, "timestamp": "2026-10-23T14:51:23Z", "warmup_s": 3, "write_ms": {"max": 363.423, "p50": 233.457, "p95": 297.186, "p99": 326.57}, "write_ratio": 0.5}, "resources": {"api": {"containers": 4, "cpu_pct_mean_per_container": 17.7, "cpu_pct_max_per_container": 20.1, "cpu_utilization_of_limit": 0.354, "mem_max_mib": 66.5}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 5.9, "cpu_pct_max_per_container": 6.4, "cpu_utilization_of_limit": 0.118, "mem_max_mib": 12.2}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 24.2, "cpu_pct_max_per_container": 26.7, "cpu_utilization_of_limit": 0.242, "mem_max_mib": 222.4}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 50.5, "cpu_pct_max_per_container": 51.0, "cpu_utilization_of_limit": 1.009, "mem_max_mib": 19.9}, "postgres_connections": {"active_max": 3, "active_mean": 1, "total_max": 76}}, "pool": {"acquires": 26279, "empty_acquire_ratio": 0.0, "avg_acquire_wait_ms": 0.001, "pool_max_conns_total": 80}}
{"series": "C_shared_resources", "config": "pg2", "concurrency": 16, "repeat": 0, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "4", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "2.00", "LB_CPUS": "0.50", "REDIS_CPUS": "0.50", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "scan", "LB_BALANCE": "roundrobin"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8322932736"}, "bench": {"chats": 8, "concurrency": 16, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"4a204741c04b": 1735, "556742a4f088": 1734, "ef72a9be18da": 1736, "fc5aa456cbb9": 1735}, "label": "C_shared_resources/pg2", "latency_ms": {"max": 160.112, "p50": 35.652, "p95": 77.879, "p99": 97.226}, "mode": "closed", "ok": 6940, "ok_read_rps": 225.6, "ok_rps": 462.6666666666667, "ok_write_rps": 237.06666666666666, "rate": 0, "read_ms": {"max": 65.784, "p50": 5.109, "p95": 16.762, "p99": 23.418}, "requests": 6940, "timestamp": "2026-10-23T14:52:02Z", "warmup_s": 3, "write_ms": {"max": 160.112, "p50": 60.291, "p95": 84.988, "p99": 105.268}, "write_ratio": 0.5}, "resources": {"api": {"containers": 4, "cpu_pct_mean_per_container": 17.3, "cpu_pct_max_per_container": 19.3, "cpu_utilization_of_limit": 0.345, "mem_max_mib": 138.3}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 5.2, "cpu_pct_max_per_container": 5.5, "cpu_utilization_of_limit": 0.104, "mem_max_mib": 12.4}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 22.0, "cpu_pct_max_per_container": 25.2, "cpu_utilization_of_limit": 0.11, "mem_max_mib": 78.2}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 50.0, "cpu_pct_max_per_container": 50.6, "cpu_utilization_of_limit": 1.0, "mem_max_mib": 12.6}, "postgres_connections": {"active_max": 0, "active_mean": 0, "total_max": 22}}, "pool": {"acquires": 23791, "empty_acquire_ratio": 0.0006, "avg_acquire_wait_ms": 0.026, "pool_max_conns_total": 80}}
{"series": "C_shared_resources", "config": "pg2", "concurrency": 16, "repeat": 1, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "4", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "2.00", "LB_CPUS": "0.50", "REDIS_CPUS": "0.50", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "scan", "LB_BALANCE": "roundrobin"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8322932736"}, "bench": {"chats": 8, "concurrency": 16, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"4a204741c04b": 1767, "556742a4f088": 1769, "ef72a9be18da": 1770, "fc5aa456cbb9": 1770}, "label": "C_shared_resources/pg2", "latency_ms": {"max": 142.767, "p50": 27.646, "p95": 78.701, "p99": 97.969}, "mode": "closed", "ok": 7076, "ok_read_rps": 235.33333333333334, "ok_rps": 471.73333333333335, "ok_write_rps": 236.4, "rate": 0, "read_ms": {"max": 78.659, "p50": 5.293, "p95": 16.645, "p99": 25.537}, "requests": 7076, "timestamp": "2026-10-23T14:52:23Z", "warmup_s": 3, "write_ms": {"max": 142.767, "p50": 59.866, "p95": 86.675, "p99": 104.769}, "write_ratio": 0.5}, "resources": {"api": {"containers": 4, "cpu_pct_mean_per_container": 17.6, "cpu_pct_max_per_container": 18.7, "cpu_utilization_of_limit": 0.353, "mem_max_mib": 253.7}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 5.4, "cpu_pct_max_per_container": 5.5, "cpu_utilization_of_limit": 0.107, "mem_max_mib": 12.6}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 25.9, "cpu_pct_max_per_container": 48.9, "cpu_utilization_of_limit": 0.129, "mem_max_mib": 87.4}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 49.9, "cpu_pct_max_per_container": 50.9, "cpu_utilization_of_limit": 0.999, "mem_max_mib": 12.6}, "postgres_connections": {"active_max": 3, "active_mean": 0.6, "total_max": 24}}, "pool": {"acquires": 24139, "empty_acquire_ratio": 0.0001, "avg_acquire_wait_ms": 0.002, "pool_max_conns_total": 80}}
{"series": "C_shared_resources", "config": "pg2", "concurrency": 16, "repeat": 2, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "4", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "2.00", "LB_CPUS": "0.50", "REDIS_CPUS": "0.50", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "scan", "LB_BALANCE": "roundrobin"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8322932736"}, "bench": {"chats": 8, "concurrency": 16, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"4a204741c04b": 1697, "556742a4f088": 1702, "ef72a9be18da": 1699, "fc5aa456cbb9": 1701}, "label": "C_shared_resources/pg2", "latency_ms": {"max": 523.409, "p50": 29.69, "p95": 80.507, "p99": 106.675}, "mode": "closed", "ok": 6799, "ok_read_rps": 225.8, "ok_rps": 453.26666666666665, "ok_write_rps": 227.46666666666667, "rate": 0, "read_ms": {"max": 488.253, "p50": 5.23, "p95": 17.048, "p99": 27.697}, "requests": 6799, "timestamp": "2026-10-23T14:52:43Z", "warmup_s": 3, "write_ms": {"max": 523.409, "p50": 60.172, "p95": 90.321, "p99": 123.025}, "write_ratio": 0.5}, "resources": {"api": {"containers": 4, "cpu_pct_mean_per_container": 17.6, "cpu_pct_max_per_container": 20.1, "cpu_utilization_of_limit": 0.351, "mem_max_mib": 255.9}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 5.3, "cpu_pct_max_per_container": 5.5, "cpu_utilization_of_limit": 0.105, "mem_max_mib": 12.6}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 21.0, "cpu_pct_max_per_container": 23.7, "cpu_utilization_of_limit": 0.105, "mem_max_mib": 90.8}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 49.1, "cpu_pct_max_per_container": 50.5, "cpu_utilization_of_limit": 0.981, "mem_max_mib": 12.4}, "postgres_connections": {"active_max": 2, "active_mean": 0.3, "total_max": 24}}, "pool": {"acquires": 23342, "empty_acquire_ratio": 0.0, "avg_acquire_wait_ms": 0.0, "pool_max_conns_total": 80}}
{"series": "C_shared_resources", "config": "pg2", "concurrency": 64, "repeat": 0, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "4", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "2.00", "LB_CPUS": "0.50", "REDIS_CPUS": "0.50", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "scan", "LB_BALANCE": "roundrobin"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8322932736"}, "bench": {"chats": 8, "concurrency": 64, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"4a204741c04b": 1928, "556742a4f088": 1931, "ef72a9be18da": 1935, "fc5aa456cbb9": 1931}, "label": "C_shared_resources/pg2", "latency_ms": {"max": 381.264, "p50": 41.328, "p95": 274.17, "p99": 303.446}, "mode": "closed", "ok": 7725, "ok_read_rps": 260, "ok_rps": 515, "ok_write_rps": 255, "rate": 0, "read_ms": {"max": 85.668, "p50": 13.89, "p95": 30.587, "p99": 40.858}, "requests": 7725, "timestamp": "2026-10-23T14:53:04Z", "warmup_s": 3, "write_ms": {"max": 381.264, "p50": 231.108, "p95": 287.286, "p99": 317.716}, "write_ratio": 0.5}, "resources": {"api": {"containers": 4, "cpu_pct_mean_per_container": 17.5, "cpu_pct_max_per_container": 19.6, "cpu_utilization_of_limit": 0.351, "mem_max_mib": 253.6}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 5.8, "cpu_pct_max_per_container": 6.1, "cpu_utilization_of_limit": 0.116, "mem_max_mib": 13.1}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 23.0, "cpu_pct_max_per_container": 25.7, "cpu_utilization_of_limit": 0.115, "mem_max_mib": 126.0}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 50.1, "cpu_pct_max_per_container": 51.1, "cpu_utilization_of_limit": 1.002, "mem_max_mib": 14.1}, "postgres_connections": {"active_max": 2, "active_mean": 0.3, "total_max": 38}}, "pool": {"acquires": 26579, "empty_acquire_ratio": 0.0005, "avg_acquire_wait_ms": 0.039, "pool_max_conns_total": 80}}
{"series": "C_shared_resources", "config": "pg2", "concurrency": 64, "repeat": 1, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "4", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "2.00", "LB_CPUS": "0.50", "REDIS_CPUS": "0.50", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "scan", "LB_BALANCE": "roundrobin"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8322932736"}, "bench": {"chats": 8, "concurrency": 64, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"4a204741c04b": 1877, "556742a4f088": 1878, "ef72a9be18da": 1876, "fc5aa456cbb9": 1876}, "label": "C_shared_resources/pg2", "latency_ms": {"max": 357.749, "p50": 170.525, "p95": 276.212, "p99": 306.586}, "mode": "closed", "ok": 7507, "ok_read_rps": 249.46666666666667, "ok_rps": 500.46666666666664, "ok_write_rps": 251, "rate": 0, "read_ms": {"max": 68.919, "p50": 14.375, "p95": 32.948, "p99": 46.39}, "requests": 7507, "timestamp": "2026-10-23T14:53:26Z", "warmup_s": 3, "write_ms": {"max": 357.749, "p50": 234.683, "p95": 291.6, "p99": 312.457}, "write_ratio": 0.5}, "resources": {"api": {"containers": 4, "cpu_pct_mean_per_container": 17.3, "cpu_pct_max_per_container": 19.3, "cpu_utilization_of_limit": 0.345, "mem_max_mib": 254.7}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 5.5, "cpu_pct_max_per_container": 5.9, "cpu_utilization_of_limit": 0.11, "mem_max_mib": 12.8}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 27.5, "cpu_pct_max_per_container": 50.1, "cpu_utilization_of_limit": 0.137, "mem_max_mib": 201.3}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 49.2, "cpu_pct_max_per_container": 50.3, "cpu_utilization_of_limit": 0.985, "mem_max_mib": 13.8}, "postgres_connections": {"active_max": 1, "active_mean": 0.3, "total_max": 71}}, "pool": {"acquires": 25842, "empty_acquire_ratio": 0.0023, "avg_acquire_wait_ms": 0.293, "pool_max_conns_total": 80}}
{"series": "C_shared_resources", "config": "pg2", "concurrency": 64, "repeat": 2, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "4", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "2.00", "LB_CPUS": "0.50", "REDIS_CPUS": "0.50", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "scan", "LB_BALANCE": "roundrobin"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8322932736"}, "bench": {"chats": 8, "concurrency": 64, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"4a204741c04b": 1832, "556742a4f088": 1835, "ef72a9be18da": 1836, "fc5aa456cbb9": 1834}, "label": "C_shared_resources/pg2", "latency_ms": {"max": 347.404, "p50": 181.951, "p95": 285.071, "p99": 313.469}, "mode": "closed", "ok": 7337, "ok_read_rps": 241.33333333333334, "ok_rps": 489.1333333333333, "ok_write_rps": 247.8, "rate": 0, "read_ms": {"max": 77.213, "p50": 14.228, "p95": 30.046, "p99": 44.373}, "requests": 7337, "timestamp": "2026-10-23T14:53:48Z", "warmup_s": 3, "write_ms": {"max": 347.404, "p50": 239.436, "p95": 299.849, "p99": 325.239}, "write_ratio": 0.5}, "resources": {"api": {"containers": 4, "cpu_pct_mean_per_container": 17.5, "cpu_pct_max_per_container": 19.6, "cpu_utilization_of_limit": 0.35, "mem_max_mib": 70.0}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 5.5, "cpu_pct_max_per_container": 6.0, "cpu_utilization_of_limit": 0.111, "mem_max_mib": 13.1}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 23.7, "cpu_pct_max_per_container": 28.0, "cpu_utilization_of_limit": 0.118, "mem_max_mib": 216.8}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 49.4, "cpu_pct_max_per_container": 50.8, "cpu_utilization_of_limit": 0.988, "mem_max_mib": 13.8}, "postgres_connections": {"active_max": 1, "active_mean": 0.1, "total_max": 74}}, "pool": {"acquires": 25356, "empty_acquire_ratio": 0.0001, "avg_acquire_wait_ms": 0.025, "pool_max_conns_total": 80}}
{"series": "C_shared_resources", "config": "lb1", "concurrency": 16, "repeat": 0, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "4", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "1.00", "LB_CPUS": "1.00", "REDIS_CPUS": "0.50", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "scan", "LB_BALANCE": "roundrobin"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8322932736"}, "bench": {"chats": 8, "concurrency": 16, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"4a204741c04b": 1754, "556742a4f088": 1755, "ef72a9be18da": 1751, "fc5aa456cbb9": 1751}, "label": "C_shared_resources/lb1", "latency_ms": {"max": 137.218, "p50": 21.89, "p95": 82.014, "p99": 98.872}, "mode": "closed", "ok": 7011, "ok_read_rps": 238.6, "ok_rps": 467.4, "ok_write_rps": 228.8, "rate": 0, "read_ms": {"max": 50.918, "p50": 5.503, "p95": 16.543, "p99": 25.7}, "requests": 7011, "timestamp": "2026-10-23T14:54:18Z", "warmup_s": 3, "write_ms": {"max": 137.218, "p50": 61.045, "p95": 90.519, "p99": 106.075}, "write_ratio": 0.5}, "resources": {"api": {"containers": 4, "cpu_pct_mean_per_container": 18.2, "cpu_pct_max_per_container": 20.1, "cpu_utilization_of_limit": 0.365, "mem_max_mib": 248.0}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 5.5, "cpu_pct_max_per_container": 5.8, "cpu_utilization_of_limit": 0.055, "mem_max_mib": 9.0}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 23.4, "cpu_pct_max_per_container": 27.9, "cpu_utilization_of_limit": 0.234, "mem_max_mib": 82.5}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 50.0, "cpu_pct_max_per_container": 51.4, "cpu_utilization_of_limit": 1.001, "mem_max_mib": 14.1}, "postgres_connections": {"active_max": 2, "active_mean": 0.6, "total_max": 23}}, "pool": {"acquires": 23652, "empty_acquire_ratio": 0.0008, "avg_acquire_wait_ms": 0.03, "pool_max_conns_total": 80}}
{"series": "C_shared_resources", "config": "lb1", "concurrency": 16, "repeat": 1, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "4", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "1.00", "LB_CPUS": "1.00", "REDIS_CPUS": "0.50", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "scan", "LB_BALANCE": "roundrobin"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8322932736"}, "bench": {"chats": 8, "concurrency": 16, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"4a204741c04b": 1693, "556742a4f088": 1692, "ef72a9be18da": 1690, "fc5aa456cbb9": 1689}, "label": "C_shared_resources/lb1", "latency_ms": {"max": 210.125, "p50": 29.763, "p95": 84.306, "p99": 105.96}, "mode": "closed", "ok": 6764, "ok_read_rps": 225.06666666666666, "ok_rps": 450.93333333333334, "ok_write_rps": 225.86666666666667, "rate": 0, "read_ms": {"max": 91.522, "p50": 5.381, "p95": 15.445, "p99": 26.942}, "requests": 6764, "timestamp": "2026-10-23T14:54:39Z", "warmup_s": 3, "write_ms": {"max": 210.125, "p50": 61.551, "p95": 92.639, "p99": 113.351}, "write_ratio": 0.5}, "resources": {"api": {"containers": 4, "cpu_pct_mean_per_container": 18.2, "cpu_pct_max_per_container": 19.8, "cpu_utilization_of_limit": 0.364, "mem_max_mib": 241.9}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 5.4, "cpu_pct_max_per_container": 5.8, "cpu_utilization_of_limit": 0.054, "mem_max_mib": 9.0}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 23.6, "cpu_pct_max_per_container": 26.0, "cpu_utilization_of_limit": 0.236, "mem_max_mib": 90.6}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 50.2, "cpu_pct_max_per_container": 50.5, "cpu_utilization_of_limit": 1.003, "mem_max_mib": 13.3}, "postgres_connections": {"active_max": 4, "active_mean": 1.1, "total_max": 26}}, "pool": {"acquires": 23075, "empty_acquire_ratio": 0.0001, "avg_acquire_wait_ms": 0.006, "pool_max_conns_total": 80}}
{"series": "C_shared_resources", "config": "lb1", "concurrency": 16, "repeat": 2, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "4", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "1.00", "LB_CPUS": "1.00", "REDIS_CPUS": "0.50", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "scan", "LB_BALANCE": "roundrobin"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8322932736"}, "bench": {"chats": 8, "concurrency": 16, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"4a204741c04b": 1698, "556742a4f088": 1697, "ef72a9be18da": 1699, "fc5aa456cbb9": 1700}, "label": "C_shared_resources/lb1", "latency_ms": {"max": 152.795, "p50": 22.14, "p95": 83.952, "p99": 103.892}, "mode": "closed", "ok": 6794, "ok_read_rps": 228.26666666666668, "ok_rps": 452.93333333333334, "ok_write_rps": 224.66666666666666, "rate": 0, "read_ms": {"max": 47.918, "p50": 5.328, "p95": 13.257, "p99": 21.843}, "requests": 6794, "timestamp": "2026-10-23T14:54:59Z", "warmup_s": 3, "write_ms": {"max": 152.795, "p50": 62.273, "p95": 92.382, "p99": 113.289}, "write_ratio": 0.5}, "resources": {"api": {"containers": 4, "cpu_pct_mean_per_container": 18.8, "cpu_pct_max_per_container": 22.7, "cpu_utilization_of_limit": 0.375, "mem_max_mib": 244.4}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 5.7, "cpu_pct_max_per_container": 5.9, "cpu_utilization_of_limit": 0.057, "mem_max_mib": 8.8}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 22.6, "cpu_pct_max_per_container": 25.0, "cpu_utilization_of_limit": 0.226, "mem_max_mib": 96.4}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 49.7, "cpu_pct_max_per_container": 50.7, "cpu_utilization_of_limit": 0.993, "mem_max_mib": 13.0}, "postgres_connections": {"active_max": 1, "active_mean": 0.1, "total_max": 26}}, "pool": {"acquires": 22930, "empty_acquire_ratio": 0.0, "avg_acquire_wait_ms": 0.0, "pool_max_conns_total": 80}}
{"series": "C_shared_resources", "config": "lb1", "concurrency": 64, "repeat": 0, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "4", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "1.00", "LB_CPUS": "1.00", "REDIS_CPUS": "0.50", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "scan", "LB_BALANCE": "roundrobin"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8322932736"}, "bench": {"chats": 8, "concurrency": 64, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"4a204741c04b": 1821, "556742a4f088": 1822, "ef72a9be18da": 1826, "fc5aa456cbb9": 1827}, "label": "C_shared_resources/lb1", "latency_ms": {"max": 434.54, "p50": 47.631, "p95": 299.221, "p99": 343.583}, "mode": "closed", "ok": 7296, "ok_read_rps": 244.8, "ok_rps": 486.4, "ok_write_rps": 241.6, "rate": 0, "read_ms": {"max": 68.739, "p50": 14.803, "p95": 30.454, "p99": 44.397}, "requests": 7296, "timestamp": "2026-10-23T14:55:21Z", "warmup_s": 3, "write_ms": {"max": 434.54, "p50": 239.652, "p95": 320.022, "p99": 360.744}, "write_ratio": 0.5}, "resources": {"api": {"containers": 4, "cpu_pct_mean_per_container": 18.0, "cpu_pct_max_per_container": 20.2, "cpu_utilization_of_limit": 0.36, "mem_max_mib": 244.4}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 5.8, "cpu_pct_max_per_container": 6.4, "cpu_utilization_of_limit": 0.058, "mem_max_mib": 9.9}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 24.1, "cpu_pct_max_per_container": 26.2, "cpu_utilization_of_limit": 0.241, "mem_max_mib": 204.9}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 49.3, "cpu_pct_max_per_container": 50.9, "cpu_utilization_of_limit": 0.985, "mem_max_mib": 14.1}, "postgres_connections": {"active_max": 1, "active_mean": 0.3, "total_max": 73}}, "pool": {"acquires": 24903, "empty_acquire_ratio": 0.0028, "avg_acquire_wait_ms": 0.975, "pool_max_conns_total": 80}}
{"series": "C_shared_resources", "config": "lb1", "concurrency": 64, "repeat": 1, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "4", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "1.00", "LB_CPUS": "1.00", "REDIS_CPUS": "0.50", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "scan", "LB_BALANCE": "roundrobin"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8322932736"}, "bench": {"chats": 8, "concurrency": 64, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"4a204741c04b": 1804, "556742a4f088": 1814, "ef72a9be18da": 1817, "fc5aa456cbb9": 1812}, "label": "C_shared_resources/lb1", "latency_ms": {"max": 391.209, "p50": 186.725, "p95": 293.161, "p99": 330.416}, "mode": "closed", "ok": 7247, "ok_read_rps": 239.26666666666668, "ok_rps": 483.1333333333333, "ok_write_rps": 243.86666666666667, "rate": 0, "read_ms": {"max": 82.769, "p50": 14.364, "p95": 30.377, "p99": 48.517}, "requests": 7247, "timestamp": "2026-10-23T14:55:43Z", "warmup_s": 3, "write_ms": {"max": 391.209, "p50": 240.098, "p95": 312.037, "p99": 340.71}, "write_ratio": 0.5}, "resources": {"api": {"containers": 4, "cpu_pct_mean_per_container": 17.7, "cpu_pct_max_per_container": 20.6, "cpu_utilization_of_limit": 0.353, "mem_max_mib": 65.3}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 5.8, "cpu_pct_max_per_container": 6.4, "cpu_utilization_of_limit": 0.058, "mem_max_mib": 10.2}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 24.0, "cpu_pct_max_per_container": 26.3, "cpu_utilization_of_limit": 0.24, "mem_max_mib": 214.6}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 49.6, "cpu_pct_max_per_container": 50.5, "cpu_utilization_of_limit": 0.992, "mem_max_mib": 14.6}, "postgres_connections": {"active_max": 1, "active_mean": 0.1, "total_max": 74}}, "pool": {"acquires": 25397, "empty_acquire_ratio": 0.0, "avg_acquire_wait_ms": 0.001, "pool_max_conns_total": 80}}
{"series": "C_shared_resources", "config": "lb1", "concurrency": 64, "repeat": 2, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "4", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "1.00", "LB_CPUS": "1.00", "REDIS_CPUS": "0.50", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "scan", "LB_BALANCE": "roundrobin"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8322932736"}, "bench": {"chats": 8, "concurrency": 64, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"4a204741c04b": 1839, "556742a4f088": 1835, "ef72a9be18da": 1836, "fc5aa456cbb9": 1836}, "label": "C_shared_resources/lb1", "latency_ms": {"max": 364.483, "p50": 35.818, "p95": 292.592, "p99": 333.181}, "mode": "closed", "ok": 7346, "ok_read_rps": 250.13333333333333, "ok_rps": 489.73333333333335, "ok_write_rps": 239.6, "rate": 0, "read_ms": {"max": 73.214, "p50": 14.733, "p95": 30.89, "p99": 42.413}, "requests": 7346, "timestamp": "2026-10-23T14:56:05Z", "warmup_s": 3, "write_ms": {"max": 364.483, "p50": 245.118, "p95": 309.845, "p99": 343.49}, "write_ratio": 0.5}, "resources": {"api": {"containers": 4, "cpu_pct_mean_per_container": 17.6, "cpu_pct_max_per_container": 20.4, "cpu_utilization_of_limit": 0.352, "mem_max_mib": 65.1}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 5.8, "cpu_pct_max_per_container": 6.4, "cpu_utilization_of_limit": 0.058, "mem_max_mib": 10.1}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 23.2, "cpu_pct_max_per_container": 26.0, "cpu_utilization_of_limit": 0.232, "mem_max_mib": 216.9}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 49.8, "cpu_pct_max_per_container": 50.7, "cpu_utilization_of_limit": 0.996, "mem_max_mib": 14.4}, "postgres_connections": {"active_max": 3, "active_mean": 0.9, "total_max": 73}}, "pool": {"acquires": 25116, "empty_acquire_ratio": 0.0016, "avg_acquire_wait_ms": 0.003, "pool_max_conns_total": 80}}
{"series": "C_shared_resources", "config": "redis1", "concurrency": 16, "repeat": 0, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "4", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "1.00", "LB_CPUS": "0.50", "REDIS_CPUS": "1.00", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "scan", "LB_BALANCE": "roundrobin"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8322932736"}, "bench": {"chats": 8, "concurrency": 16, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"4a204741c04b": 1824, "556742a4f088": 1829, "ef72a9be18da": 1828, "fc5aa456cbb9": 1825}, "label": "C_shared_resources/redis1", "latency_ms": {"max": 128.548, "p50": 28.82, "p95": 78.131, "p99": 99.385}, "mode": "closed", "ok": 7306, "ok_read_rps": 241.73333333333332, "ok_rps": 487.06666666666666, "ok_write_rps": 245.33333333333334, "rate": 0, "read_ms": {"max": 49.619, "p50": 5.113, "p95": 12.695, "p99": 20.412}, "requests": 7306, "timestamp": "2026-10-23T14:56:35Z", "warmup_s": 3, "write_ms": {"max": 128.548, "p50": 56.884, "p95": 87.38, "p99": 107.192}, "write_ratio": 0.5}, "resources": {"api": {"containers": 4, "cpu_pct_mean_per_container": 19.8, "cpu_pct_max_per_container": 22.6, "cpu_utilization_of_limit": 0.397, "mem_max_mib": 63.2}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 5.8, "cpu_pct_max_per_container": 6.5, "cpu_utilization_of_limit": 0.115, "mem_max_mib": 9.0}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 27.4, "cpu_pct_max_per_container": 43.2, "cpu_utilization_of_limit": 0.274, "mem_max_mib": 232.9}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 52.6, "cpu_pct_max_per_container": 55.1, "cpu_utilization_of_limit": 0.526, "mem_max_mib": 18.1}, "postgres_connections": {"active_max": 1, "active_mean": 0.1, "total_max": 73}}, "pool": {"acquires": 24850, "empty_acquire_ratio": 0.0, "avg_acquire_wait_ms": 0.001, "pool_max_conns_total": 80}}
{"series": "C_shared_resources", "config": "redis1", "concurrency": 16, "repeat": 1, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "4", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "1.00", "LB_CPUS": "0.50", "REDIS_CPUS": "1.00", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "scan", "LB_BALANCE": "roundrobin"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8322932736"}, "bench": {"chats": 8, "concurrency": 16, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"4a204741c04b": 1845, "556742a4f088": 1847, "ef72a9be18da": 1846, "fc5aa456cbb9": 1844}, "label": "C_shared_resources/redis1", "latency_ms": {"max": 272.259, "p50": 30.712, "p95": 76.349, "p99": 97.135}, "mode": "closed", "ok": 7382, "ok_read_rps": 242.86666666666667, "ok_rps": 492.1333333333333, "ok_write_rps": 249.26666666666668, "rate": 0, "read_ms": {"max": 77.1, "p50": 5.032, "p95": 11.856, "p99": 20.182}, "requests": 7382, "timestamp": "2026-10-23T14:56:56Z", "warmup_s": 3, "write_ms": {"max": 272.259, "p50": 55.321, "p95": 85.157, "p99": 111.38}, "write_ratio": 0.5}, "resources": {"api": {"containers": 4, "cpu_pct_mean_per_container": 20.1, "cpu_pct_max_per_container": 21.9, "cpu_utilization_of_limit": 0.403, "mem_max_mib": 63.1}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 5.9, "cpu_pct_max_per_container": 6.2, "cpu_utilization_of_limit": 0.117, "mem_max_mib": 8.8}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 24.4, "cpu_pct_max_per_container": 26.0, "cpu_utilization_of_limit": 0.244, "mem_max_mib": 228.4}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 53.7, "cpu_pct_max_per_container": 55.5, "cpu_utilization_of_limit": 0.537, "mem_max_mib": 18.0}, "postgres_connections": {"active_max": 16, "active_mean": 2.4, "total_max": 73}}, "pool": {"acquires": 25229, "empty_acquire_ratio": 0.0, "avg_acquire_wait_ms": 0.001, "pool_max_conns_total": 80}}
{"series": "C_shared_resources", "config": "redis1", "concurrency": 16, "repeat": 2, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "4", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "1.00", "LB_CPUS": "0.50", "REDIS_CPUS": "1.00", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "scan", "LB_BALANCE": "roundrobin"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8322932736"}, "bench": {"chats": 8, "concurrency": 16, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"4a204741c04b": 1894, "556742a4f088": 1896, "ef72a9be18da": 1901, "fc5aa456cbb9": 1896}, "label": "C_shared_resources/redis1", "latency_ms": {"max": 141.528, "p50": 28.028, "p95": 75.485, "p99": 103.578}, "mode": "closed", "ok": 7587, "ok_read_rps": 249.66666666666666, "ok_rps": 505.8, "ok_write_rps": 256.1333333333333, "rate": 0, "read_ms": {"max": 64.106, "p50": 5.24, "p95": 13.184, "p99": 23.025}, "requests": 7587, "timestamp": "2026-10-23T14:57:19Z", "warmup_s": 3, "write_ms": {"max": 141.528, "p50": 53.699, "p95": 86.008, "p99": 111.28}, "write_ratio": 0.5}, "resources": {"api": {"containers": 4, "cpu_pct_mean_per_container": 20.4, "cpu_pct_max_per_container": 22.7, "cpu_utilization_of_limit": 0.407, "mem_max_mib": 71.5}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 5.9, "cpu_pct_max_per_container": 6.2, "cpu_utilization_of_limit": 0.118, "mem_max_mib": 9.0}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 25.2, "cpu_pct_max_per_container": 26.1, "cpu_utilization_of_limit": 0.252, "mem_max_mib": 227.0}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 55.0, "cpu_pct_max_per_container": 56.3, "cpu_utilization_of_limit": 0.55, "mem_max_mib": 14.9}, "postgres_connections": {"active_max": 1, "active_mean": 0.1, "total_max": 73}}, "pool": {"acquires": 26166, "empty_acquire_ratio": 0.0, "avg_acquire_wait_ms": 0.001, "pool_max_conns_total": 80}}
{"series": "C_shared_resources", "config": "redis1", "concurrency": 64, "repeat": 0, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "4", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "1.00", "LB_CPUS": "0.50", "REDIS_CPUS": "1.00", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "scan", "LB_BALANCE": "roundrobin"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8322932736"}, "bench": {"chats": 8, "concurrency": 64, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"4a204741c04b": 1956, "556742a4f088": 1959, "ef72a9be18da": 1956, "fc5aa456cbb9": 1959}, "label": "C_shared_resources/redis1", "latency_ms": {"max": 403.765, "p50": 145.339, "p95": 280.676, "p99": 325.283}, "mode": "closed", "ok": 7830, "ok_read_rps": 259.93333333333334, "ok_rps": 522, "ok_write_rps": 262.06666666666666, "rate": 0, "read_ms": {"max": 85.914, "p50": 13.761, "p95": 27.473, "p99": 37.889}, "requests": 7830, "timestamp": "2026-10-23T14:57:41Z", "warmup_s": 3, "write_ms": {"max": 403.765, "p50": 221.005, "p95": 299.949, "p99": 354.354}, "write_ratio": 0.5}, "resources": {"api": {"containers": 4, "cpu_pct_mean_per_container": 19.3, "cpu_pct_max_per_container": 22.0, "cpu_utilization_of_limit": 0.386, "mem_max_mib": 65.0}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 6.3, "cpu_pct_max_per_container": 6.7, "cpu_utilization_of_limit": 0.125, "mem_max_mib": 9.8}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 29.2, "cpu_pct_max_per_container": 44.0, "cpu_utilization_of_limit": 0.292, "mem_max_mib": 248.9}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 53.2, "cpu_pct_max_per_container": 55.4, "cpu_utilization_of_limit": 0.532, "mem_max_mib": 13.4}, "postgres_connections": {"active_max": 2, "active_mean": 0.6, "total_max": 79}}, "pool": {"acquires": 27266, "empty_acquire_ratio": 0.0002, "avg_acquire_wait_ms": 0.06, "pool_max_conns_total": 80}}
{"series": "C_shared_resources", "config": "redis1", "concurrency": 64, "repeat": 1, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "4", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "1.00", "LB_CPUS": "0.50", "REDIS_CPUS": "1.00", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "scan", "LB_BALANCE": "roundrobin"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8322932736"}, "bench": {"chats": 8, "concurrency": 64, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"4a204741c04b": 2023, "556742a4f088": 2006, "ef72a9be18da": 2019, "fc5aa456cbb9": 2021}, "label": "C_shared_resources/redis1", "latency_ms": {"max": 319.672, "p50": 38.515, "p95": 266.303, "p99": 289.011}, "mode": "closed", "ok": 8069, "ok_read_rps": 269.8666666666667, "ok_rps": 537.9333333333333, "ok_write_rps": 268.06666666666666, "rate": 0, "read_ms": {"max": 53.801, "p50": 13.708, "p95": 25.409, "p99": 33.758}, "requests": 8069, "timestamp": "2026-10-23T14:58:03Z", "warmup_s": 3, "write_ms": {"max": 319.672, "p50": 220.781, "p95": 277.338, "p99": 296.396}, "write_ratio": 0.5}, "resources": {"api": {"containers": 4, "cpu_pct_mean_per_container": 19.6, "cpu_pct_max_per_container": 21.8, "cpu_utilization_of_limit": 0.393, "mem_max_mib": 68.4}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 6.3, "cpu_pct_max_per_container": 6.5, "cpu_utilization_of_limit": 0.125, "mem_max_mib": 10.3}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 26.6, "cpu_pct_max_per_container": 28.6, "cpu_utilization_of_limit": 0.266, "mem_max_mib": 247.2}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 54.8, "cpu_pct_max_per_container": 58.4, "cpu_utilization_of_limit": 0.548, "mem_max_mib": 17.4}, "postgres_connections": {"active_max": 2, "active_mean": 0.6, "total_max": 78}}, "pool": {"acquires": 28074, "empty_acquire_ratio": 0.0, "avg_acquire_wait_ms": 0.001, "pool_max_conns_total": 80}}
{"series": "C_shared_resources", "config": "redis1", "concurrency": 64, "repeat": 2, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "4", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "1.00", "LB_CPUS": "0.50", "REDIS_CPUS": "1.00", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "scan", "LB_BALANCE": "roundrobin"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8322932736"}, "bench": {"chats": 8, "concurrency": 64, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"4a204741c04b": 2040, "556742a4f088": 2031, "ef72a9be18da": 2037, "fc5aa456cbb9": 2042}, "label": "C_shared_resources/redis1", "latency_ms": {"max": 360.494, "p50": 131.864, "p95": 272.159, "p99": 304.745}, "mode": "closed", "ok": 8150, "ok_read_rps": 270.73333333333335, "ok_rps": 543.3333333333334, "ok_write_rps": 272.6, "rate": 0, "read_ms": {"max": 63.143, "p50": 13.435, "p95": 27.061, "p99": 35.516}, "requests": 8150, "timestamp": "2026-10-23T14:58:23Z", "warmup_s": 3, "write_ms": {"max": 360.494, "p50": 213.661, "p95": 289.346, "p99": 316.335}, "write_ratio": 0.5}, "resources": {"api": {"containers": 4, "cpu_pct_mean_per_container": 19.6, "cpu_pct_max_per_container": 21.8, "cpu_utilization_of_limit": 0.392, "mem_max_mib": 64.6}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 6.4, "cpu_pct_max_per_container": 6.6, "cpu_utilization_of_limit": 0.128, "mem_max_mib": 10.4}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 26.4, "cpu_pct_max_per_container": 27.9, "cpu_utilization_of_limit": 0.264, "mem_max_mib": 251.2}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 55.0, "cpu_pct_max_per_container": 57.4, "cpu_utilization_of_limit": 0.55, "mem_max_mib": 14.1}, "postgres_connections": {"active_max": 1, "active_mean": 0.4, "total_max": 78}}, "pool": {"acquires": 28085, "empty_acquire_ratio": 0.0, "avg_acquire_wait_ms": 0.001, "pool_max_conns_total": 80}}
{"series": "E_scale_out_after_fix", "config": "1x0.50", "concurrency": 4, "repeat": 0, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "1", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "1.00", "LB_CPUS": "0.50", "REDIS_CPUS": "0.50", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "version", "LB_BALANCE": "roundrobin"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8323969024"}, "bench": {"chats": 8, "concurrency": 4, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"d84589879ca7": 7231}, "label": "E_scale_out_after_fix/1x0.50", "latency_ms": {"max": 51.897, "p50": 5.633, "p95": 31.897, "p99": 39.572}, "mode": "closed", "ok": 7231, "ok_read_rps": 240.26666666666668, "ok_rps": 482.06666666666666, "ok_write_rps": 241.8, "rate": 0, "read_ms": {"max": 48.118, "p50": 5.125, "p95": 29.423, "p99": 38.747}, "requests": 7231, "timestamp": "2026-10-23T14:49:47Z", "warmup_s": 3, "write_ms": {"max": 51.897, "p50": 6.254, "p95": 33.299, "p99": 39.905}, "write_ratio": 0.5}, "resources": {"api": {"containers": 1, "cpu_pct_mean_per_container": 49.9, "cpu_pct_max_per_container": 50.7, "cpu_utilization_of_limit": 0.999, "mem_max_mib": 137.8}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 8.3, "cpu_pct_max_per_container": 8.8, "cpu_utilization_of_limit": 0.167, "mem_max_mib": 8.6}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 36.7, "cpu_pct_max_per_container": 41.6, "cpu_utilization_of_limit": 0.367, "mem_max_mib": 42.2}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 11.4, "cpu_pct_max_per_container": 14.6, "cpu_utilization_of_limit": 0.228, "mem_max_mib": 29.8}, "postgres_connections": {"active_max": 1, "active_mean": 0.1, "total_max": 5}}, "pool": {"acquires": 25111, "empty_acquire_ratio": 0.0001, "avg_acquire_wait_ms": 0.001, "pool_max_conns_total": 20}}
{"series": "E_scale_out_after_fix", "config": "1x0.50", "concurrency": 4, "repeat": 1, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "1", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "1.00", "LB_CPUS": "0.50", "REDIS_CPUS": "0.50", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "version", "LB_BALANCE": "roundrobin"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8323969024"}, "bench": {"chats": 8, "concurrency": 4, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"d84589879ca7": 7129}, "label": "E_scale_out_after_fix/1x0.50", "latency_ms": {"max": 97.942, "p50": 5.725, "p95": 31.014, "p99": 39.026}, "mode": "closed", "ok": 7129, "ok_read_rps": 234.93333333333334, "ok_rps": 475.26666666666665, "ok_write_rps": 240.33333333333334, "rate": 0, "read_ms": {"max": 60.261, "p50": 5.123, "p95": 29.213, "p99": 38.52}, "requests": 7129, "timestamp": "2026-10-23T14:50:10Z", "warmup_s": 3, "write_ms": {"max": 97.942, "p50": 6.278, "p95": 32.142, "p99": 39.631}, "write_ratio": 0.5}, "resources": {"api": {"containers": 1, "cpu_pct_mean_per_container": 50.1, "cpu_pct_max_per_container": 50.9, "cpu_utilization_of_limit": 1.002, "mem_max_mib": 255.9}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 8.5, "cpu_pct_max_per_container": 9.1, "cpu_utilization_of_limit": 0.169, "mem_max_mib": 8.5}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 38.7, "cpu_pct_max_per_container": 44.0, "cpu_utilization_of_limit": 0.387, "mem_max_mib": 47.5}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 11.5, "cpu_pct_max_per_container": 15.1, "cpu_utilization_of_limit": 0.229, "mem_max_mib": 52.1}, "postgres_connections": {"active_max": 1, "active_mean": 0.9, "total_max": 5}}, "pool": {"acquires": 24670, "empty_acquire_ratio": 0.0, "avg_acquire_wait_ms": 0.001, "pool_max_conns_total": 20}}
{"series": "E_scale_out_after_fix", "config": "1x0.50", "concurrency": 4, "repeat": 2, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "1", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "1.00", "LB_CPUS": "0.50", "REDIS_CPUS": "0.50", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "version", "LB_BALANCE": "roundrobin"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8323969024"}, "bench": {"chats": 8, "concurrency": 4, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"d84589879ca7": 6978}, "label": "E_scale_out_after_fix/1x0.50", "latency_ms": {"max": 71.068, "p50": 5.795, "p95": 32.088, "p99": 40.255}, "mode": "closed", "ok": 6978, "ok_read_rps": 233.66666666666666, "ok_rps": 465.2, "ok_write_rps": 231.53333333333333, "rate": 0, "read_ms": {"max": 71.068, "p50": 5.284, "p95": 31.772, "p99": 39.517}, "requests": 6978, "timestamp": "2026-10-23T14:50:32Z", "warmup_s": 3, "write_ms": {"max": 64.966, "p50": 6.352, "p95": 32.396, "p99": 41.253}, "write_ratio": 0.5}, "resources": {"api": {"containers": 1, "cpu_pct_mean_per_container": 50.1, "cpu_pct_max_per_container": 50.7, "cpu_utilization_of_limit": 1.003, "mem_max_mib": 242.0}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 8.4, "cpu_pct_max_per_container": 9.0, "cpu_utilization_of_limit": 0.168, "mem_max_mib": 8.6}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 36.4, "cpu_pct_max_per_container": 42.2, "cpu_utilization_of_limit": 0.364, "mem_max_mib": 50.4}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 11.2, "cpu_pct_max_per_container": 13.8, "cpu_utilization_of_limit": 0.223, "mem_max_mib": 62.6}, "postgres_connections": {"active_max": 2, "active_mean": 0.6, "total_max": 5}}, "pool": {"acquires": 23976, "empty_acquire_ratio": 0.0, "avg_acquire_wait_ms": 0.001, "pool_max_conns_total": 20}}
{"series": "E_scale_out_after_fix", "config": "1x0.50", "concurrency": 16, "repeat": 0, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "1", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "1.00", "LB_CPUS": "0.50", "REDIS_CPUS": "0.50", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "version", "LB_BALANCE": "roundrobin"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8323969024"}, "bench": {"chats": 8, "concurrency": 16, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"d84589879ca7": 7662}, "label": "E_scale_out_after_fix/1x0.50", "latency_ms": {"max": 134.873, "p50": 24.447, "p95": 66.167, "p99": 84.066}, "mode": "closed", "ok": 7662, "ok_read_rps": 259.06666666666666, "ok_rps": 510.8, "ok_write_rps": 251.73333333333332, "rate": 0, "read_ms": {"max": 92.824, "p50": 20.49, "p95": 57.816, "p99": 71.749}, "requests": 7662, "timestamp": "2026-10-23T14:50:54Z", "warmup_s": 3, "write_ms": {"max": 134.873, "p50": 29.257, "p95": 71.697, "p99": 90.117}, "write_ratio": 0.5}, "resources": {"api": {"containers": 1, "cpu_pct_mean_per_container": 50.0, "cpu_pct_max_per_container": 50.5, "cpu_utilization_of_limit": 1.0, "mem_max_mib": 223.7}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 8.5, "cpu_pct_max_per_container": 9.0, "cpu_utilization_of_limit": 0.169, "mem_max_mib": 8.9}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 37.6, "cpu_pct_max_per_container": 45.7, "cpu_utilization_of_limit": 0.376, "mem_max_mib": 80.4}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 10.3, "cpu_pct_max_per_container": 11.1, "cpu_utilization_of_limit": 0.205, "mem_max_mib": 62.0}, "postgres_connections": {"active_max": 1, "active_mean": 0.2, "total_max": 18}}, "pool": {"acquires": 26030, "empty_acquire_ratio": 0.0005, "avg_acquire_wait_ms": 0.044, "pool_max_conns_total": 20}}
{"series": "E_scale_out_after_fix", "config": "1x0.50", "concurrency": 16, "repeat": 1, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "1", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "1.00", "LB_CPUS": "0.50", "REDIS_CPUS": "0.50", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "version", "LB_BALANCE": "roundrobin"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8323969024"}, "bench": {"chats": 8, "concurrency": 16, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"d84589879ca7": 7680}, "label": "E_scale_out_after_fix/1x0.50", "latency_ms": {"max": 147.929, "p50": 24.677, "p95": 66.031, "p99": 79.93}, "mode": "closed", "ok": 7680, "ok_read_rps": 259.26666666666665, "ok_rps": 512, "ok_write_rps": 252.73333333333332, "rate": 0, "read_ms": {"max": 112.467, "p50": 21.711, "p95": 59.838, "p99": 76.491}, "requests": 7680, "timestamp": "2026-10-23T14:51:17Z", "warmup_s": 3, "write_ms": {"max": 147.929, "p50": 28.173, "p95": 69.773, "p99": 82.778}, "write_ratio": 0.5}, "resources": {"api": {"containers": 1, "cpu_pct_mean_per_container": 49.8, "cpu_pct_max_per_container": 50.5, "cpu_utilization_of_limit": 0.995, "mem_max_mib": 64.5}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 8.5, "cpu_pct_max_per_container": 9.5, "cpu_utilization_of_limit": 0.17, "mem_max_mib": 8.9}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 34.7, "cpu_pct_max_per_container": 38.7, "cpu_utilization_of_limit": 0.347, "mem_max_mib": 84.4}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 13.8, "cpu_pct_max_per_container": 31.8, "cpu_utilization_of_limit": 0.277, "mem_max_mib": 59.0}, "postgres_connections": {"active_max": 1, "active_mean": 0.3, "total_max": 17}}, "pool": {"acquires": 26396, "empty_acquire_ratio": 0.0, "avg_acquire_wait_ms": 0.001, "pool_max_conns_total": 20}}
{"series": "E_scale_out_after_fix", "config": "1x0.50", "concurrency": 16, "repeat": 2, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "1", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "1.00", "LB_CPUS": "0.50", "REDIS_CPUS": "0.50", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "version", "LB_BALANCE": "roundrobin"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8323969024"}, "bench": {"chats": 8, "concurrency": 16, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"d84589879ca7": 7865}, "label": "E_scale_out_after_fix/1x0.50", "latency_ms": {"max": 129.888, "p50": 24.074, "p95": 65.21, "p99": 81.169}, "mode": "closed", "ok": 7865, "ok_read_rps": 261.6, "ok_rps": 524.3333333333334, "ok_write_rps": 262.73333333333335, "rate": 0, "read_ms": {"max": 115.32, "p50": 20.635, "p95": 59.999, "p99": 72.969}, "requests": 7865, "timestamp": "2026-10-23T14:51:40Z", "warmup_s": 3, "write_ms": {"max": 129.888, "p50": 27.198, "p95": 69.862, "p99": 85.8}, "write_ratio": 0.5}, "resources": {"api": {"containers": 1, "cpu_pct_mean_per_container": 50.0, "cpu_pct_max_per_container": 51.3, "cpu_utilization_of_limit": 1.001, "mem_max_mib": 64.5}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 8.6, "cpu_pct_max_per_container": 10.0, "cpu_utilization_of_limit": 0.172, "mem_max_mib": 9.0}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 36.4, "cpu_pct_max_per_container": 39.3, "cpu_utilization_of_limit": 0.364, "mem_max_mib": 87.1}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 10.8, "cpu_pct_max_per_container": 15.0, "cpu_utilization_of_limit": 0.216, "mem_max_mib": 58.3}, "postgres_connections": {"active_max": 1, "active_mean": 0.3, "total_max": 17}}, "pool": {"acquires": 27060, "empty_acquire_ratio": 0.0, "avg_acquire_wait_ms": 0.001, "pool_max_conns_total": 20}}
{"series": "E_scale_out_after_fix", "config": "1x0.50", "concurrency": 64, "repeat": 0, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "1", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "1.00", "LB_CPUS": "0.50", "REDIS_CPUS": "0.50", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "version", "LB_BALANCE": "roundrobin"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8323969024"}, "bench": {"chats": 8, "concurrency": 64, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"d84589879ca7": 8451}, "label": "E_scale_out_after_fix/1x0.50", "latency_ms": {"max": 290.631, "p50": 108.658, "p95": 177.337, "p99": 205.905}, "mode": "closed", "ok": 8451, "ok_read_rps": 279.73333333333335, "ok_rps": 563.4, "ok_write_rps": 283.6666666666667, "rate": 0, "read_ms": {"max": 250.765, "p50": 103.688, "p95": 165.099, "p99": 195.479}, "requests": 8451, "timestamp": "2026-10-23T14:52:02Z", "warmup_s": 3, "write_ms": {"max": 290.631, "p50": 114.609, "p95": 184.618, "p99": 212.59}, "write_ratio": 0.5}, "resources": {"api": {"containers": 1, "cpu_pct_mean_per_container": 49.9, "cpu_pct_max_per_container": 50.5, "cpu_utilization_of_limit": 0.999, "mem_max_mib": 68.6}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 10.2, "cpu_pct_max_per_container": 11.2, "cpu_utilization_of_limit": 0.204, "mem_max_mib": 10.3}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 40.7, "cpu_pct_max_per_container": 47.4, "cpu_utilization_of_limit": 0.407, "mem_max_mib": 97.2}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 11.5, "cpu_pct_max_per_container": 14.6, "cpu_utilization_of_limit": 0.23, "mem_max_mib": 59.6}, "postgres_connections": {"active_max": 1, "active_mean": 0.3, "total_max": 20}}, "pool": {"acquires": 30288, "empty_acquire_ratio": 0.8948, "avg_acquire_wait_ms": 13.655, "pool_max_conns_total": 20}}
{"series": "E_scale_out_after_fix", "config": "1x0.50", "concurrency": 64, "repeat": 1, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "1", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "1.00", "LB_CPUS": "0.50", "REDIS_CPUS": "0.50", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "version", "LB_BALANCE": "roundrobin"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8323969024"}, "bench": {"chats": 8, "concurrency": 64, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"d84589879ca7": 8400}, "label": "E_scale_out_after_fix/1x0.50", "latency_ms": {"max": 288.798, "p50": 109.088, "p95": 175.975, "p99": 202.438}, "mode": "closed", "ok": 8400, "ok_read_rps": 287.4, "ok_rps": 560, "ok_write_rps": 272.6, "rate": 0, "read_ms": {"max": 266.894, "p50": 105.743, "p95": 168.485, "p99": 192.139}, "requests": 8400, "timestamp": "2026-10-23T14:52:25Z", "warmup_s": 3, "write_ms": {"max": 288.798, "p50": 113.572, "p95": 182.726, "p99": 213.974}, "write_ratio": 0.5}, "resources": {"api": {"containers": 1, "cpu_pct_mean_per_container": 50.6, "cpu_pct_max_per_container": 51.5, "cpu_utilization_of_limit": 1.012, "mem_max_mib": 67.5}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 9.4, "cpu_pct_max_per_container": 10.6, "cpu_utilization_of_limit": 0.189, "mem_max_mib": 10.3}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 37.0, "cpu_pct_max_per_container": 39.2, "cpu_utilization_of_limit": 0.37, "mem_max_mib": 100.2}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 11.8, "cpu_pct_max_per_container": 20.3, "cpu_utilization_of_limit": 0.235, "mem_max_mib": 42.9}, "postgres_connections": {"active_max": 2, "active_mean": 0.5, "total_max": 20}}, "pool": {"acquires": 29883, "empty_acquire_ratio": 0.8652, "avg_acquire_wait_ms": 12.267, "pool_max_conns_total": 20}}
{"series": "E_scale_out_after_fix", "config": "1x0.50", "concurrency": 64, "repeat": 2, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "1", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "1.00", "LB_CPUS": "0.50", "REDIS_CPUS": "0.50", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "version", "LB_BALANCE": "roundrobin"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8323969024"}, "bench": {"chats": 8, "concurrency": 64, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"d84589879ca7": 8330}, "label": "E_scale_out_after_fix/1x0.50", "latency_ms": {"max": 305.232, "p50": 109.29, "p95": 175.427, "p99": 204.492}, "mode": "closed", "ok": 8330, "ok_read_rps": 275.2, "ok_rps": 555.3333333333334, "ok_write_rps": 280.1333333333333, "rate": 0, "read_ms": {"max": 261.746, "p50": 104.072, "p95": 163.027, "p99": 191.553}, "requests": 8330, "timestamp": "2026-10-23T14:52:47Z", "warmup_s": 3, "write_ms": {"max": 305.232, "p50": 116.549, "p95": 182.917, "p99": 211.486}, "write_ratio": 0.5}, "resources": {"api": {"containers": 1, "cpu_pct_mean_per_container": 49.8, "cpu_pct_max_per_container": 50.8, "cpu_utilization_of_limit": 0.997, "mem_max_mib": 80.0}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 9.2, "cpu_pct_max_per_container": 9.9, "cpu_utilization_of_limit": 0.184, "mem_max_mib": 10.4}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 39.7, "cpu_pct_max_per_container": 45.3, "cpu_utilization_of_limit": 0.397, "mem_max_mib": 104.2}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 10.6, "cpu_pct_max_per_container": 14.4, "cpu_utilization_of_limit": 0.212, "mem_max_mib": 34.9}, "postgres_connections": {"active_max": 2, "active_mean": 0.6, "total_max": 21}}, "pool": {"acquires": 29897, "empty_acquire_ratio": 0.8929, "avg_acquire_wait_ms": 14.225, "pool_max_conns_total": 20}}
{"series": "E_scale_out_after_fix", "config": "2x0.50", "concurrency": 4, "repeat": 0, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "2", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "1.00", "LB_CPUS": "0.50", "REDIS_CPUS": "0.50", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "version", "LB_BALANCE": "roundrobin"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8323969024"}, "bench": {"chats": 8, "concurrency": 4, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"0c3123b2f1ed": 4574, "2116fbbd7d1b": 4572}, "label": "E_scale_out_after_fix/2x0.50", "latency_ms": {"max": 72.886, "p50": 5.615, "p95": 11.998, "p99": 20.64}, "mode": "closed", "ok": 9146, "ok_read_rps": 307.4, "ok_rps": 609.7333333333333, "ok_write_rps": 302.3333333333333, "rate": 0, "read_ms": {"max": 56.91, "p50": 5.251, "p95": 11.474, "p99": 17.871}, "requests": 9146, "timestamp": "2026-10-23T14:53:19Z", "warmup_s": 3, "write_ms": {"max": 72.886, "p50": 5.981, "p95": 12.784, "p99": 21.92}, "write_ratio": 0.5}, "resources": {"api": {"containers": 2, "cpu_pct_mean_per_container": 39.7, "cpu_pct_max_per_container": 41.1, "cpu_utilization_of_limit": 0.794, "mem_max_mib": 138.3}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 10.7, "cpu_pct_max_per_container": 11.4, "cpu_utilization_of_limit": 0.214, "mem_max_mib": 10.4}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 43.3, "cpu_pct_max_per_container": 47.5, "cpu_utilization_of_limit": 0.433, "mem_max_mib": 79.4}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 17.3, "cpu_pct_max_per_container": 26.6, "cpu_utilization_of_limit": 0.346, "mem_max_mib": 48.5}, "postgres_connections": {"active_max": 3, "active_mean": 1, "total_max": 8}}, "pool": {"acquires": 30940, "empty_acquire_ratio": 0.0001, "avg_acquire_wait_ms": 0.003, "pool_max_conns_total": 40}}
{"series": "E_scale_out_after_fix", "config": "2x0.50", "concurrency": 4, "repeat": 1, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "2", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "1.00", "LB_CPUS": "0.50", "REDIS_CPUS": "0.50", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "version", "LB_BALANCE": "roundrobin"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8323969024"}, "bench": {"chats": 8, "concurrency": 4, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"0c3123b2f1ed": 4585, "2116fbbd7d1b": 4585}, "label": "E_scale_out_after_fix/2x0.50", "latency_ms": {"max": 56.637, "p50": 5.709, "p95": 11.581, "p99": 20.054}, "mode": "closed", "ok": 9170, "ok_read_rps": 305.6666666666667, "ok_rps": 611.3333333333334, "ok_write_rps": 305.6666666666667, "rate": 0, "read_ms": {"max": 56.637, "p50": 5.375, "p95": 10.76, "p99": 17.782}, "requests": 9170, "timestamp": "2026-10-23T14:53:41Z", "warmup_s": 3, "write_ms": {"max": 55.405, "p50": 6.015, "p95": 12.427, "p99": 22.094}, "write_ratio": 0.5}, "resources": {"api": {"containers": 2, "cpu_pct_mean_per_container": 40.1, "cpu_pct_max_per_container": 41.3, "cpu_utilization_of_limit": 0.801, "mem_max_mib": 241.4}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 10.8, "cpu_pct_max_per_container": 11.2, "cpu_utilization_of_limit": 0.215, "mem_max_mib": 10.6}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 45.2, "cpu_pct_max_per_container": 48.6, "cpu_utilization_of_limit": 0.452, "mem_max_mib": 90.3}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 13.9, "cpu_pct_max_per_container": 17.0, "cpu_utilization_of_limit": 0.278, "mem_max_mib": 69.7}, "postgres_connections": {"active_max": 3, "active_mean": 1.4, "total_max": 8}}, "pool": {"acquires": 31320, "empty_acquire_ratio": 0.0, "avg_acquire_wait_ms": 0.0, "pool_max_conns_total": 40}}
{"series": "E_scale_out_after_fix", "config": "2x0.50", "concurrency": 4, "repeat": 2, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "2", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "1.00", "LB_CPUS": "0.50", "REDIS_CPUS": "0.50", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "version", "LB_BALANCE": "roundrobin"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8323969024"}, "bench": {"chats": 8, "concurrency": 4, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"0c3123b2f1ed": 4369, "2116fbbd7d1b": 4367}, "label": "E_scale_out_after_fix/2x0.50", "latency_ms": {"max": 76.12, "p50": 5.942, "p95": 12.199, "p99": 21.545}, "mode": "closed", "ok": 8736, "ok_read_rps": 292.4, "ok_rps": 582.4, "ok_write_rps": 290, "rate": 0, "read_ms": {"max": 76.12, "p50": 5.805, "p95": 11.805, "p99": 20.406}, "requests": 8736, "timestamp": "2026-10-23T14:54:01Z", "warmup_s": 3, "write_ms": {"max": 64.649, "p50": 6.091, "p95": 12.512, "p99": 22.298}, "write_ratio": 0.5}, "resources": {"api": {"containers": 2, "cpu_pct_mean_per_container": 38.3, "cpu_pct_max_per_container": 40.6, "cpu_utilization_of_limit": 0.765, "mem_max_mib": 235.7}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 10.2, "cpu_pct_max_per_container": 10.9, "cpu_utilization_of_limit": 0.203, "mem_max_mib": 10.6}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 46.5, "cpu_pct_max_per_container": 51.4, "cpu_utilization_of_limit": 0.465, "mem_max_mib": 86.2}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 16.6, "cpu_pct_max_per_container": 38.2, "cpu_utilization_of_limit": 0.332, "mem_max_mib": 78.3}, "postgres_connections": {"active_max": 2, "active_mean": 0.9, "total_max": 8}}, "pool": {"acquires": 29474, "empty_acquire_ratio": 0.0, "avg_acquire_wait_ms": 0.0, "pool_max_conns_total": 40}}
{"series": "E_scale_out_after_fix", "config": "2x0.50", "concurrency": 16, "repeat": 0, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "2", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "1.00", "LB_CPUS": "0.50", "REDIS_CPUS": "0.50", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "version", "LB_BALANCE": "roundrobin"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8323969024"}, "bench": {"chats": 8, "concurrency": 16, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"0c3123b2f1ed": 4635, "2116fbbd7d1b": 4631}, "label": "E_scale_out_after_fix/2x0.50", "latency_ms": {"max": 347.366, "p50": 23.047, "p95": 52.358, "p99": 72.581}, "mode": "closed", "ok": 9266, "ok_read_rps": 303.26666666666665, "ok_rps": 617.7333333333333, "ok_write_rps": 314.46666666666664, "rate": 0, "read_ms": {"max": 347.366, "p50": 16.807, "p95": 41.11, "p99": 55.019}, "requests": 9266, "timestamp": "2026-10-23T14:54:22Z", "warmup_s": 3, "write_ms": {"max": 148.715, "p50": 30.013, "p95": 58.662, "p99": 81.648}, "write_ratio": 0.5}, "resources": {"api": {"containers": 2, "cpu_pct_mean_per_container": 38.6, "cpu_pct_max_per_container": 41.5, "cpu_utilization_of_limit": 0.773, "mem_max_mib": 223.9}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 10.0, "cpu_pct_max_per_container": 10.6, "cpu_utilization_of_limit": 0.2, "mem_max_mib": 10.6}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 48.7, "cpu_pct_max_per_container": 52.4, "cpu_utilization_of_limit": 0.487, "mem_max_mib": 138.2}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 17.8, "cpu_pct_max_per_container": 33.2, "cpu_utilization_of_limit": 0.355, "mem_max_mib": 74.5}, "postgres_connections": {"active_max": 9, "active_mean": 4.8, "total_max": 27}}, "pool": {"acquires": 31237, "empty_acquire_ratio": 0.0006, "avg_acquire_wait_ms": 0.049, "pool_max_conns_total": 40}}
{"series": "E_scale_out_after_fix", "config": "2x0.50", "concurrency": 16, "repeat": 1, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "2", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "1.00", "LB_CPUS": "0.50", "REDIS_CPUS": "0.50", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "version", "LB_BALANCE": "roundrobin"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8323969024"}, "bench": {"chats": 8, "concurrency": 16, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"0c3123b2f1ed": 4692, "2116fbbd7d1b": 4689}, "label": "E_scale_out_after_fix/2x0.50", "latency_ms": {"max": 132.319, "p50": 22.931, "p95": 51.393, "p99": 73.644}, "mode": "closed", "ok": 9381, "ok_read_rps": 315.3333333333333, "ok_rps": 625.4, "ok_write_rps": 310.06666666666666, "rate": 0, "read_ms": {"max": 117.434, "p50": 16.824, "p95": 39.196, "p99": 52.55}, "requests": 9381, "timestamp": "2026-10-23T14:54:43Z", "warmup_s": 3, "write_ms": {"max": 132.319, "p50": 30.49, "p95": 59.126, "p99": 85.486}, "write_ratio": 0.5}, "resources": {"api": {"containers": 2, "cpu_pct_mean_per_container": 40.4, "cpu_pct_max_per_container": 42.0, "cpu_utilization_of_limit": 0.808, "mem_max_mib": 202.9}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 9.8, "cpu_pct_max_per_container": 10.1, "cpu_utilization_of_limit": 0.197, "mem_max_mib": 10.7}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 51.4, "cpu_pct_max_per_container": 54.5, "cpu_utilization_of_limit": 0.514, "mem_max_mib": 141.3}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 16.8, "cpu_pct_max_per_container": 33.4, "cpu_utilization_of_limit": 0.337, "mem_max_mib": 72.3}, "postgres_connections": {"active_max": 7, "active_mean": 3.6, "total_max": 28}}, "pool": {"acquires": 31625, "empty_acquire_ratio": 0.0, "avg_acquire_wait_ms": 0.002, "pool_max_conns_total": 40}}
{"series": "E_scale_out_after_fix", "config": "2x0.50", "concurrency": 16, "repeat": 2, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "2", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "1.00", "LB_CPUS": "0.50", "REDIS_CPUS": "0.50", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "version", "LB_BALANCE": "roundrobin"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8323969024"}, "bench": {"chats": 8, "concurrency": 16, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"0c3123b2f1ed": 4525, "2116fbbd7d1b": 4526}, "label": "E_scale_out_after_fix/2x0.50", "latency_ms": {"max": 170.769, "p50": 23.502, "p95": 54.313, "p99": 80.293}, "mode": "closed", "ok": 9051, "ok_read_rps": 300.46666666666664, "ok_rps": 603.4, "ok_write_rps": 302.93333333333334, "rate": 0, "read_ms": {"max": 170.769, "p50": 17.046, "p95": 41.654, "p99": 56.833}, "requests": 9051, "timestamp": "2026-10-23T14:55:04Z", "warmup_s": 3, "write_ms": {"max": 164.343, "p50": 31.049, "p95": 62.735, "p99": 87.396}, "write_ratio": 0.5}, "resources": {"api": {"containers": 2, "cpu_pct_mean_per_container": 39.0, "cpu_pct_max_per_container": 42.8, "cpu_utilization_of_limit": 0.779, "mem_max_mib": 186.5}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 9.5, "cpu_pct_max_per_container": 10.3, "cpu_utilization_of_limit": 0.191, "mem_max_mib": 10.6}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 49.6, "cpu_pct_max_per_container": 53.3, "cpu_utilization_of_limit": 0.496, "mem_max_mib": 144.9}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 21.2, "cpu_pct_max_per_container": 39.7, "cpu_utilization_of_limit": 0.424, "mem_max_mib": 73.1}, "postgres_connections": {"active_max": 12, "active_mean": 5.5, "total_max": 29}}, "pool": {"acquires": 30992, "empty_acquire_ratio": 0.0, "avg_acquire_wait_ms": 0.002, "pool_max_conns_total": 40}}
{"series": "E_scale_out_after_fix", "config": "2x0.50", "concurrency": 64, "repeat": 0, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "2", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "1.00", "LB_CPUS": "0.50", "REDIS_CPUS": "0.50", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "version", "LB_BALANCE": "roundrobin"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8323969024"}, "bench": {"chats": 8, "concurrency": 64, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"0c3123b2f1ed": 4476, "2116fbbd7d1b": 4494}, "label": "E_scale_out_after_fix/2x0.50", "latency_ms": {"max": 363.531, "p50": 100.856, "p95": 206.533, "p99": 260.686}, "mode": "closed", "ok": 8970, "ok_read_rps": 294.93333333333334, "ok_rps": 598, "ok_write_rps": 303.06666666666666, "rate": 0, "read_ms": {"max": 242.456, "p50": 69.85, "p95": 136.189, "p99": 173.196}, "requests": 8970, "timestamp": "2026-10-23T14:55:25Z", "warmup_s": 3, "write_ms": {"max": 363.531, "p50": 137.397, "p95": 230.226, "p99": 277.529}, "write_ratio": 0.5}, "resources": {"api": {"containers": 2, "cpu_pct_mean_per_container": 39.2, "cpu_pct_max_per_container": 40.7, "cpu_utilization_of_limit": 0.783, "mem_max_mib": 197.3}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 9.4, "cpu_pct_max_per_container": 9.6, "cpu_utilization_of_limit": 0.188, "mem_max_mib": 11.2}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 55.0, "cpu_pct_max_per_container": 56.1, "cpu_utilization_of_limit": 0.55, "mem_max_mib": 180.5}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 11.6, "cpu_pct_max_per_container": 12.1, "cpu_utilization_of_limit": 0.231, "mem_max_mib": 69.9}, "postgres_connections": {"active_max": 32, "active_mean": 27, "total_max": 40}}, "pool": {"acquires": 31413, "empty_acquire_ratio": 0.7589, "avg_acquire_wait_ms": 10.552, "pool_max_conns_total": 40}}
{"series": "E_scale_out_after_fix", "config": "2x0.50", "concurrency": 64, "repeat": 1, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "2", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "1.00", "LB_CPUS": "0.50", "REDIS_CPUS": "0.50", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "version", "LB_BALANCE": "roundrobin"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8323969024"}, "bench": {"chats": 8, "concurrency": 64, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"0c3123b2f1ed": 4571, "2116fbbd7d1b": 4519}, "label": "E_scale_out_after_fix/2x0.50", "latency_ms": {"max": 454.574, "p50": 98.17, "p95": 208.648, "p99": 267.046}, "mode": "closed", "ok": 9090, "ok_read_rps": 298.8666666666667, "ok_rps": 606, "ok_write_rps": 307.1333333333333, "rate": 0, "read_ms": {"max": 254.289, "p50": 67.557, "p95": 134.449, "p99": 166.981}, "requests": 9090, "timestamp": "2026-10-23T14:55:47Z", "warmup_s": 3, "write_ms": {"max": 454.574, "p50": 135.142, "p95": 232.728, "p99": 306.293}, "write_ratio": 0.5}, "resources": {"api": {"containers": 2, "cpu_pct_mean_per_container": 40.1, "cpu_pct_max_per_container": 40.6, "cpu_utilization_of_limit": 0.802, "mem_max_mib": 63.4}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 10.2, "cpu_pct_max_per_container": 10.4, "cpu_utilization_of_limit": 0.203, "mem_max_mib": 11.1}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 57.9, "cpu_pct_max_per_container": 60.9, "cpu_utilization_of_limit": 0.579, "mem_max_mib": 187.8}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 11.9, "cpu_pct_max_per_container": 12.3, "cpu_utilization_of_limit": 0.238, "mem_max_mib": 53.2}, "postgres_connections": {"active_max": 29, "active_mean": 28.3, "total_max": 41}}, "pool": {"acquires": 31745, "empty_acquire_ratio": 0.8254, "avg_acquire_wait_ms": 11.401, "pool_max_conns_total": 40}}
{"series": "E_scale_out_after_fix", "config": "2x0.50", "concurrency": 64, "repeat": 2, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "2", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "1.00", "LB_CPUS": "0.50", "REDIS_CPUS": "0.50", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "version", "LB_BALANCE": "roundrobin"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8323969024"}, "bench": {"chats": 8, "concurrency": 64, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"0c3123b2f1ed": 4535, "2116fbbd7d1b": 4524}, "label": "E_scale_out_after_fix/2x0.50", "latency_ms": {"max": 412.042, "p50": 99.557, "p95": 197.779, "p99": 237.825}, "mode": "closed", "ok": 9059, "ok_read_rps": 305.73333333333335, "ok_rps": 603.9333333333333, "ok_write_rps": 298.2, "rate": 0, "read_ms": {"max": 412.042, "p50": 70.512, "p95": 135.774, "p99": 166.066}, "requests": 9059, "timestamp": "2026-10-23T14:56:09Z", "warmup_s": 3, "write_ms": {"max": 346.969, "p50": 138.323, "p95": 216.076, "p99": 259.669}, "write_ratio": 0.5}, "resources": {"api": {"containers": 2, "cpu_pct_mean_per_container": 38.6, "cpu_pct_max_per_container": 40.6, "cpu_utilization_of_limit": 0.771, "mem_max_mib": 62.7}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 10.1, "cpu_pct_max_per_container": 10.6, "cpu_utilization_of_limit": 0.201, "mem_max_mib": 11.3}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 54.2, "cpu_pct_max_per_container": 56.6, "cpu_utilization_of_limit": 0.542, "mem_max_mib": 192.4}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 14.0, "cpu_pct_max_per_container": 18.7, "cpu_utilization_of_limit": 0.28, "mem_max_mib": 46.9}, "postgres_connections": {"active_max": 25, "active_mean": 8.3, "total_max": 40}}, "pool": {"acquires": 31531, "empty_acquire_ratio": 0.7986, "avg_acquire_wait_ms": 10.553, "pool_max_conns_total": 40}}
{"series": "E_scale_out_after_fix", "config": "4x0.50", "concurrency": 4, "repeat": 0, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "4", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "1.00", "LB_CPUS": "0.50", "REDIS_CPUS": "0.50", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "version", "LB_BALANCE": "roundrobin"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8323969024"}, "bench": {"chats": 8, "concurrency": 4, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"0c3123b2f1ed": 2249, "1d4d2744a3a6": 2248, "2116fbbd7d1b": 2249, "5f696d47f489": 2249}, "label": "E_scale_out_after_fix/4x0.50", "latency_ms": {"max": 73.667, "p50": 5.683, "p95": 13.024, "p99": 20.185}, "mode": "closed", "ok": 8995, "ok_read_rps": 299.26666666666665, "ok_rps": 599.6666666666666, "ok_write_rps": 300.4, "rate": 0, "read_ms": {"max": 42.135, "p50": 5.074, "p95": 11.266, "p99": 18.647}, "requests": 8995, "timestamp": "2026-10-23T14:56:39Z", "warmup_s": 3, "write_ms": {"max": 73.667, "p50": 6.35, "p95": 13.981, "p99": 21.253}, "write_ratio": 0.5}, "resources": {"api": {"containers": 4, "cpu_pct_mean_per_container": 21.3, "cpu_pct_max_per_container": 24.0, "cpu_utilization_of_limit": 0.425, "mem_max_mib": 138.1}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 9.9, "cpu_pct_max_per_container": 10.6, "cpu_utilization_of_limit": 0.199, "mem_max_mib": 10.7}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 43.3, "cpu_pct_max_per_container": 46.5, "cpu_utilization_of_limit": 0.433, "mem_max_mib": 205.1}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 14.1, "cpu_pct_max_per_container": 16.8, "cpu_utilization_of_limit": 0.281, "mem_max_mib": 52.4}, "postgres_connections": {"active_max": 3, "active_mean": 1.1, "total_max": 46}}, "pool": {"acquires": 30279, "empty_acquire_ratio": 0.0, "avg_acquire_wait_ms": 0.001, "pool_max_conns_total": 80}}
{"series": "E_scale_out_after_fix", "config": "4x0.50", "concurrency": 4, "repeat": 1, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "4", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "1.00", "LB_CPUS": "0.50", "REDIS_CPUS": "0.50", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "version", "LB_BALANCE": "roundrobin"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8323969024"}, "bench": {"chats": 8, "concurrency": 4, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"0c3123b2f1ed": 2190, "1d4d2744a3a6": 2190, "2116fbbd7d1b": 2192, "5f696d47f489": 2191}, "label": "E_scale_out_after_fix/4x0.50", "latency_ms": {"max": 68.471, "p50": 5.818, "p95": 13.157, "p99": 20.894}, "mode": "closed", "ok": 8763, "ok_read_rps": 293.73333333333335, "ok_rps": 584.2, "ok_write_rps": 290.46666666666664, "rate": 0, "read_ms": {"max": 68.471, "p50": 5.339, "p95": 11.864, "p99": 18.463}, "requests": 8763, "timestamp": "2026-10-23T14:57:00Z", "warmup_s": 3, "write_ms": {"max": 58.573, "p50": 6.356, "p95": 14.255, "p99": 22.489}, "write_ratio": 0.5}, "resources": {"api": {"containers": 4, "cpu_pct_mean_per_container": 21.3, "cpu_pct_max_per_container": 22.8, "cpu_utilization_of_limit": 0.426, "mem_max_mib": 246.6}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 10.0, "cpu_pct_max_per_container": 10.4, "cpu_utilization_of_limit": 0.2, "mem_max_mib": 10.7}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 44.2, "cpu_pct_max_per_container": 46.6, "cpu_utilization_of_limit": 0.442, "mem_max_mib": 211.0}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 14.7, "cpu_pct_max_per_container": 17.4, "cpu_utilization_of_limit": 0.295, "mem_max_mib": 70.7}, "postgres_connections": {"active_max": 2, "active_mean": 0.8, "total_max": 47}}, "pool": {"acquires": 29347, "empty_acquire_ratio": 0.0, "avg_acquire_wait_ms": 0.002, "pool_max_conns_total": 80}}
{"series": "E_scale_out_after_fix", "config": "4x0.50", "concurrency": 4, "repeat": 2, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "4", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "1.00", "LB_CPUS": "0.50", "REDIS_CPUS": "0.50", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "version", "LB_BALANCE": "roundrobin"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8323969024"}, "bench": {"chats": 8, "concurrency": 4, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"0c3123b2f1ed": 2247, "1d4d2744a3a6": 2248, "2116fbbd7d1b": 2247, "5f696d47f489": 2247}, "label": "E_scale_out_after_fix/4x0.50", "latency_ms": {"max": 46.413, "p50": 5.796, "p95": 12.542, "p99": 19.606}, "mode": "closed", "ok": 8989, "ok_read_rps": 298.93333333333334, "ok_rps": 599.2666666666667, "ok_write_rps": 300.3333333333333, "rate": 0, "read_ms": {"max": 45.953, "p50": 5.193, "p95": 10.978, "p99": 17.645}, "requests": 8989, "timestamp": "2026-10-23T14:57:22Z", "warmup_s": 3, "write_ms": {"max": 46.413, "p50": 6.447, "p95": 13.776, "p99": 20.631}, "write_ratio": 0.5}, "resources": {"api": {"containers": 4, "cpu_pct_mean_per_container": 21.5, "cpu_pct_max_per_container": 24.4, "cpu_utilization_of_limit": 0.431, "mem_max_mib": 238.1}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 9.9, "cpu_pct_max_per_container": 10.4, "cpu_utilization_of_limit": 0.198, "mem_max_mib": 10.7}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 44.2, "cpu_pct_max_per_container": 46.0, "cpu_utilization_of_limit": 0.442, "mem_max_mib": 214.8}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 14.6, "cpu_pct_max_per_container": 16.4, "cpu_utilization_of_limit": 0.293, "mem_max_mib": 74.2}, "postgres_connections": {"active_max": 3, "active_mean": 1.7, "total_max": 47}}, "pool": {"acquires": 30707, "empty_acquire_ratio": 0.0, "avg_acquire_wait_ms": 0.001, "pool_max_conns_total": 80}}
{"series": "E_scale_out_after_fix", "config": "4x0.50", "concurrency": 16, "repeat": 0, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "4", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "1.00", "LB_CPUS": "0.50", "REDIS_CPUS": "0.50", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "version", "LB_BALANCE": "roundrobin"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8323969024"}, "bench": {"chats": 8, "concurrency": 16, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"0c3123b2f1ed": 2270, "1d4d2744a3a6": 2270, "2116fbbd7d1b": 2270, "5f696d47f489": 2273}, "label": "E_scale_out_after_fix/4x0.50", "latency_ms": {"max": 359.016, "p50": 23.061, "p95": 54.586, "p99": 78.528}, "mode": "closed", "ok": 9083, "ok_read_rps": 305.1333333333333, "ok_rps": 605.5333333333333, "ok_write_rps": 300.4, "rate": 0, "read_ms": {"max": 359.016, "p50": 14.655, "p95": 35.289, "p99": 55.054}, "requests": 9083, "timestamp": "2026-10-23T14:57:43Z", "warmup_s": 3, "write_ms": {"max": 185.153, "p50": 34.185, "p95": 61.637, "p99": 88.602}, "write_ratio": 0.5}, "resources": {"api": {"containers": 4, "cpu_pct_mean_per_container": 20.8, "cpu_pct_max_per_container": 23.1, "cpu_utilization_of_limit": 0.417, "mem_max_mib": 236.3}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 9.5, "cpu_pct_max_per_container": 9.8, "cpu_utilization_of_limit": 0.189, "mem_max_mib": 10.8}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 48.3, "cpu_pct_max_per_container": 48.9, "cpu_utilization_of_limit": 0.483, "mem_max_mib": 239.9}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 14.8, "cpu_pct_max_per_container": 16.0, "cpu_utilization_of_limit": 0.295, "mem_max_mib": 73.4}, "postgres_connections": {"active_max": 9, "active_mean": 6.2, "total_max": 56}}, "pool": {"acquires": 30781, "empty_acquire_ratio": 0.0003, "avg_acquire_wait_ms": 0.025, "pool_max_conns_total": 80}}
{"series": "E_scale_out_after_fix", "config": "4x0.50", "concurrency": 16, "repeat": 1, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "4", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "1.00", "LB_CPUS": "0.50", "REDIS_CPUS": "0.50", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "version", "LB_BALANCE": "roundrobin"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8323969024"}, "bench": {"chats": 8, "concurrency": 16, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"0c3123b2f1ed": 2218, "1d4d2744a3a6": 2219, "2116fbbd7d1b": 2218, "5f696d47f489": 2215}, "label": "E_scale_out_after_fix/4x0.50", "latency_ms": {"max": 161.345, "p50": 23.532, "p95": 56.579, "p99": 76.23}, "mode": "closed", "ok": 8870, "ok_read_rps": 299.53333333333336, "ok_rps": 591.3333333333334, "ok_write_rps": 291.8, "rate": 0, "read_ms": {"max": 107.061, "p50": 14.785, "p95": 37.191, "p99": 55.572}, "requests": 8870, "timestamp": "2026-10-23T14:58:05Z", "warmup_s": 3, "write_ms": {"max": 161.345, "p50": 35.6, "p95": 62.679, "p99": 90.54}, "write_ratio": 0.5}, "resources": {"api": {"containers": 4, "cpu_pct_mean_per_container": 20.8, "cpu_pct_max_per_container": 23.9, "cpu_utilization_of_limit": 0.415, "mem_max_mib": 238.5}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 9.6, "cpu_pct_max_per_container": 10.2, "cpu_utilization_of_limit": 0.191, "mem_max_mib": 10.7}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 45.7, "cpu_pct_max_per_container": 49.4, "cpu_utilization_of_limit": 0.457, "mem_max_mib": 247.4}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 18.0, "cpu_pct_max_per_container": 27.1, "cpu_utilization_of_limit": 0.36, "mem_max_mib": 76.4}, "postgres_connections": {"active_max": 10, "active_mean": 8.2, "total_max": 56}}, "pool": {"acquires": 30361, "empty_acquire_ratio": 0.0, "avg_acquire_wait_ms": 0.002, "pool_max_conns_total": 80}}
{"series": "E_scale_out_after_fix", "config": "4x0.50", "concurrency": 16, "repeat": 2, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "4", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "1.00", "LB_CPUS": "0.50", "REDIS_CPUS": "0.50", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "version", "LB_BALANCE": "roundrobin"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8323969024"}, "bench": {"chats": 8, "concurrency": 16, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"0c3123b2f1ed": 2201, "1d4d2744a3a6": 2199, "2116fbbd7d1b": 2201, "5f696d47f489": 2200}, "label": "E_scale_out_after_fix/4x0.50", "latency_ms": {"max": 196.624, "p50": 24.02, "p95": 56.004, "p99": 76.312}, "mode": "closed", "ok": 8801, "ok_read_rps": 295.2, "ok_rps": 586.7333333333333, "ok_write_rps": 291.53333333333336, "rate": 0, "read_ms": {"max": 99.652, "p50": 14.995, "p95": 39.561, "p99": 55.215}, "requests": 8801, "timestamp": "2026-10-23T14:58:26Z", "warmup_s": 3, "write_ms": {"max": 196.624, "p50": 35.304, "p95": 63.553, "p99": 84.235}, "write_ratio": 0.5}, "resources": {"api": {"containers": 4, "cpu_pct_mean_per_container": 20.6, "cpu_pct_max_per_container": 23.5, "cpu_utilization_of_limit": 0.411, "mem_max_mib": 247.3}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 9.7, "cpu_pct_max_per_container": 10.1, "cpu_utilization_of_limit": 0.193, "mem_max_mib": 10.9}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 45.6, "cpu_pct_max_per_container": 51.2, "cpu_utilization_of_limit": 0.456, "mem_max_mib": 249.4}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 13.3, "cpu_pct_max_per_container": 14.1, "cpu_utilization_of_limit": 0.266, "mem_max_mib": 69.8}, "postgres_connections": {"active_max": 5, "active_mean": 3.2, "total_max": 57}}, "pool": {"acquires": 30199, "empty_acquire_ratio": 0.0, "avg_acquire_wait_ms": 0.0, "pool_max_conns_total": 80}}
{"series": "E_scale_out_after_fix", "config": "4x0.50", "concurrency": 64, "repeat": 0, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "4", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "1.00", "LB_CPUS": "0.50", "REDIS_CPUS": "0.50", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "version", "LB_BALANCE": "roundrobin"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8323969024"}, "bench": {"chats": 8, "concurrency": 64, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"0c3123b2f1ed": 2240, "1d4d2744a3a6": 2250, "2116fbbd7d1b": 2230, "5f696d47f489": 2246}, "label": "E_scale_out_after_fix/4x0.50", "latency_ms": {"max": 554.644, "p50": 87.938, "p95": 243.258, "p99": 351.806}, "mode": "closed", "ok": 8966, "ok_read_rps": 298.1333333333333, "ok_rps": 597.7333333333333, "ok_write_rps": 299.6, "rate": 0, "read_ms": {"max": 522.205, "p50": 46.765, "p95": 105.385, "p99": 151.341}, "requests": 8966, "timestamp": "2026-10-23T14:58:48Z", "warmup_s": 3, "write_ms": {"max": 554.644, "p50": 154.301, "p95": 288.231, "p99": 400.177}, "write_ratio": 0.5}, "resources": {"api": {"containers": 4, "cpu_pct_mean_per_container": 20.2, "cpu_pct_max_per_container": 22.0, "cpu_utilization_of_limit": 0.404, "mem_max_mib": 236.4}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 9.3, "cpu_pct_max_per_container": 10.6, "cpu_utilization_of_limit": 0.187, "mem_max_mib": 11.0}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 51.3, "cpu_pct_max_per_container": 52.7, "cpu_utilization_of_limit": 0.513, "mem_max_mib": 314.1}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 13.7, "cpu_pct_max_per_container": 14.0, "cpu_utilization_of_limit": 0.274, "mem_max_mib": 68.4}, "postgres_connections": {"active_max": 45, "active_mean": 26.7, "total_max": 81}}, "pool": {"acquires": 30318, "empty_acquire_ratio": 0.038, "avg_acquire_wait_ms": 0.766, "pool_max_conns_total": 80}}
{"series": "E_scale_out_after_fix", "config": "4x0.50", "concurrency": 64, "repeat": 1, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "4", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "1.00", "LB_CPUS": "0.50", "REDIS_CPUS": "0.50", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "version", "LB_BALANCE": "roundrobin"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8323969024"}, "bench": {"chats": 8, "concurrency": 64, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"0c3123b2f1ed": 2233, "1d4d2744a3a6": 2232, "2116fbbd7d1b": 2234, "5f696d47f489": 2233}, "label": "E_scale_out_after_fix/4x0.50", "latency_ms": {"max": 454.421, "p50": 86.151, "p95": 244.085, "p99": 321.814}, "mode": "closed", "ok": 8932, "ok_read_rps": 298, "ok_rps": 595.4666666666667, "ok_write_rps": 297.46666666666664, "rate": 0, "read_ms": {"max": 282.472, "p50": 45.3, "p95": 112.225, "p99": 164.543}, "requests": 8932, "timestamp": "2026-10-23T14:59:09Z", "warmup_s": 3, "write_ms": {"max": 454.421, "p50": 160.854, "p95": 281.895, "p99": 357.2}, "write_ratio": 0.5}, "resources": {"api": {"containers": 4, "cpu_pct_mean_per_container": 20.8, "cpu_pct_max_per_container": 21.6, "cpu_utilization_of_limit": 0.416, "mem_max_mib": 63.6}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 9.7, "cpu_pct_max_per_container": 9.9, "cpu_utilization_of_limit": 0.194, "mem_max_mib": 11.0}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 52.5, "cpu_pct_max_per_container": 53.5, "cpu_utilization_of_limit": 0.525, "mem_max_mib": 315.1}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 12.8, "cpu_pct_max_per_container": 13.3, "cpu_utilization_of_limit": 0.257, "mem_max_mib": 60.2}, "postgres_connections": {"active_max": 38, "active_mean": 25, "total_max": 80}}, "pool": {"acquires": 30490, "empty_acquire_ratio": 0.0216, "avg_acquire_wait_ms": 0.079, "pool_max_conns_total": 80}}
{"series": "E_scale_out_after_fix", "config": "4x0.50", "concurrency": 64, "repeat": 2, "load": {"duration": "15s", "warmup": "3s", "write_ratio": 0.5, "chats": 8}, "env": {"API_REPLICAS": "4", "API_CPUS": "0.50", "API_MEMORY": "256M", "PG_CPUS": "1.00", "LB_CPUS": "0.50", "REDIS_CPUS": "0.50", "DB_POOL_MAX": "20", "CACHE_INVALIDATION": "version", "LB_BALANCE": "roundrobin"}, "host": {"host_cpus": 2, "docker": "28.0.4", "docker_cpus": "2", "docker_mem_bytes": "8323969024"}, "bench": {"chats": 8, "concurrency": 64, "dropped": 0, "duration_s": 15, "error_ratio": 0, "errors": 0, "errors_by_class": {}, "instances": {"0c3123b2f1ed": 2206, "1d4d2744a3a6": 2209, "2116fbbd7d1b": 2206, "5f696d47f489": 2202}, "label": "E_scale_out_after_fix/4x0.50", "latency_ms": {"max": 546.27, "p50": 88.108, "p95": 248.993, "p99": 361.321}, "mode": "closed", "ok": 8823, "ok_read_rps": 291, "ok_rps": 588.2, "ok_write_rps": 297.2, "rate": 0, "read_ms": {"max": 211.362, "p50": 46.769, "p95": 109.003, "p99": 145.071}, "requests": 8823, "timestamp": "2026-10-23T14:59:31Z", "warmup_s": 3, "write_ms": {"max": 546.27, "p50": 159.803, "p95": 291.212, "p99": 410.307}, "write_ratio": 0.5}, "resources": {"api": {"containers": 4, "cpu_pct_mean_per_container": 21.1, "cpu_pct_max_per_container": 23.1, "cpu_utilization_of_limit": 0.422, "mem_max_mib": 68.5}, "lb": {"containers": 1, "cpu_pct_mean_per_container": 9.2, "cpu_pct_max_per_container": 9.5, "cpu_utilization_of_limit": 0.184, "mem_max_mib": 11.0}, "postgres": {"containers": 1, "cpu_pct_mean_per_container": 48.3, "cpu_pct_max_per_container": 50.4, "cpu_utilization_of_limit": 0.483, "mem_max_mib": 320.5}, "redis": {"containers": 1, "cpu_pct_mean_per_container": 14.5, "cpu_pct_max_per_container": 15.4, "cpu_utilization_of_limit": 0.291, "mem_max_mib": 53.0}, "postgres_connections": {"active_max": 54, "active_mean": 39.7, "total_max": 80}}, "pool": {"acquires": 30746, "empty_acquire_ratio": 0.0167, "avg_acquire_wait_ms": 0.054, "pool_max_conns_total": 80}}
File diff suppressed because one or more lines are too long
@@ -0,0 +1,7 @@
2
total used free shared buff/cache available
Mem: 7937 1617 1873 106 4865 6319
Swap: 3071 13 3058
CPU(s): 2
Model name: Intel(R) Xeon(R) 6973P-C
CPU(s) scaling MHz: 162%
@@ -0,0 +1,6 @@
2
total used free shared buff/cache available
Mem: 7938 1667 1714 150 5021 6270
Swap: 3071 4 3067
CPU(s): 2
Model name: AMD EPYC 7763 64-Core Processor
+44
View File
@@ -0,0 +1,44 @@
series,config,c,repeats,ok_rps,rps_min,rps_max,write_rps,read_rps,p50_ms,p95_ms,p99_ms,err,util_api,util_pg,util_redis,util_lb,host_cores,pool_empty,pool_wait_ms,pg_active
A_fixed_total,1x1.00,4,3,224.4,223.3,225.8,111.8,112.9,19.10,44.84,57.88,0.0000,0.70,0.19,1.03,0.09,1.44/2,0.000,0.00,1
A_fixed_total,1x1.00,16,3,258.1,255.0,264.0,128.2,129.9,40.23,142.01,190.66,0.0000,0.67,0.19,1.01,0.10,1.42/2,0.000,0.00,1
A_fixed_total,1x1.00,64,3,246.9,236.8,251.0,120.3,122.7,77.49,579.19,635.98,0.0000,0.69,0.19,1.00,0.10,1.43/2,0.003,0.02,0
A_fixed_total,2x0.50,4,3,198.2,190.8,205.5,97.1,101.1,17.03,48.94,63.16,0.0000,0.81,0.16,1.05,0.09,1.53/2,0.000,0.00,1
A_fixed_total,2x0.50,16,3,233.7,231.1,242.9,119.3,116.4,36.61,165.70,208.17,0.0000,0.79,0.20,0.99,0.09,1.55/2,0.000,0.01,0
A_fixed_total,2x0.50,64,3,251.5,242.0,254.7,122.5,128.0,89.25,677.59,857.04,0.0000,0.81,0.20,1.00,0.09,1.58/2,0.013,0.19,1
A_fixed_total,4x0.25,4,3,181.8,181.5,193.0,88.7,93.2,15.74,55.21,79.76,0.0000,0.84,0.17,0.94,0.07,1.53/2,0.000,0.01,1
A_fixed_total,4x0.25,16,3,215.2,214.5,221.0,106.3,108.9,41.80,182.87,326.25,0.0000,0.86,0.18,0.88,0.08,1.54/2,0.000,0.01,1
A_fixed_total,4x0.25,64,3,230.9,227.9,240.9,115.7,115.2,311.46,681.08,819.55,0.0000,0.42,0.05,0.19,0.02,0.57/2,0.000,0.09,0
B_scale_out,1x0.50,4,3,258.6,227.4,261.2,129.9,128.2,13.65,52.79,61.48,0.0000,0.99,0.14,0.78,0.07,1.06/2,0.000,0.00,1
B_scale_out,1x0.50,16,3,295.3,293.3,300.3,148.1,148.0,48.74,118.69,151.75,0.0000,1.00,0.14,0.79,0.08,1.08/2,0.000,0.00,5
B_scale_out,1x0.50,64,3,285.4,281.2,285.7,143.7,142.1,341.54,473.85,509.37,0.0000,1.00,0.13,0.78,0.07,1.06/2,0.011,0.03,0
B_scale_out,2x0.50,4,3,312.7,304.5,316.1,153.5,159.1,12.58,33.81,41.91,0.0000,0.77,0.15,1.01,0.08,1.48/2,0.000,0.00,1
B_scale_out,2x0.50,16,3,356.2,352.9,360.5,174.9,183.3,24.92,109.31,138.03,0.0000,0.74,0.18,1.00,0.09,1.47/2,0.000,0.00,1
B_scale_out,2x0.50,64,3,372.1,368.7,373.7,182.1,190.5,56.62,460.00,511.75,0.0000,0.77,0.19,1.00,0.09,1.50/2,0.009,0.12,0
B_scale_out,4x0.50,4,3,291.5,289.5,292.3,144.7,147.5,12.11,32.35,43.74,0.0000,0.44,0.17,1.00,0.08,1.60/2,0.000,0.00,1
B_scale_out,4x0.50,16,3,329.9,325.7,329.9,164.9,164.9,34.25,114.19,140.18,0.0000,0.44,0.18,0.99,0.09,1.61/2,0.000,0.01,1
B_scale_out,4x0.50,64,3,356.7,346.3,359.6,177.0,179.7,62.23,399.52,461.76,0.0000,0.43,0.20,0.97,0.10,1.59/2,0.000,0.00,4
D_improvement,baseline_scan,32,3,214.0,212.9,216.0,105.5,108.8,50.05,346.31,399.77,0.0000,0.38,0.19,1.00,0.09,1.49/2,0.000,0.02,1
D_improvement,baseline_scan,64,3,221.9,214.7,230.9,110.8,111.1,401.92,620.88,740.32,0.0000,0.39,0.18,0.99,0.10,1.50/2,0.000,0.12,1
D_improvement,cache_version,32,3,543.7,540.1,566.4,267.5,276.7,48.60,129.57,174.33,0.0000,0.38,0.58,0.24,0.20,1.55/2,0.001,0.11,24
D_improvement,cache_version,64,3,549.1,547.6,573.7,275.5,273.8,91.17,264.48,351.21,0.0000,0.39,0.57,0.23,0.19,1.56/2,0.024,0.11,43
D_improvement,pool_8,32,3,208.2,187.3,227.5,104.7,103.5,197.00,346.58,407.86,0.0000,0.37,0.18,1.00,0.09,1.48/2,0.001,0.01,1
D_improvement,pool_8,64,3,233.7,229.1,237.3,116.5,116.4,387.35,617.68,699.87,0.0000,0.40,0.20,0.98,0.10,1.53/2,0.016,0.17,2
D_improvement,leastconn,32,3,231.6,222.3,232.7,115.0,114.7,189.50,321.39,412.19,0.0000,0.39,0.19,0.99,0.09,1.53/2,0.000,0.00,1
D_improvement,leastconn,64,3,223.5,211.8,253.1,114.6,108.9,418.69,616.12,745.16,0.0000,0.38,0.20,0.99,0.09,1.51/2,0.000,0.02,2
C_shared_resources,pg1_lb0.5_redis0.5,16,3,455.1,446.8,470.5,228.5,226.6,32.17,80.56,106.30,0.0000,0.36,0.23,0.99,0.11,1.51/2,0.000,0.00,1
C_shared_resources,pg1_lb0.5_redis0.5,64,3,493.5,490.0,503.8,247.1,249.3,61.64,286.88,318.98,0.0000,0.35,0.24,1.00,0.12,1.51/2,0.000,0.07,1
C_shared_resources,pg2,16,3,462.7,453.3,471.7,236.4,225.8,29.69,78.70,97.97,0.0000,0.35,0.11,1.00,0.10,1.46/2,0.000,0.00,2
C_shared_resources,pg2,64,3,500.5,489.1,515.0,251.0,249.5,170.53,276.21,306.59,0.0000,0.35,0.12,0.99,0.11,1.49/2,0.001,0.04,1
C_shared_resources,lb1,16,3,452.9,450.9,467.4,225.9,228.3,22.14,83.95,103.89,0.0000,0.36,0.23,1.00,0.06,1.52/2,0.000,0.01,2
C_shared_resources,lb1,64,3,486.4,483.1,489.7,241.6,244.8,47.63,293.16,333.18,0.0000,0.35,0.24,0.99,0.06,1.50/2,0.002,0.00,1
C_shared_resources,redis1,16,3,492.1,487.1,505.8,249.3,242.9,28.82,76.35,99.39,0.0000,0.40,0.25,0.54,0.12,1.65/2,0.000,0.00,1
C_shared_resources,redis1,64,3,537.9,522.0,543.3,268.1,269.9,131.86,272.16,304.75,0.0000,0.39,0.27,0.55,0.12,1.66/2,0.000,0.00,2
E_scale_out_after_fix,1x0.50,4,3,475.3,465.2,482.1,240.3,234.9,5.72,31.90,39.57,0.0000,1.00,0.37,0.23,0.17,1.06/2,0.000,0.00,1
E_scale_out_after_fix,1x0.50,16,3,512.0,510.8,524.3,252.7,259.3,24.45,66.03,81.17,0.0000,1.00,0.36,0.22,0.17,1.06/2,0.000,0.00,1
E_scale_out_after_fix,1x0.50,64,3,560.0,555.3,563.4,280.1,279.7,109.09,175.97,204.49,0.0000,1.00,0.40,0.23,0.19,1.09/2,0.893,13.65,2
E_scale_out_after_fix,2x0.50,4,3,609.7,582.4,611.3,302.3,305.7,5.71,12.00,20.64,0.0000,0.79,0.45,0.33,0.21,1.50/2,0.000,0.00,3
E_scale_out_after_fix,2x0.50,16,3,617.7,603.4,625.4,310.1,303.3,23.05,52.36,73.64,0.0000,0.78,0.50,0.35,0.20,1.58/2,0.000,0.00,9
E_scale_out_after_fix,2x0.50,64,3,603.9,598.0,606.0,303.1,298.9,99.56,206.53,260.69,0.0000,0.78,0.55,0.24,0.20,1.55/2,0.799,10.55,29
E_scale_out_after_fix,4x0.50,4,3,599.3,584.2,599.7,300.3,298.9,5.80,13.02,20.18,0.0000,0.43,0.44,0.29,0.20,1.54/2,0.000,0.00,3
E_scale_out_after_fix,4x0.50,16,3,591.3,586.7,605.5,291.8,299.5,23.53,56.00,76.31,0.0000,0.41,0.46,0.29,0.19,1.56/2,0.000,0.00,9
E_scale_out_after_fix,4x0.50,64,3,595.5,588.2,597.7,297.5,298.0,87.94,244.09,351.81,0.0000,0.42,0.51,0.27,0.19,1.56/2,0.022,0.08,45
1 series config c repeats ok_rps rps_min rps_max write_rps read_rps p50_ms p95_ms p99_ms err util_api util_pg util_redis util_lb host_cores pool_empty pool_wait_ms pg_active
2 A_fixed_total 1x1.00 4 3 224.4 223.3 225.8 111.8 112.9 19.10 44.84 57.88 0.0000 0.70 0.19 1.03 0.09 1.44/2 0.000 0.00 1
3 A_fixed_total 1x1.00 16 3 258.1 255.0 264.0 128.2 129.9 40.23 142.01 190.66 0.0000 0.67 0.19 1.01 0.10 1.42/2 0.000 0.00 1
4 A_fixed_total 1x1.00 64 3 246.9 236.8 251.0 120.3 122.7 77.49 579.19 635.98 0.0000 0.69 0.19 1.00 0.10 1.43/2 0.003 0.02 0
5 A_fixed_total 2x0.50 4 3 198.2 190.8 205.5 97.1 101.1 17.03 48.94 63.16 0.0000 0.81 0.16 1.05 0.09 1.53/2 0.000 0.00 1
6 A_fixed_total 2x0.50 16 3 233.7 231.1 242.9 119.3 116.4 36.61 165.70 208.17 0.0000 0.79 0.20 0.99 0.09 1.55/2 0.000 0.01 0
7 A_fixed_total 2x0.50 64 3 251.5 242.0 254.7 122.5 128.0 89.25 677.59 857.04 0.0000 0.81 0.20 1.00 0.09 1.58/2 0.013 0.19 1
8 A_fixed_total 4x0.25 4 3 181.8 181.5 193.0 88.7 93.2 15.74 55.21 79.76 0.0000 0.84 0.17 0.94 0.07 1.53/2 0.000 0.01 1
9 A_fixed_total 4x0.25 16 3 215.2 214.5 221.0 106.3 108.9 41.80 182.87 326.25 0.0000 0.86 0.18 0.88 0.08 1.54/2 0.000 0.01 1
10 A_fixed_total 4x0.25 64 3 230.9 227.9 240.9 115.7 115.2 311.46 681.08 819.55 0.0000 0.42 0.05 0.19 0.02 0.57/2 0.000 0.09 0
11 B_scale_out 1x0.50 4 3 258.6 227.4 261.2 129.9 128.2 13.65 52.79 61.48 0.0000 0.99 0.14 0.78 0.07 1.06/2 0.000 0.00 1
12 B_scale_out 1x0.50 16 3 295.3 293.3 300.3 148.1 148.0 48.74 118.69 151.75 0.0000 1.00 0.14 0.79 0.08 1.08/2 0.000 0.00 5
13 B_scale_out 1x0.50 64 3 285.4 281.2 285.7 143.7 142.1 341.54 473.85 509.37 0.0000 1.00 0.13 0.78 0.07 1.06/2 0.011 0.03 0
14 B_scale_out 2x0.50 4 3 312.7 304.5 316.1 153.5 159.1 12.58 33.81 41.91 0.0000 0.77 0.15 1.01 0.08 1.48/2 0.000 0.00 1
15 B_scale_out 2x0.50 16 3 356.2 352.9 360.5 174.9 183.3 24.92 109.31 138.03 0.0000 0.74 0.18 1.00 0.09 1.47/2 0.000 0.00 1
16 B_scale_out 2x0.50 64 3 372.1 368.7 373.7 182.1 190.5 56.62 460.00 511.75 0.0000 0.77 0.19 1.00 0.09 1.50/2 0.009 0.12 0
17 B_scale_out 4x0.50 4 3 291.5 289.5 292.3 144.7 147.5 12.11 32.35 43.74 0.0000 0.44 0.17 1.00 0.08 1.60/2 0.000 0.00 1
18 B_scale_out 4x0.50 16 3 329.9 325.7 329.9 164.9 164.9 34.25 114.19 140.18 0.0000 0.44 0.18 0.99 0.09 1.61/2 0.000 0.01 1
19 B_scale_out 4x0.50 64 3 356.7 346.3 359.6 177.0 179.7 62.23 399.52 461.76 0.0000 0.43 0.20 0.97 0.10 1.59/2 0.000 0.00 4
20 D_improvement baseline_scan 32 3 214.0 212.9 216.0 105.5 108.8 50.05 346.31 399.77 0.0000 0.38 0.19 1.00 0.09 1.49/2 0.000 0.02 1
21 D_improvement baseline_scan 64 3 221.9 214.7 230.9 110.8 111.1 401.92 620.88 740.32 0.0000 0.39 0.18 0.99 0.10 1.50/2 0.000 0.12 1
22 D_improvement cache_version 32 3 543.7 540.1 566.4 267.5 276.7 48.60 129.57 174.33 0.0000 0.38 0.58 0.24 0.20 1.55/2 0.001 0.11 24
23 D_improvement cache_version 64 3 549.1 547.6 573.7 275.5 273.8 91.17 264.48 351.21 0.0000 0.39 0.57 0.23 0.19 1.56/2 0.024 0.11 43
24 D_improvement pool_8 32 3 208.2 187.3 227.5 104.7 103.5 197.00 346.58 407.86 0.0000 0.37 0.18 1.00 0.09 1.48/2 0.001 0.01 1
25 D_improvement pool_8 64 3 233.7 229.1 237.3 116.5 116.4 387.35 617.68 699.87 0.0000 0.40 0.20 0.98 0.10 1.53/2 0.016 0.17 2
26 D_improvement leastconn 32 3 231.6 222.3 232.7 115.0 114.7 189.50 321.39 412.19 0.0000 0.39 0.19 0.99 0.09 1.53/2 0.000 0.00 1
27 D_improvement leastconn 64 3 223.5 211.8 253.1 114.6 108.9 418.69 616.12 745.16 0.0000 0.38 0.20 0.99 0.09 1.51/2 0.000 0.02 2
28 C_shared_resources pg1_lb0.5_redis0.5 16 3 455.1 446.8 470.5 228.5 226.6 32.17 80.56 106.30 0.0000 0.36 0.23 0.99 0.11 1.51/2 0.000 0.00 1
29 C_shared_resources pg1_lb0.5_redis0.5 64 3 493.5 490.0 503.8 247.1 249.3 61.64 286.88 318.98 0.0000 0.35 0.24 1.00 0.12 1.51/2 0.000 0.07 1
30 C_shared_resources pg2 16 3 462.7 453.3 471.7 236.4 225.8 29.69 78.70 97.97 0.0000 0.35 0.11 1.00 0.10 1.46/2 0.000 0.00 2
31 C_shared_resources pg2 64 3 500.5 489.1 515.0 251.0 249.5 170.53 276.21 306.59 0.0000 0.35 0.12 0.99 0.11 1.49/2 0.001 0.04 1
32 C_shared_resources lb1 16 3 452.9 450.9 467.4 225.9 228.3 22.14 83.95 103.89 0.0000 0.36 0.23 1.00 0.06 1.52/2 0.000 0.01 2
33 C_shared_resources lb1 64 3 486.4 483.1 489.7 241.6 244.8 47.63 293.16 333.18 0.0000 0.35 0.24 0.99 0.06 1.50/2 0.002 0.00 1
34 C_shared_resources redis1 16 3 492.1 487.1 505.8 249.3 242.9 28.82 76.35 99.39 0.0000 0.40 0.25 0.54 0.12 1.65/2 0.000 0.00 1
35 C_shared_resources redis1 64 3 537.9 522.0 543.3 268.1 269.9 131.86 272.16 304.75 0.0000 0.39 0.27 0.55 0.12 1.66/2 0.000 0.00 2
36 E_scale_out_after_fix 1x0.50 4 3 475.3 465.2 482.1 240.3 234.9 5.72 31.90 39.57 0.0000 1.00 0.37 0.23 0.17 1.06/2 0.000 0.00 1
37 E_scale_out_after_fix 1x0.50 16 3 512.0 510.8 524.3 252.7 259.3 24.45 66.03 81.17 0.0000 1.00 0.36 0.22 0.17 1.06/2 0.000 0.00 1
38 E_scale_out_after_fix 1x0.50 64 3 560.0 555.3 563.4 280.1 279.7 109.09 175.97 204.49 0.0000 1.00 0.40 0.23 0.19 1.09/2 0.893 13.65 2
39 E_scale_out_after_fix 2x0.50 4 3 609.7 582.4 611.3 302.3 305.7 5.71 12.00 20.64 0.0000 0.79 0.45 0.33 0.21 1.50/2 0.000 0.00 3
40 E_scale_out_after_fix 2x0.50 16 3 617.7 603.4 625.4 310.1 303.3 23.05 52.36 73.64 0.0000 0.78 0.50 0.35 0.20 1.58/2 0.000 0.00 9
41 E_scale_out_after_fix 2x0.50 64 3 603.9 598.0 606.0 303.1 298.9 99.56 206.53 260.69 0.0000 0.78 0.55 0.24 0.20 1.55/2 0.799 10.55 29
42 E_scale_out_after_fix 4x0.50 4 3 599.3 584.2 599.7 300.3 298.9 5.80 13.02 20.18 0.0000 0.43 0.44 0.29 0.20 1.54/2 0.000 0.00 3
43 E_scale_out_after_fix 4x0.50 16 3 591.3 586.7 605.5 291.8 299.5 23.53 56.00 76.31 0.0000 0.41 0.46 0.29 0.19 1.56/2 0.000 0.00 9
44 E_scale_out_after_fix 4x0.50 64 3 595.5 588.2 597.7 297.5 298.0 87.94 244.09 351.81 0.0000 0.42 0.51 0.27 0.19 1.56/2 0.022 0.08 45
+64
View File
@@ -0,0 +1,64 @@
# Трек 1 — сводка (сгенерировано scripts/track1_report.py)
Медианы по повторам; util_* — доля CPU-лимита контейнера роли; pool_empty — доля acquire без свободного соединения.
## A_fixed_total — Фиксированный суммарный бюджет API: 1.0 CPU / 768M
**Гипотеза:** При фиксированном суммарном CPU рост числа реплик не увеличивает пиковый RPS (тот же бюджет) и немного ухудшает p95 из-за накладных расходов на процесс и пул соединений; выигрыш реплик — только отказоустойчивость.
| config | пик RPS | c пика | c насыщения | узкое место (util) | CPU хоста | pool empty / wait ms |
|---|---|---|---|---|---|---|
| 1x1.00 | 258.1 | 16 | 64 | redis (1.00) — насыщена | 71% | 0.003 / 0.02 |
| 2x0.50 | 251.5 | 64 | 64 | redis (1.00) — насыщена | 79% | 0.013 / 0.19 |
| 4x0.25 | 230.9 | 64 | 64 | api (0.42) | 29% | 0.000 / 0.09 |
## B_scale_out — Рост ресурсов: реплики по 0.5 CPU, БД 1.0 CPU, LB 0.5 CPU
**Гипотеза:** Пиковый RPS растёт почти линейно, пока узкое место — CPU API; затем рост останавливается на общей зависимости (PostgreSQL, Redis или LB), чья утилизация CPU приближается к лимиту.
| config | пик RPS | c пика | c насыщения | узкое место (util) | CPU хоста | pool empty / wait ms |
|---|---|---|---|---|---|---|
| 1x0.50 | 295.3 | 16 | 64 | api (1.00) — насыщена | 53% | 0.011 / 0.03 |
| 2x0.50 | 372.1 | 64 | 64 | redis (1.00) — насыщена | 75% | 0.009 / 0.12 |
| 4x0.50 | 356.7 | 64 | 64 | redis (0.97) — насыщена | 80% | 0.000 / 0.00 |
## D_improvement — Кандидаты улучшения на 4×0.5 CPU
**Гипотеза:** Инвалидация кэша истории через SCAN (lab2) делает O(keyspace/100) запросов к Redis на каждую запись; ключ с версией чата (CACHE_INVALIDATION=version) делает 1 INCR и поднимает RPS записи при большом keyspace. Альтернативы: меньший пул на реплику, leastconn.
| config | пик RPS | c пика | c насыщения | узкое место (util) | CPU хоста | pool empty / wait ms |
|---|---|---|---|---|---|---|
| baseline_scan | 221.9 | 64 | 64 | redis (0.99) — насыщена | 75% | 0.000 / 0.12 |
| cache_version | 549.1 | 64 | 64 | postgres (0.57) | 78% | 0.024 / 0.11 |
| pool_8 | 233.7 | 64 | 64 | redis (0.98) — насыщена | 76% | 0.016 / 0.17 |
| leastconn | 231.6 | 32 | 64 | redis (0.99) — насыщена | 75% | 0.000 / 0.02 |
Сравнение с `baseline_scan` (уровни ≥ насыщения baseline):
| кандидат | c | ΔRPS % | Δp95 % | повторы b/c | подтверждено |
|---|---|---|---|---|---|
| cache_version | 64 | 147.5 | -57.4 | 3/3 | да |
| pool_8 | 64 | 5.3 | -0.5 | 3/3 | нет |
| leastconn | 64 | 0.7 | -0.8 | 3/3 | нет |
## C_shared_resources — 4×0.5 CPU API, меняем ресурсы общих зависимостей
**Гипотеза:** Если насыщение B вызвано общей зависимостью, увеличение её CPU поднимает пиковый RPS, а увеличение CPU других зависимостей — нет.
| config | пик RPS | c пика | c насыщения | узкое место (util) | CPU хоста | pool empty / wait ms |
|---|---|---|---|---|---|---|
| pg1_lb0.5_redis0.5 | 493.5 | 64 | 64 | redis (1.00) — насыщена | 76% | 0.000 / 0.07 |
| pg2 | 500.5 | 64 | 64 | redis (0.99) — насыщена | 75% | 0.001 / 0.04 |
| lb1 | 486.4 | 64 | 64 | redis (0.99) — насыщена | 75% | 0.002 / 0.00 |
| redis1 | 537.9 | 64 | 64 | redis (0.55) | 83% | 0.000 / 0.00 |
## E_scale_out_after_fix — Рост реплик после улучшения (CACHE_INVALIDATION=version), реплики по 0.5 CPU
**Гипотеза:** После снятия упора в Redis рост реплик снова увеличивает RPS, пока не насытится следующая общая зависимость (ожидаем PostgreSQL) или CPU хоста.
| config | пик RPS | c пика | c насыщения | узкое место (util) | CPU хоста | pool empty / wait ms |
|---|---|---|---|---|---|---|
| 1x0.50 | 560.0 | 64 | 16 | api (1.00) — насыщена | 53% | 0.000 / 0.00 |
| 2x0.50 | 617.7 | 16 | 16 | api (0.78) | 79% | 0.000 / 0.00 |
| 4x0.50 | 599.3 | 4 | 16 | postgres (0.46) | 78% | 0.000 / 0.00 |
+39 -7
View File
@@ -8,6 +8,9 @@
* узкое место — роль (api/postgres/redis/lb) с наибольшей утилизацией CPU
от своего лимита на уровне насыщения; ≥0.85 — «насыщена»; дополнительно
признак пула: доля acquire без свободного соединения и среднее ожидание;
* если ни одна роль не насыщена, а сумма занятых ядер (util × лимит × число
контейнеров по всем ролям) ≥ 0.85 × CPU хоста — узкое место «CPU хоста»
(критерий добавлен после прогона 2: сумма лимитов превысила 2 vCPU runner);
* улучшение «подтверждено», если на уровне хотя бы одного параллелизма ≥ уровня
насыщения baseline min(ok_rps кандидата) > max(ok_rps baseline) по всем повторам,
медиана p95 не хуже и доля ошибок не выше.
@@ -34,6 +37,28 @@ def load(path):
return rows
LIMIT_ENV = {'api': 'API_CPUS', 'postgres': 'PG_CPUS', 'redis': 'REDIS_CPUS', 'lb': 'LB_CPUS'}
DEFAULT_LIMIT = {'postgres': 1.0, 'redis': 0.5, 'lb': 0.5}
def cores_used(r):
total = 0.0
for role in ROLES:
x = r['resources'].get(role)
if not x or x.get('cpu_utilization_of_limit') is None:
continue
lim = float(r['env'].get(LIMIT_ENV[role]) or DEFAULT_LIMIT.get(role, 0.5))
total += x['cpu_utilization_of_limit'] * lim * x.get('containers', 1)
return total
def host_cpus(r):
try:
return int(r.get('host', {}).get('docker_cpus') or r.get('host', {}).get('host_cpus'))
except (TypeError, ValueError):
return None
def med(xs):
xs = [x for x in xs if x is not None]
return statistics.median(xs) if xs else None
@@ -61,6 +86,8 @@ def aggregate(rows):
'error_ratio': med(x['error_ratio'] for x in b),
'empty_acquire_ratio': med(r['pool'].get('empty_acquire_ratio') for r in rs),
'acquire_wait_ms': med(r['pool'].get('avg_acquire_wait_ms') for r in rs),
'host_cores': med(cores_used(r) for r in rs),
'host_cpus': host_cpus(rs[0]),
'pg_active_max': med(r['resources'].get('postgres_connections', {}).get('active_max') for r in rs),
}
for role in ROLES:
@@ -98,7 +125,10 @@ def saturation(agg, series, config):
a = agg[(series, config, knee)]
utils = {r: a['util_' + r] for r in ROLES if a['util_' + r] is not None}
bottleneck = max(utils, key=utils.get) if utils else None
return {'peak_level': peak_l, 'peak_rps': agg[(series, config, peak_l)]['ok_rps'], 'knee_level': knee,
host_share = a['host_cores'] / a['host_cpus'] if a['host_cpus'] and a['host_cores'] is not None else None
if bottleneck and utils[bottleneck] < SAT_UTIL and host_share is not None and host_share >= SAT_UTIL:
bottleneck, utils = 'host_cpu', dict(utils, host_cpu=host_share)
return {'host_share': host_share,'peak_level': peak_l, 'peak_rps': agg[(series, config, peak_l)]['ok_rps'], 'knee_level': knee,
'bottleneck': bottleneck, 'bottleneck_util': utils.get(bottleneck),
'saturated': bool(bottleneck and utils[bottleneck] >= SAT_UTIL), 'utils': utils,
'pool_empty_ratio': a['empty_acquire_ratio'], 'pool_wait_ms': a['acquire_wait_ms']}
@@ -235,7 +265,7 @@ def main():
outdir.mkdir(parents=True, exist_ok=True)
headers = ['series', 'config', 'c', 'repeats', 'ok_rps', 'rps_min', 'rps_max', 'write_rps', 'read_rps', 'p50_ms',
'p95_ms', 'p99_ms', 'err', 'util_api', 'util_pg', 'util_redis', 'util_lb', 'pool_empty', 'pool_wait_ms', 'pg_active']
'p95_ms', 'p99_ms', 'err', 'util_api', 'util_pg', 'util_redis', 'util_lb', 'host_cores', 'pool_empty', 'pool_wait_ms', 'pg_active']
csv_rows = []
for s, c in order:
for l in levels_of(agg, s, c):
@@ -243,7 +273,8 @@ def main():
csv_rows.append([s, c, l, a['repeats'], fmt(a['ok_rps']), fmt(a['ok_rps_min']), fmt(a['ok_rps_max']),
fmt(a['write_rps']), fmt(a['read_rps']), fmt(a['p50'], 2), fmt(a['p95'], 2), fmt(a['p99'], 2),
fmt(a['error_ratio'], 4), fmt(a['util_api'], 2), fmt(a['util_postgres'], 2),
fmt(a['util_redis'], 2), fmt(a['util_lb'], 2), fmt(a['empty_acquire_ratio'], 3),
fmt(a['util_redis'], 2), fmt(a['util_lb'], 2),
'%s/%s' % (fmt(a['host_cores'], 2), a['host_cpus']), fmt(a['empty_acquire_ratio'], 3),
fmt(a['acquire_wait_ms'], 2), fmt(a['pg_active_max'], 0)])
with (outdir / 'summary.csv').open('w', newline='', encoding='utf-8') as f:
csv.writer(f).writerows([headers] + csv_rows)
@@ -264,17 +295,18 @@ def main():
line_chart('p95 задержки, мс', xl, [(c, get(c, 'p95')) for c in cfgs[:4]], 'мс')))
sat_rows = []
md += ['## %s — %s' % (name, meta['title']), '', '**Гипотеза:** ' + meta['hypothesis'], '',
'| config | пик RPS | c пика | c насыщения | узкое место (util) | pool empty / wait ms |', '|---|---|---|---|---|---|']
'| config | пик RPS | c пика | c насыщения | узкое место (util) | CPU хоста | pool empty / wait ms |', '|---|---|---|---|---|---|---|']
base_peak = None
for c in cfgs:
st = saturation(agg, name, c)
base_peak = base_peak or st['peak_rps']
bn = '%s (%s)%s' % (st['bottleneck'], fmt(st['bottleneck_util'], 2), ' — насыщена' if st['saturated'] else '')
pool = '%s / %s' % (fmt(st['pool_empty_ratio'], 3), fmt(st['pool_wait_ms'], 2))
md.append('| %s | %s | %s | %s | %s | %s |' % (c, fmt(st['peak_rps']), st['peak_level'], st['knee_level'], bn, pool))
hs = fmt(100 * st['host_share'], 0) + '%' if st['host_share'] is not None else '—'
md.append('| %s | %s | %s | %s | %s | %s | %s |' % (c, fmt(st['peak_rps']), st['peak_level'], st['knee_level'], bn, hs, pool))
sat_rows.append([c, fmt(st['peak_rps']), '%.2f×' % (st['peak_rps'] / base_peak) if base_peak else '—',
st['peak_level'], st['knee_level'], bn, pool])
body.append(table(['config', 'пик RPS', 'к первой', 'c пика', 'c насыщения', 'узкое место', 'pool empty / wait ms'], sat_rows))
st['peak_level'], st['knee_level'], bn, hs, pool])
body.append(table(['config', 'пик RPS', 'к первой', 'c пика', 'c насыщения', 'узкое место', 'CPU хоста', 'pool empty / wait ms'], sat_rows))
if name.startswith('D') and cfgs:
baseline = cfgs[0]
from_level = saturation(agg, name, baseline)['knee_level']