test: confirm read optimization and document scaling results

This commit is contained in:
2026-10-16 09:41:43 +03:00
parent e2be4787c7
commit ca8f5646b9
58 changed files with 5337 additions and 13 deletions
+5 -4
View File
@@ -16,10 +16,11 @@ API за HAProxy, PostgreSQL — источник истины (данные, с
**H4 опровергнута:** R* основного случая 788 → 788/с; сравнение и графики
в `evidence/compare/` и `evidence/plots/scaling-ab/`. Переполнение пула
возвращено с 0 на 5. Контроли H5 сняты; шум 24.9 % превысил её допуск.
H6 также опровергнута, пул возвращён к 10 + 5. Применён кандидат H7:
одиночные SELECT в AUTOCOMMIT, запись в явной READ COMMITTED транзакции
через общий пул. Далее проверки, самопроверка и `scaling-h7-after`.
Для «5» ещё нужно подтверждённое улучшение и проверка чистой копии.
H6 также опровергнута, пул возвращён к 10 + 5. **H7 подтверждена:**
R* 788 → 1301/с (+65.1 %), все три after выше обоих контролей,
контрольная медиана 1819/с сохранена. Код `e2be478`: одиночные SELECT
в AUTOCOMMIT, запись в READ COMMITTED через общий пул. Проверки 84 + 15
прошли; сравнения и графики — `scaling-h7`. Осталась проверка чистой копии.
Гипотезы каждого кандидата записаны в `REPORT.md` до его замеров.
Указание пользователя от 15 октября 2026: выполнять замеры и при
+11
View File
@@ -20,6 +20,17 @@
только незавершённой ячейки с сохранением её исходных данных и снятием
`aborted` после успешного продолжения. Данные текущих меток не менять.
## Подпись насыщения для A/B с одной конфигурацией
В `bench/plots.py:saturation` единственная точка возвращает `None`,
а `main` трактует это как продолжающийся рост ≥ 10 %. Это видно в
`evidence/plots/scaling-h6/summary.md`: для каждой метки и лимита БД
есть только 4 реплики, поэтому проверить рост от числа реплик нельзя.
Сами R*, диапазоны и график сравнения верны. Предложение: отдельно
печатать «недостаточно конфигураций» при числе точек меньше двух.
В отчёте точка насыщения берётся из полных серий a/b/db; исходные
автоматические сводки A/B не редактируются.
Закрыто 15 октября 2026 с явного разрешения пользователя: в семи
журналах Docker events меток failover/baseline и rollout/baseline
абсолютный путь проекта в служебных Compose labels заменён на
+71 -7
View File
@@ -9,8 +9,11 @@
Состояние отчёта: уровень 3 и все проверки уровня 4, включая отказ
каждой реплики и поочерёдную замену под нагрузкой, сняты
(разделы 3–4, файлы `evidence/`). Основные серии трека 1 и эксперимент
H4 завершены по [bench/RUNBOOK.md](bench/RUNBOOK.md). H4 опровергнута;
требование одного подтверждённого улучшения пока не выполнено.
H4 завершены по [bench/RUNBOOK.md](bench/RUNBOOK.md). H4 и H6 опровергнуты,
условие шума H5 не выполнено. H7 подтвердилась: основной R* вырос
с 788 до 1301/с (+65.1 %), контрольная медиана осталась 1819/с.
Требование одного подтверждённого улучшения закрыто; итоговый код —
`e2be478`, `src_sha256` `5880b0252c5fd7bb`.
Прогноз каждого кандидата записан **до его измерения**. H1–H4 были
исходным планом; H5–H7 — последовательное исследование с сохранением
отрицательных результатов и правил каждого этапа.
@@ -228,7 +231,7 @@ created_at, id)`. `created_at` назначает приложение: стро
| Собственные тесты уровня 4 | 84 passed; проверки отказов 15 passed | [test-isolated](evidence/tests/test-isolated.txt), [failure-checks](evidence/tests/failure-checks.txt) |
| Трек 1: фиксированный бюджет 1/2/4 реплики | Медианы R*: 745 / 1231 / 1819 запросов/с; по 3 повтора, бюджет API 4 CPU / 2 ГиБ | [серия a](evidence/scaling/scaling-a/summary.md) |
| Трек 1: рост ресурсов, точка насыщения | При PG 2 CPU: R* 745 → 1819/с для 1 → 4 API; при PG 0.5 CPU максимум после 2 реплик, далее 1164 → 788/с | [серия b](evidence/scaling/scaling-b/summary.md), [db](evidence/scaling/scaling-db/summary.md), [графики](evidence/plots/scaling/summary.md) |
| Трек 1: одно подтверждённое улучшение | Пока не выполнено: H4 опровергнута, изменение возвращено | [сравнение H4 с A/A](evidence/compare/scaling-ab-before__scaling-ab-after.md) |
| Трек 1: одно подтверждённое улучшение | H7: R* 788 → 1301/с (+65.1 %), все повторы выше шести исходных; контроль 1819 → 1819/с | [before → H7 с A/A](evidence/compare/scaling-h5-before__scaling-h7-after.md), [A/A → H7](evidence/compare/scaling-h5-aa__scaling-h7-after.md), [аудит критериев](evidence/tests/h7-criteria.txt) |
| Запуск из копии без локальных файлов | TODO (Codex, шаг 6 RUNBOOK) | [fresh-copy](evidence/stand/fresh-copy.txt) |
## 4. Эксперименты и отказы
@@ -338,7 +341,7 @@ NULL`; ревизия существует только в образе стен
| during | 10.12 | 2022 | 199.9 | 0 | — | 7.1 | 48.1 | 1167 | 855 |
| after | 94.91 | 18982 | 200.0 | 0 | — | 7 | 38.4 | 0 | 18982 |
## Контейнеры (секунды от начала скрипта)
#### Контейнеры (секунды от начала скрипта)
- +0.63 с create migrate 4529a10cb5fa
- +0.70 с start migrate 4529a10cb5fa
@@ -356,7 +359,7 @@ NULL`; ревизия существует только в образе стен
- +9.25 с die old 8fe1b57c6f9d
- +9.30 с destroy old 8fe1b57c6f9d
## CPU и память по окнам
#### CPU и память по окнам
| Окно | API, ядер (макс. реплика) | PostgreSQL | HAProxy | ВМ занята | API, мкс/запрос |
|---|---|---|---|---|---|
@@ -623,7 +626,13 @@ smoke, failover и persistence — успешны. Хеш приложения
Ошибочное применение к составной записи нарушило бы атомарность,
поэтому проверки отката чата и ключа обязательны до замера.
Это последовательный эксперимент после исследования пула.
- Итог: реализация и измерения H7 ещё не начинались.
- Итог: **подтверждена**. Все три основных повтора дали 1301/с:
отношение к before — больше 1,5; 1301 выше максимума шести исходных
повторов (1164). Оба сравнения дают «эффект». Контрольная медиана
осталась 1819/с, все 12 фиксированных ступеней после держат SLO.
CPU PostgreSQL на фиксированных 500/с снизился с 290 до 188
мкс/запрос. Проверки приложения и отказов прошли, все шесть ячеек
after завершены без предупреждений и пометок. Код H7 остаётся.
После реализации H7 и до основного замера: [проверки кандидата](evidence/tests/h7-candidate.txt)
успешны — 84 теста приложения, 15 проверок отказов, smoke, failover,
@@ -631,6 +640,54 @@ persistence и короткая самопроверка scaling. Хеш `5880b0
диагностика engine подтвердила один общий пул, AUTOCOMMIT для чтения и
READ COMMITTED для записи.
**Итоговое сравнение H7.** Код before и A/A — `0349e9a270178467`,
коммит `467cb57`; after — `5880b0252c5fd7bb`, коммит `e2be478`.
Параметры пула в обоих случаях 10 + 5, таймауты и профиль одинаковы.
| Конфигурация | Before, R* медиана (min–max), /с | A/A | H7 after | Δ к before | Вывод с A/A |
|---|---|---|---|---|---|
| 4x1-pg0.5 | 788 (788–833) | 984 (833–1164) | 1301 (1301–1301) | 65.1 % | эффект |
| 4x1 | 1819 (1819–1819) | 1819 (1819–1819) | 1819 (1819–1923) | 0 % | шум (разбросы пересекаются) |
[Полное сравнение с before](evidence/compare/scaling-h5-before__scaling-h7-after.md)
учитывает шум A/A 24.9 %. В
[сравнении с A/A](evidence/compare/scaling-h5-aa__scaling-h7-after.md)
основной сдвиг +32.2 %, обратный шум 19.9 %, вывод также «эффект».
[Аудит условий H7](evidence/tests/h7-criteria.txt) — все условия `true`.
![R* исходных контролей и H7](evidence/plots/scaling-h7/rstar-by-config.svg)
На R* CPU PostgreSQL на запрос снизился с 321.1 до 232.9 мкс;
это разные интенсивности, поэтому для механизма отдельно сравнивается
фиксированная ступень 500/с: 290 → 188 мкс/запрос в основном сценарии.
Это согласуется с сокращением служебных транзакций одиночных чтений.
Переоткрытие соединений не исчезло: на первой нарушившей ступени after
`db_cpu` есть в 3/3, `pool` в 3/3, `churn` в 2/3. Общая база остаётся
ограничением; новая точка насыщения по числу реплик после H7 не снималась.
**Повторение эксперимента.** Нужны те же ресурсы и условия RUNBOOK.
Для before/A/A используется исходный коммит `467cb57`, для after —
`e2be478`, в отдельной рабочей копии. Ниже приведены новые метки;
повторно существующие каталоги меток не перезаписываются.
```sh
# Код 467cb57, пул 10 + 5, исходные транзакции чтения:
make bench-scaling SERIES=ab SCALING_LABEL=repeat-read-before
make bench-scaling SERIES=ab SCALING_LABEL=repeat-read-aa
# Код e2be478, H7, пул 10 + 5:
make bench-scaling SERIES=ab SCALING_LABEL=repeat-read-after
make bench-compare BEFORE=repeat-read-before AFTER=repeat-read-after AA=repeat-read-aa
make bench-compare BEFORE=repeat-read-aa AFTER=repeat-read-after AA=repeat-read-before
make bench-plots LABELS="repeat-read-before repeat-read-aa repeat-read-after" PLOTS=repeat-read
```
Контроли H5 закончились в 22:07 UTC 15 октября, H6 — в 22:33,
H7 снималась 22:41–22:59 в той же сессии устройства. Между метками
выполнялись обязательные проверки кандидатов. Перезапуск сервиса Codex
не прервал нагрузочный процесс; сон хоста и swapouts в паспорте H7 — 0.
Оболочка контролей завершилась ошибкой уже после двух готовых меток;
сравнение выполнено отдельно, прогоны не повторялись.
Режимы и общий пул описаны в
[SQLAlchemy: несколько уровней изоляции одного engine](https://docs.sqlalchemy.org/en/21/core/connections.html#maintaining-multiple-isolation-levels-for-a-single-engine)
и [AUTOCOMMIT](https://docs.sqlalchemy.org/en/21/core/connections.html#fully-preventing-rollback-calls-under-autocommit).
@@ -777,6 +834,11 @@ R* здесь описывает результат заданного поис
- Возобновление прерванной серии требует доработки: статически найденные
дефекты `RESUME=1` описаны в [KNOWN_ISSUES.md](KNOWN_ISSUES.md).
Завершённые серии для отчёта этот режим не использовали.
- У A/B есть только четыре реплики при каждом лимите БД; точку насыщения
по этим меткам определить нельзя. Автоматическая подпись о продолжающемся
росте в сводке A/B — неточность `plots.py`, записанная в
[KNOWN_ISSUES.md](KNOWN_ISSUES.md). Здесь точка насыщения определяется
по полным исходным сериям, а A/B используется для сравнения кода.
## 6. Ответы на вопросы защиты
@@ -838,6 +900,8 @@ round-robin отправит следующий запрос на другую
`X-Instance-Id`, идемпотентности, раннего обработчика SIGTERM, стенда
compose с HAProxy, скриптов отказа и замены, тестов, нагрузочного
стенда и черновиков документации; Codex (OpenAI) — замеры по
`bench/RUNBOOK.md` и их разбор. Все числа в отчёте — из файлов
`bench/RUNBOOK.md` и их разбор, исправление bootstrap, операторский
shell-скрипт, эксперименты с пулом и оптимизация одиночных чтений,
проверки и оформление результатов. Все числа в отчёте — из файлов
`evidence/`, снятых командами, указанными в их шапках; решения
проверены тестами и вручную.
@@ -0,0 +1,11 @@
# Сравнение: scaling-h5-aa → scaling-h7-after
- Код «до»: src_sha256 `0349e9a270178467`; «после»: `5880b0252c5fd7bb`.
- Пул приложения «до»: {'pool_size': 10, 'pool_overflow': 5, 'pool_timeout': 5.0, 'operation_timeout': 6.0, 'statement_timeout_ms': 5000, 'kdf_concurrency': 4, 'keep_alive': 60, 'shutdown_timeout': 5}; «после»: {'pool_size': 10, 'pool_overflow': 5, 'pool_timeout': 5.0, 'operation_timeout': 6.0, 'statement_timeout_ms': 5000, 'kdf_concurrency': 4, 'keep_alive': 60, 'shutdown_timeout': 5}.
- Шум A/A (scaling-h5-before): наибольшее |Δ медианы R*| = 19.9 %.
- Порог эффекта: разбросы не пересекаются, |Δ| > шума и R* после / до ≥ 1.118 (две ступени сетки поиска; одна ступень — 1.057).
| Конфигурация | R* до, медиана (min–max) | R* после | Δ | Вывод | p95 до / после на фиксированных, мс | API мкс/запрос до / после | PostgreSQL мкс/запрос на R* до / после | Новых сессий за окно на первой нарушившей до / после | Соединений на R* до / после |
|---|---|---|---|---|---|---|---|---|---|
| 4x1-pg0.5 | 984 (833–1164) | 1301 (1301–1301) | 32.2 % | эффект | 250: 6.4 / 6.6 ; 500: 4.5 / 4.3 | 1728 / 1492 | 338.4 / 232.9 | 22 / 22 | 40 / 40 |
| 4x1 | 1819 (1819–1819) | 1819 (1819–1923) | 0 % | шум (разбросы пересекаются) | 250: 6.5 / 6.4 ; 500: 4.7 / 4.5 | 1750 / 1454 | 622.3 / 370.8 | 34 / 39 | 60 / 52 |
@@ -0,0 +1,11 @@
# Сравнение: scaling-h5-before → scaling-h7-after
- Код «до»: src_sha256 `0349e9a270178467`; «после»: `5880b0252c5fd7bb`.
- Пул приложения «до»: {'pool_size': 10, 'pool_overflow': 5, 'pool_timeout': 5.0, 'operation_timeout': 6.0, 'statement_timeout_ms': 5000, 'kdf_concurrency': 4, 'keep_alive': 60, 'shutdown_timeout': 5}; «после»: {'pool_size': 10, 'pool_overflow': 5, 'pool_timeout': 5.0, 'operation_timeout': 6.0, 'statement_timeout_ms': 5000, 'kdf_concurrency': 4, 'keep_alive': 60, 'shutdown_timeout': 5}.
- Шум A/A (scaling-h5-aa): наибольшее |Δ медианы R*| = 24.9 %.
- Порог эффекта: разбросы не пересекаются, |Δ| > шума и R* после / до ≥ 1.118 (две ступени сетки поиска; одна ступень — 1.057).
| Конфигурация | R* до, медиана (min–max) | R* после | Δ | Вывод | p95 до / после на фиксированных, мс | API мкс/запрос до / после | PostgreSQL мкс/запрос на R* до / после | Новых сессий за окно на первой нарушившей до / после | Соединений на R* до / после |
|---|---|---|---|---|---|---|---|---|---|
| 4x1-pg0.5 | 788 (788–833) | 1301 (1301–1301) | 65.1 % | эффект | 250: 6.3 / 6.6 ; 500: 4.8 / 4.3 | 1728 / 1492 | 321.1 / 232.9 | 23 / 22 | 40 / 40 |
| 4x1 | 1819 (1819–1819) | 1819 (1819–1923) | 0 % | шум (разбросы пересекаются) | 250: 6.3 / 6.4 ; 500: 4.5 / 4.5 | 1748 / 1454 | 604.2 / 370.8 | 46 / 39 | 60 / 52 |
@@ -0,0 +1,44 @@
<svg xmlns="http://www.w3.org/2000/svg" width="1000" height="460" viewBox="0 0 1000 460" font-family="sans-serif" font-size="12">
<rect width="1000" height="460" fill="white"/>
<text x="500.0" y="22" text-anchor="middle" font-size="14">R* по конфигурациям: медиана и min–max</text>
<line x1="70" y1="410" x2="700" y2="410" stroke="#333"/>
<line x1="70" y1="40" x2="70" y2="410" stroke="#333"/>
<text x="160.0" y="426" text-anchor="middle">4x1</text>
<text x="250.0" y="426" text-anchor="middle">4x1-pg0.5</text>
<text x="340.0" y="426" text-anchor="middle">4x1</text>
<text x="430.0" y="426" text-anchor="middle">4x1-pg0.5</text>
<text x="520.0" y="426" text-anchor="middle">4x1</text>
<text x="610.0" y="426" text-anchor="middle">4x1-pg0.5</text>
<line x1="70" y1="410.0" x2="700" y2="410.0" stroke="#eee"/>
<text x="64" y="414.0" text-anchor="end">0</text>
<line x1="70" y1="336.0" x2="700" y2="336.0" stroke="#eee"/>
<text x="64" y="340.0" text-anchor="end">500</text>
<line x1="70" y1="262.0" x2="700" y2="262.0" stroke="#eee"/>
<text x="64" y="266.0" text-anchor="end">1000</text>
<line x1="70" y1="188.0" x2="700" y2="188.0" stroke="#eee"/>
<text x="64" y="192.0" text-anchor="end">1500</text>
<line x1="70" y1="114.0" x2="700" y2="114.0" stroke="#eee"/>
<text x="64" y="118.0" text-anchor="end">2000</text>
<line x1="70" y1="40.0" x2="700" y2="40.0" stroke="#eee"/>
<text x="64" y="44.0" text-anchor="end">2500</text>
<text x="385.0" y="448" text-anchor="middle">метка / конфигурация</text>
<text x="16" y="225.0" text-anchor="middle" transform="rotate(-90 16 225.0)">R*, запросов/с</text>
<rect x="135.2" y="140.8" width="49.5" height="269.2" fill="#2f6fbf" opacity="0.85"/>
<line x1="160.0" y1="140.8" x2="160.0" y2="140.8" stroke="#222" stroke-width="1.5"/>
<rect x="225.2" y="293.4" width="49.5" height="116.6" fill="#2f6fbf" opacity="0.85"/>
<line x1="250.0" y1="293.4" x2="250.0" y2="286.7" stroke="#222" stroke-width="1.5"/>
<rect x="315.2" y="140.8" width="49.5" height="269.2" fill="#d0752a" opacity="0.85"/>
<line x1="340.0" y1="140.8" x2="340.0" y2="140.8" stroke="#222" stroke-width="1.5"/>
<rect x="405.2" y="264.4" width="49.5" height="145.6" fill="#d0752a" opacity="0.85"/>
<line x1="430.0" y1="286.7" x2="430.0" y2="237.7" stroke="#222" stroke-width="1.5"/>
<rect x="495.2" y="140.8" width="49.5" height="269.2" fill="#3c9a5f" opacity="0.85"/>
<line x1="520.0" y1="140.8" x2="520.0" y2="125.4" stroke="#222" stroke-width="1.5"/>
<rect x="585.2" y="217.5" width="49.5" height="192.5" fill="#3c9a5f" opacity="0.85"/>
<line x1="610.0" y1="217.5" x2="610.0" y2="217.5" stroke="#222" stroke-width="1.5"/>
<line x1="714" y1="50" x2="732" y2="50" stroke="#2f6fbf" stroke-width="3"/>
<text x="738" y="54">scaling-h5-before</text>
<line x1="714" y1="68" x2="732" y2="68" stroke="#d0752a" stroke-width="3"/>
<text x="738" y="72">scaling-h5-aa</text>
<line x1="714" y1="86" x2="732" y2="86" stroke="#3c9a5f" stroke-width="3"/>
<text x="738" y="90">scaling-h7-after</text>
</svg>

After

Width:  |  Height:  |  Size: 3.0 KiB

@@ -0,0 +1,54 @@
<svg xmlns="http://www.w3.org/2000/svg" width="860" height="440" viewBox="0 0 860 440" font-family="sans-serif" font-size="12">
<rect width="860" height="440" fill="white"/>
<text x="430.0" y="22" text-anchor="middle" font-size="14">R* от числа реплик (по 1 CPU): медиана, min–max, линейный рост</text>
<line x1="70" y1="390" x2="560" y2="390" stroke="#333"/>
<line x1="70" y1="40" x2="70" y2="390" stroke="#333"/>
<text x="178.9" y="406" text-anchor="middle">1</text>
<text x="287.8" y="406" text-anchor="middle">2</text>
<text x="396.7" y="406" text-anchor="middle">3</text>
<text x="505.6" y="406" text-anchor="middle">4</text>
<line x1="70" y1="390.0" x2="560" y2="390.0" stroke="#eee"/>
<text x="64" y="394.0" text-anchor="end">0</text>
<line x1="70" y1="320.0" x2="560" y2="320.0" stroke="#eee"/>
<text x="64" y="324.0" text-anchor="end">500</text>
<line x1="70" y1="250.0" x2="560" y2="250.0" stroke="#eee"/>
<text x="64" y="254.0" text-anchor="end">1000</text>
<line x1="70" y1="180.0" x2="560" y2="180.0" stroke="#eee"/>
<text x="64" y="184.0" text-anchor="end">1500</text>
<line x1="70" y1="110.0" x2="560" y2="110.0" stroke="#eee"/>
<text x="64" y="114.0" text-anchor="end">2000</text>
<line x1="70" y1="40.0" x2="560" y2="40.0" stroke="#eee"/>
<text x="64" y="44.0" text-anchor="end">2500</text>
<text x="315.0" y="428" text-anchor="middle">реплик</text>
<text x="16" y="215.0" text-anchor="middle" transform="rotate(-90 16 215.0)">R*, запросов/с</text>
<polyline points="505.6,252.2" fill="none" stroke="#2f6fbf" stroke-width="2"/>
<circle cx="505.6" cy="252.2" r="3.5" fill="#2f6fbf" stroke="#2f6fbf"/>
<line x1="505.6" y1="273.4" x2="505.6" y2="227.0" stroke="#2f6fbf" stroke-width="1.5"/>
<line x1="574" y1="50" x2="592" y2="50" stroke="#2f6fbf" stroke-width="3"/>
<text x="598" y="54">scaling-h5-aa, PostgreSQL 0.5 CPU</text>
<polyline points="505.6,135.3" fill="none" stroke="#d0752a" stroke-width="2"/>
<circle cx="505.6" cy="135.3" r="3.5" fill="#d0752a" stroke="#d0752a"/>
<line x1="505.6" y1="135.3" x2="505.6" y2="135.3" stroke="#d0752a" stroke-width="1.5"/>
<line x1="574" y1="68" x2="592" y2="68" stroke="#d0752a" stroke-width="3"/>
<text x="598" y="72">scaling-h5-aa, PostgreSQL 2 CPU</text>
<polyline points="505.6,279.7" fill="none" stroke="#3c9a5f" stroke-width="2"/>
<circle cx="505.6" cy="279.7" r="3.5" fill="#3c9a5f" stroke="#3c9a5f"/>
<line x1="505.6" y1="279.7" x2="505.6" y2="273.4" stroke="#3c9a5f" stroke-width="1.5"/>
<line x1="574" y1="86" x2="592" y2="86" stroke="#3c9a5f" stroke-width="3"/>
<text x="598" y="90">scaling-h5-before, PostgreSQL 0.5 CPU</text>
<polyline points="505.6,135.3" fill="none" stroke="#b8404a" stroke-width="2"/>
<circle cx="505.6" cy="135.3" r="3.5" fill="#b8404a" stroke="#b8404a"/>
<line x1="505.6" y1="135.3" x2="505.6" y2="135.3" stroke="#b8404a" stroke-width="1.5"/>
<line x1="574" y1="104" x2="592" y2="104" stroke="#b8404a" stroke-width="3"/>
<text x="598" y="108">scaling-h5-before, PostgreSQL 2 CPU</text>
<polyline points="505.6,207.9" fill="none" stroke="#7a5cb5" stroke-width="2"/>
<circle cx="505.6" cy="207.9" r="3.5" fill="#7a5cb5" stroke="#7a5cb5"/>
<line x1="505.6" y1="207.9" x2="505.6" y2="207.9" stroke="#7a5cb5" stroke-width="1.5"/>
<line x1="574" y1="122" x2="592" y2="122" stroke="#7a5cb5" stroke-width="3"/>
<text x="598" y="126">scaling-h7-after, PostgreSQL 0.5 CPU</text>
<polyline points="505.6,135.3" fill="none" stroke="#8c6d3f" stroke-width="2"/>
<circle cx="505.6" cy="135.3" r="3.5" fill="#8c6d3f" stroke="#8c6d3f"/>
<line x1="505.6" y1="135.3" x2="505.6" y2="120.8" stroke="#8c6d3f" stroke-width="1.5"/>
<line x1="574" y1="140" x2="592" y2="140" stroke="#8c6d3f" stroke-width="3"/>
<text x="598" y="144">scaling-h7-after, PostgreSQL 2 CPU</text>
</svg>

After

Width:  |  Height:  |  Size: 3.7 KiB

+21
View File
@@ -0,0 +1,21 @@
# Графики трека 1: scaling-h7
Метки: scaling-h5-before, scaling-h5-aa, scaling-h7-after. Числа — `searches.csv` меток.
| Метка | Конфигурация | Реплик | CPU реплики | PostgreSQL CPU | R* медиана | min–max | Эффективность к 1 × 1 метки | Признаки на первой нарушившей |
|---|---|---|---|---|---|---|---|---|
| scaling-h5-before | 4x1 | 4 | 1 | 2 | 1819 | 1819–1819 | — | app ×3, churn ×3, pool ×3 |
| scaling-h5-before | 4x1-pg0.5 | 4 | 1 | 0.5 | 788 | 788–833 | — | churn ×2, db_cpu ×1, pool ×3 |
| scaling-h5-aa | 4x1 | 4 | 1 | 2 | 1819 | 1819–1819 | — | app ×3, churn ×2, pool ×3 |
| scaling-h5-aa | 4x1-pg0.5 | 4 | 1 | 0.5 | 984 | 833–1164 | — | churn ×2, db_cpu ×3, pool ×3 |
| scaling-h7-after | 4x1 | 4 | 1 | 2 | 1819 | 1819–1923 | — | app ×3, churn ×3, pool ×3 |
| scaling-h7-after | 4x1-pg0.5 | 4 | 1 | 0.5 | 1301 | 1301–1301 | — | churn ×2, db_cpu ×3, pool ×3 |
## Точка насыщения
- scaling-h5-aa, PostgreSQL 0.5 CPU: в пределах снятых конфигураций рост не останавливается (≥ +10 % на реплику).
- scaling-h5-aa, PostgreSQL 2 CPU: в пределах снятых конфигураций рост не останавливается (≥ +10 % на реплику).
- scaling-h5-before, PostgreSQL 0.5 CPU: в пределах снятых конфигураций рост не останавливается (≥ +10 % на реплику).
- scaling-h5-before, PostgreSQL 2 CPU: в пределах снятых конфигураций рост не останавливается (≥ +10 % на реплику).
- scaling-h7-after, PostgreSQL 0.5 CPU: в пределах снятых конфигураций рост не останавливается (≥ +10 % на реплику).
- scaling-h7-after, PostgreSQL 2 CPU: в пределах снятых конфигураций рост не останавливается (≥ +10 % на реплику).
@@ -0,0 +1,38 @@
<svg xmlns="http://www.w3.org/2000/svg" width="1000" height="440" viewBox="0 0 1000 440" font-family="sans-serif" font-size="12">
<rect width="1000" height="440" fill="white"/>
<text x="500.0" y="22" text-anchor="middle" font-size="14">CPU компонентов на ступени R* (медиана), ядер: scaling-h7-after</text>
<line x1="70" y1="390" x2="700" y2="390" stroke="#333"/>
<line x1="70" y1="40" x2="70" y2="390" stroke="#333"/>
<text x="280.0" y="406" text-anchor="middle">4x1</text>
<text x="490.0" y="406" text-anchor="middle">4x1-pg0.5</text>
<line x1="70" y1="390.0" x2="700" y2="390.0" stroke="#eee"/>
<text x="64" y="394.0" text-anchor="end">0</text>
<line x1="70" y1="273.3" x2="700" y2="273.3" stroke="#eee"/>
<text x="64" y="277.3" text-anchor="end">2</text>
<line x1="70" y1="156.7" x2="700" y2="156.7" stroke="#eee"/>
<text x="64" y="160.7" text-anchor="end">4</text>
<line x1="70" y1="40.0" x2="700" y2="40.0" stroke="#eee"/>
<text x="64" y="44.0" text-anchor="end">6</text>
<text x="385.0" y="428" text-anchor="middle">конфигурация</text>
<text x="16" y="215.0" text-anchor="middle" transform="rotate(-90 16 215.0)">ядер</text>
<rect x="227.5" y="177.6" width="105.0" height="212.4" fill="#2f6fbf" opacity="0.85"/>
<rect x="227.5" y="137.1" width="105.0" height="40.4" fill="#b8404a" opacity="0.85"/>
<rect x="227.5" y="125.6" width="105.0" height="11.6" fill="#3c9a5f" opacity="0.85"/>
<rect x="227.5" y="122.3" width="105.0" height="3.3" fill="#7a5cb5" opacity="0.85"/>
<rect x="227.5" y="100.4" width="105.0" height="21.9" fill="#8c6d3f" opacity="0.85"/>
<rect x="437.5" y="258.0" width="105.0" height="132.0" fill="#2f6fbf" opacity="0.85"/>
<rect x="437.5" y="240.3" width="105.0" height="17.7" fill="#b8404a" opacity="0.85"/>
<rect x="437.5" y="234.4" width="105.0" height="5.9" fill="#3c9a5f" opacity="0.85"/>
<rect x="437.5" y="232.7" width="105.0" height="1.8" fill="#7a5cb5" opacity="0.85"/>
<rect x="437.5" y="221.9" width="105.0" height="10.8" fill="#8c6d3f" opacity="0.85"/>
<line x1="714" y1="50" x2="732" y2="50" stroke="#2f6fbf" stroke-width="3"/>
<text x="738" y="54">API (сумма реплик)</text>
<line x1="714" y1="68" x2="732" y2="68" stroke="#b8404a" stroke-width="3"/>
<text x="738" y="72">PostgreSQL</text>
<line x1="714" y1="86" x2="732" y2="86" stroke="#3c9a5f" stroke-width="3"/>
<text x="738" y="90">HAProxy</text>
<line x1="714" y1="104" x2="732" y2="104" stroke="#7a5cb5" stroke-width="3"/>
<text x="738" y="108">Valkey</text>
<line x1="714" y1="122" x2="732" y2="122" stroke="#8c6d3f" stroke-width="3"/>
<text x="738" y="126">генератор</text>
</svg>

After

Width:  |  Height:  |  Size: 2.6 KiB

+218
View File
@@ -0,0 +1,218 @@
{
"kind": "scaling",
"label": "scaling-h7-after",
"series": "ab",
"started": "2026-10-15T22:41:16Z",
"profile": {
"name": "scaling",
"series": "ab",
"configs": [
"4x1-pg0.5",
"4x1"
],
"repeats": 3,
"users": 20,
"read_messages": 10000,
"write_chats": 10,
"fill_clients": 16,
"mix": "70,20,10",
"fixed_rates": [
250.0,
500.0
],
"ladder_base": 100.0,
"ladder_factor": 1.25,
"start_per_replica": 300.0,
"bisections": 2,
"rate_cap": 8000.0,
"warmup_first_s": 10.0,
"warmup_ramp_s": 5.0,
"window_s": 15.0,
"pause_after_fail_s": 10.0,
"slo_p95_ms": 200.0,
"slo_fail_share": 0.01,
"abort_error_share": 0.5,
"abort_p95_ms": 2000.0,
"request_timeout_s": 10.0,
"gen_procs": 4,
"session_ttl": 21600,
"order_seed": 20261014,
"base": {
"api_replicas": 1,
"api_cpus": 1.0,
"api_memory": "512m",
"db_cpus": 2.0,
"db_memory": "1g",
"db_max_connections": 100,
"cache_cpus": 0.5,
"cache_memory": "128m",
"lb_cpus": 1.0,
"lb_memory": "256m",
"gen_cpus": 2.0,
"gen_memory": "1g",
"sampler_cpus": 0.25,
"sampler_memory": "256m"
}
},
"configs": {
"4x1-pg0.5": {
"api_replicas": 4,
"api_cpus": 1.0,
"api_memory": "512m",
"db_cpus": 0.5,
"db_memory": "1g",
"db_max_connections": 100,
"cache_cpus": 0.5,
"cache_memory": "128m",
"lb_cpus": 1.0,
"lb_memory": "256m",
"gen_cpus": 2.0,
"gen_memory": "1g",
"sampler_cpus": 0.25,
"sampler_memory": "256m"
},
"4x1": {
"api_replicas": 4,
"api_cpus": 1.0,
"api_memory": "512m",
"db_cpus": 2.0,
"db_memory": "1g",
"db_max_connections": 100,
"cache_cpus": 0.5,
"cache_memory": "128m",
"lb_cpus": 1.0,
"lb_memory": "256m",
"gen_cpus": 2.0,
"gen_memory": "1g",
"sampler_cpus": 0.25,
"sampler_memory": "256m"
}
},
"budget": {
"4x1-pg0.5": {
"cpus": 8.25,
"memory_gib": 4.62
},
"4x1": {
"cpus": 9.75,
"memory_gib": 4.62
}
},
"vm": {
"limits_cpus": 9.75,
"limits_memory_gib": 4.62,
"vm_cpus": 10,
"vm_memory_gib": 7.65
},
"host": {
"platform": "macOS-26.6.2-arm64-arm-64bit-Mach-O",
"machine": "arm64",
"cpu_model": "Apple M4",
"cpu_count": 10,
"ram_gb": 16.0,
"swap_used_mib": 0.0,
"power": "AC Power",
"memory_pressure": null,
"memory_free_percent": 53,
"swapouts": 0,
"loadavg_1m": 2.33
},
"docker": {
"ServerVersion": "28.0.4",
"OperatingSystem": "Docker Desktop",
"KernelVersion": "6.10.14-linuxkit",
"Architecture": "aarch64",
"NCPU": 10,
"MemTotal": 8218034176,
"CgroupVersion": "2",
"CgroupDriver": "cgroupfs",
"compose_version": "2.34.0-desktop.1",
"other_running_containers": []
},
"host_warnings": [],
"image": {
"tag": "mtusi-messenger-vladimirceva:bench-scaling-h7-after",
"id": "sha256:f9c9c07183f88e2ce48c471e45ea55fdaee2f47c3d5b32d3f3aa960dcc99bd2d",
"created": "2026-10-15T22:34:00.736439377Z",
"src_sha256": "5880b0252c5fd7bb68fd1771ab198c48da080e847753e7612635775fab02b4aa",
"versions": {
"python": "3.13.15",
"fastapi": "0.142.1",
"starlette": "1.7.0",
"uvicorn": "0.54.0",
"pydantic": "2.13.5",
"sqlalchemy": "2.1.1",
"asyncpg": "0.31.0",
"alembic": "1.20.0",
"redis": "8.1.0",
"argon2-cffi": "25.1.0"
},
"app_defaults": {
"pool_size": 10,
"pool_overflow": 5,
"pool_timeout": 5.0,
"operation_timeout": 6.0,
"statement_timeout_ms": 5000,
"kdf_concurrency": 4,
"keep_alive": 60,
"shutdown_timeout": 5
}
},
"code": {
"src_sha256": "5880b0252c5fd7bb68fd1771ab198c48da080e847753e7612635775fab02b4aa",
"git_commit": "e2be4787c7550082cd78276400147ae0dfcccdf3",
"git_dirty": false
},
"thresholds": {
"app_cpu_share": 0.85,
"app_throttled_share": 0.2,
"db_cpu_share": 0.85,
"db_lock_wait_mean": 1.0,
"pool_share": 0.9,
"churn_sessions": 20,
"lb_cpu_share": 0.85,
"host_busy_share": 0.9,
"gen_cpu_share": 0.9,
"gen_lag_p99_ms": 50.0
},
"plan": [
{
"cell": 1,
"config": "4x1",
"repeat": 1
},
{
"cell": 2,
"config": "4x1-pg0.5",
"repeat": 1
},
{
"cell": 3,
"config": "4x1",
"repeat": 2
},
{
"cell": 4,
"config": "4x1-pg0.5",
"repeat": 2
},
{
"cell": 5,
"config": "4x1",
"repeat": 3
},
{
"cell": 6,
"config": "4x1-pg0.5",
"repeat": 3
}
],
"finished": "2026-10-15T22:59:40Z",
"host_state_end": {
"slept_seconds": 0.0,
"swapouts_start": 0,
"swapouts_end": 0,
"power_end": "AC Power",
"swapouts_delta": 0
}
}
@@ -0,0 +1,77 @@
<svg xmlns="http://www.w3.org/2000/svg" width="1000" height="440" viewBox="0 0 1000 440" font-family="sans-serif" font-size="12">
<rect width="1000" height="440" fill="white"/>
<text x="500.0" y="22" text-anchor="middle" font-size="14">p95 успешных от поданной интенсивности: scaling-h7-after</text>
<line x1="70" y1="390" x2="700" y2="390" stroke="#333"/>
<line x1="70" y1="40" x2="70" y2="390" stroke="#333"/>
<text x="70.0" y="406" text-anchor="middle">0</text>
<text x="201.9" y="406" text-anchor="middle">500</text>
<text x="333.9" y="406" text-anchor="middle">1000</text>
<text x="465.8" y="406" text-anchor="middle">1500</text>
<text x="597.7" y="406" text-anchor="middle">2000</text>
<line x1="70" y1="390.0" x2="700" y2="390.0" stroke="#eee"/>
<text x="64" y="394.0" text-anchor="end">0</text>
<line x1="70" y1="320.0" x2="700" y2="320.0" stroke="#eee"/>
<text x="64" y="324.0" text-anchor="end">250</text>
<line x1="70" y1="250.0" x2="700" y2="250.0" stroke="#eee"/>
<text x="64" y="254.0" text-anchor="end">500</text>
<line x1="70" y1="180.0" x2="700" y2="180.0" stroke="#eee"/>
<text x="64" y="184.0" text-anchor="end">750</text>
<line x1="70" y1="110.0" x2="700" y2="110.0" stroke="#eee"/>
<text x="64" y="114.0" text-anchor="end">1000</text>
<line x1="70" y1="40.0" x2="700" y2="40.0" stroke="#eee"/>
<text x="64" y="44.0" text-anchor="end">1250</text>
<text x="385.0" y="428" text-anchor="middle">запросов в секунду (по расписанию)</text>
<text x="16" y="215.0" text-anchor="middle" transform="rotate(-90 16 215.0)">p95, мс (≤ 1000)</text>
<polyline points="70.0,334.0 700.0,334.0" fill="none" stroke="#999" stroke-width="2" stroke-dasharray="4 4"/>
<polyline points="136.0,388.4 201.9,388.9 453.9,388.6 549.9,387.1 577.4,110.0 606.7,321.4 670.0,110.0" fill="none" stroke="#2f6fbf" stroke-width="2"/>
<circle cx="136.0" cy="388.4" r="3.5" fill="#2f6fbf" stroke="#2f6fbf"/>
<circle cx="201.9" cy="388.9" r="3.5" fill="#2f6fbf" stroke="#2f6fbf"/>
<circle cx="453.9" cy="388.6" r="3.5" fill="#2f6fbf" stroke="#2f6fbf"/>
<circle cx="549.9" cy="387.1" r="3.5" fill="#2f6fbf" stroke="#2f6fbf"/>
<circle cx="670.0" cy="110.0" r="3.5" fill="white" stroke="#2f6fbf"/>
<circle cx="606.7" cy="321.4" r="3.5" fill="white" stroke="#2f6fbf"/>
<circle cx="577.4" cy="110.0" r="3.5" fill="white" stroke="#2f6fbf"/>
<polyline points="136.0,388.2 201.9,388.7 453.9,388.7 549.9,387.3 577.4,339.3 606.7,274.2 670.0,110.0" fill="none" stroke="#2f6fbf" stroke-width="2"/>
<circle cx="136.0" cy="388.2" r="3.5" fill="#2f6fbf" stroke="#2f6fbf"/>
<circle cx="201.9" cy="388.7" r="3.5" fill="#2f6fbf" stroke="#2f6fbf"/>
<circle cx="453.9" cy="388.7" r="3.5" fill="#2f6fbf" stroke="#2f6fbf"/>
<circle cx="549.9" cy="387.3" r="3.5" fill="#2f6fbf" stroke="#2f6fbf"/>
<circle cx="670.0" cy="110.0" r="3.5" fill="white" stroke="#2f6fbf"/>
<circle cx="606.7" cy="274.2" r="3.5" fill="white" stroke="#2f6fbf"/>
<circle cx="577.4" cy="339.3" r="3.5" fill="#2f6fbf" stroke="#2f6fbf"/>
<polyline points="136.0,388.2 201.9,388.7 453.9,388.6 549.9,368.1 577.4,110.0 606.7,110.0 670.0,110.0" fill="none" stroke="#2f6fbf" stroke-width="2"/>
<circle cx="136.0" cy="388.2" r="3.5" fill="#2f6fbf" stroke="#2f6fbf"/>
<circle cx="201.9" cy="388.7" r="3.5" fill="#2f6fbf" stroke="#2f6fbf"/>
<circle cx="453.9" cy="388.6" r="3.5" fill="#2f6fbf" stroke="#2f6fbf"/>
<circle cx="549.9" cy="368.1" r="3.5" fill="#2f6fbf" stroke="#2f6fbf"/>
<circle cx="670.0" cy="110.0" r="3.5" fill="white" stroke="#2f6fbf"/>
<circle cx="606.7" cy="110.0" r="3.5" fill="white" stroke="#2f6fbf"/>
<circle cx="577.4" cy="110.0" r="3.5" fill="white" stroke="#2f6fbf"/>
<line x1="714" y1="50" x2="732" y2="50" stroke="#2f6fbf" stroke-width="3"/>
<text x="738" y="54">4x1</text>
<polyline points="136.0,388.3 201.9,388.8 377.1,388.8 413.3,388.7 433.1,110.0 453.9,110.0" fill="none" stroke="#d0752a" stroke-width="2"/>
<circle cx="136.0" cy="388.3" r="3.5" fill="#d0752a" stroke="#d0752a"/>
<circle cx="201.9" cy="388.8" r="3.5" fill="#d0752a" stroke="#d0752a"/>
<circle cx="453.9" cy="110.0" r="3.5" fill="white" stroke="#d0752a"/>
<circle cx="377.1" cy="388.8" r="3.5" fill="#d0752a" stroke="#d0752a"/>
<circle cx="413.3" cy="388.7" r="3.5" fill="#d0752a" stroke="#d0752a"/>
<circle cx="433.1" cy="110.0" r="3.5" fill="white" stroke="#d0752a"/>
<polyline points="136.0,388.1 201.9,388.8 377.1,388.8 413.3,388.7 433.1,110.0 453.9,262.5" fill="none" stroke="#d0752a" stroke-width="2"/>
<circle cx="136.0" cy="388.1" r="3.5" fill="#d0752a" stroke="#d0752a"/>
<circle cx="201.9" cy="388.8" r="3.5" fill="#d0752a" stroke="#d0752a"/>
<circle cx="453.9" cy="262.5" r="3.5" fill="white" stroke="#d0752a"/>
<circle cx="377.1" cy="388.8" r="3.5" fill="#d0752a" stroke="#d0752a"/>
<circle cx="413.3" cy="388.7" r="3.5" fill="#d0752a" stroke="#d0752a"/>
<circle cx="433.1" cy="110.0" r="3.5" fill="white" stroke="#d0752a"/>
<polyline points="136.0,388.2 201.9,388.8 377.1,388.7 413.3,388.7 433.1,110.0 453.9,110.0" fill="none" stroke="#d0752a" stroke-width="2"/>
<circle cx="136.0" cy="388.2" r="3.5" fill="#d0752a" stroke="#d0752a"/>
<circle cx="201.9" cy="388.8" r="3.5" fill="#d0752a" stroke="#d0752a"/>
<circle cx="453.9" cy="110.0" r="3.5" fill="white" stroke="#d0752a"/>
<circle cx="377.1" cy="388.7" r="3.5" fill="#d0752a" stroke="#d0752a"/>
<circle cx="413.3" cy="388.7" r="3.5" fill="#d0752a" stroke="#d0752a"/>
<circle cx="433.1" cy="110.0" r="3.5" fill="white" stroke="#d0752a"/>
<line x1="714" y1="68" x2="732" y2="68" stroke="#d0752a" stroke-width="3"/>
<text x="738" y="72">4x1-pg0.5</text>
<line x1="714" y1="86" x2="732" y2="86" stroke="#999" stroke-width="3" stroke-dasharray="4 4"/>
<text x="738" y="90">SLO 200 мс</text>
</svg>

After

Width:  |  Height:  |  Size: 5.6 KiB

@@ -0,0 +1 @@
{"rate": 250.0, "rate_from": 0.0, "warmup_s": 10.0, "window_s": 15.0, "window_start": 1792104101.057, "window_end": 1792104116.057, "scheduled": 3750, "sent": 3750, "ok": 3750, "errors": 0, "error_kinds": {}, "short_pages": 0, "dropped": 0, "unsent": 0, "fail_share": 0.0, "achieved_rps": 250.0, "p50_ms": 4.03, "p95_ms": 5.66, "p99_ms": 6.86, "max_ms": 13.37, "service_p95_ms": 3.03, "lag_p99_ms": 4.13, "lag_max_ms": 5.94, "by_kind": {"read": 2620, "write": 748, "me": 382}, "ok_by_kind": {"read": 2620, "write": 748, "me": 382}, "kind_p95_ms": {"read": 5.42, "write": 6.2, "me": 4.32}, "instances": {"a45e20137b32": 937, "4f760fb7e006": 937, "838011f70891": 938, "464caf5759bf": 938}, "peak_inflight": 4, "gen_cpu_s": 0.773, "procs": 4, "abort": ""}
@@ -0,0 +1 @@
{"rate": 500.0, "rate_from": 250.0, "warmup_s": 5.0, "window_s": 15.0, "window_start": 1792104121.535, "window_end": 1792104136.535, "scheduled": 7500, "sent": 7500, "ok": 7500, "errors": 0, "error_kinds": {}, "short_pages": 0, "dropped": 0, "unsent": 0, "fail_share": 0.0, "achieved_rps": 500.0, "p50_ms": 2.94, "p95_ms": 3.84, "p99_ms": 4.47, "max_ms": 22.6, "service_p95_ms": 2.37, "lag_p99_ms": 2.32, "lag_max_ms": 4.34, "by_kind": {"read": 5269, "write": 1463, "me": 768}, "ok_by_kind": {"read": 5269, "write": 1463, "me": 768}, "kind_p95_ms": {"read": 3.59, "write": 4.31, "me": 2.68}, "instances": {"a45e20137b32": 1875, "4f760fb7e006": 1875, "464caf5759bf": 1875, "838011f70891": 1875}, "peak_inflight": 11, "gen_cpu_s": 1.192, "procs": 4, "abort": ""}
@@ -0,0 +1 @@
{"rate": 1455.0, "rate_from": 500.0, "warmup_s": 5.0, "window_s": 15.0, "window_start": 1792104141.998, "window_end": 1792104156.998, "scheduled": 21825, "sent": 21825, "ok": 21825, "errors": 0, "error_kinds": {}, "short_pages": 0, "dropped": 0, "unsent": 0, "fail_share": 0.0, "achieved_rps": 1455.0, "p50_ms": 2.42, "p95_ms": 4.84, "p99_ms": 46.53, "max_ms": 198.06, "service_p95_ms": 3.91, "lag_p99_ms": 1.95, "lag_max_ms": 7.76, "by_kind": {"read": 15314, "write": 4337, "me": 2174}, "ok_by_kind": {"read": 15314, "write": 4337, "me": 2174}, "kind_p95_ms": {"read": 4.39, "write": 6.11, "me": 2.87}, "instances": {"464caf5759bf": 5457, "a45e20137b32": 5456, "838011f70891": 5457, "4f760fb7e006": 5455}, "peak_inflight": 79, "gen_cpu_s": 3.496, "procs": 4, "abort": ""}
@@ -0,0 +1 @@
{"rate": 1819.0, "rate_from": 1455.0, "warmup_s": 5.0, "window_s": 15.0, "window_start": 1792104162.477, "window_end": 1792104177.477, "scheduled": 27285, "sent": 27285, "ok": 27285, "errors": 0, "error_kinds": {}, "short_pages": 0, "dropped": 0, "unsent": 0, "fail_share": 0.0, "achieved_rps": 1819.0, "p50_ms": 3.26, "p95_ms": 10.2, "p99_ms": 106.96, "max_ms": 366.06, "service_p95_ms": 9.73, "lag_p99_ms": 1.86, "lag_max_ms": 5.6, "by_kind": {"read": 19120, "write": 5451, "me": 2714}, "ok_by_kind": {"read": 19120, "write": 5451, "me": 2714}, "kind_p95_ms": {"read": 9.94, "write": 12.19, "me": 4.88}, "instances": {"4f760fb7e006": 6821, "a45e20137b32": 6822, "838011f70891": 6821, "464caf5759bf": 6821}, "peak_inflight": 215, "gen_cpu_s": 6.012, "procs": 4, "abort": ""}
@@ -0,0 +1 @@
{"rate": 2274.0, "rate_from": 1819.0, "warmup_s": 5.0, "window_s": 15.0, "window_start": 1792104182.952, "window_end": 1792104197.952, "scheduled": 34110, "sent": 34110, "ok": 30888, "errors": 3222, "error_kinds": {"503": 3216, "IncompleteReadError": 1, "ConnectionResetError": 5}, "short_pages": 0, "dropped": 0, "unsent": 0, "fail_share": 0.09446, "achieved_rps": 2059.2, "p50_ms": 118.34, "p95_ms": 2273.2, "p99_ms": 3693.09, "max_ms": 6195.99, "service_p95_ms": 2272.52, "lag_p99_ms": 1.93, "lag_max_ms": 10.76, "by_kind": {"read": 24008, "write": 6701, "me": 3401}, "ok_by_kind": {"read": 21746, "write": 6060, "me": 3082}, "kind_p95_ms": {"read": 2358.34, "write": 2243.83, "me": 1481.11}, "instances": {"838011f70891": 7102, "4f760fb7e006": 9334, "a45e20137b32": 7941, "464caf5759bf": 6511}, "peak_inflight": 2089, "gen_cpu_s": 9.501, "procs": 4, "abort": ""}
@@ -0,0 +1 @@
{"rate": 2034.0, "rate_from": 0.0, "warmup_s": 10.0, "window_s": 15.0, "window_start": 1792104219.512, "window_end": 1792104234.512, "scheduled": 30510, "sent": 30510, "ok": 30510, "errors": 0, "error_kinds": {}, "short_pages": 0, "dropped": 0, "unsent": 0, "fail_share": 0.0, "achieved_rps": 2034.0, "p50_ms": 5.37, "p95_ms": 244.99, "p99_ms": 533.67, "max_ms": 1961.36, "service_p95_ms": 244.49, "lag_p99_ms": 1.93, "lag_max_ms": 12.11, "by_kind": {"read": 21414, "write": 6084, "me": 3012}, "ok_by_kind": {"read": 21414, "write": 6084, "me": 3012}, "kind_p95_ms": {"read": 252.22, "write": 260.98, "me": 139.26}, "instances": {"838011f70891": 7627, "4f760fb7e006": 7627, "a45e20137b32": 7628, "464caf5759bf": 7628}, "peak_inflight": 432, "gen_cpu_s": 7.836, "procs": 4, "abort": ""}
@@ -0,0 +1 @@
{"rate": 1923.0, "rate_from": 0.0, "warmup_s": 10.0, "window_s": 15.0, "window_start": 1792104255.162, "window_end": 1792104270.162, "scheduled": 28845, "sent": 28845, "ok": 28843, "errors": 2, "error_kinds": {"503": 2}, "short_pages": 0, "dropped": 0, "unsent": 0, "fail_share": 7e-05, "achieved_rps": 1922.9, "p50_ms": 67.31, "p95_ms": 1362.95, "p99_ms": 2439.09, "max_ms": 6389.3, "service_p95_ms": 1363.51, "lag_p99_ms": 1.98, "lag_max_ms": 18.2, "by_kind": {"read": 20101, "write": 5850, "me": 2894}, "ok_by_kind": {"read": 20100, "write": 5850, "me": 2893}, "kind_p95_ms": {"read": 1396.79, "write": 1448.96, "me": 887.44}, "instances": {"4f760fb7e006": 7211, "838011f70891": 7212, "a45e20137b32": 7211, "464caf5759bf": 7209}, "peak_inflight": 927, "gen_cpu_s": 8.411, "procs": 4, "abort": ""}
@@ -0,0 +1 @@
{"rate": 250.0, "rate_from": 0.0, "warmup_s": 10.0, "window_s": 15.0, "window_start": 1792104312.273, "window_end": 1792104327.273, "scheduled": 3750, "sent": 3750, "ok": 3750, "errors": 0, "error_kinds": {}, "short_pages": 0, "dropped": 0, "unsent": 0, "fail_share": 0.0, "achieved_rps": 250.0, "p50_ms": 3.99, "p95_ms": 5.92, "p99_ms": 7.03, "max_ms": 19.66, "service_p95_ms": 3.08, "lag_p99_ms": 4.23, "lag_max_ms": 6.44, "by_kind": {"read": 2627, "write": 736, "me": 387}, "ok_by_kind": {"read": 2627, "write": 736, "me": 387}, "kind_p95_ms": {"read": 5.57, "write": 6.48, "me": 4.4}, "instances": {"9f8f449b9655": 937, "953c63e27ec6": 938, "582877b26df3": 937, "d68ca40b4f97": 938}, "peak_inflight": 5, "gen_cpu_s": 0.778, "procs": 4, "abort": ""}
@@ -0,0 +1 @@
{"rate": 500.0, "rate_from": 250.0, "warmup_s": 5.0, "window_s": 15.0, "window_start": 1792104332.761, "window_end": 1792104347.761, "scheduled": 7500, "sent": 7500, "ok": 7500, "errors": 0, "error_kinds": {}, "short_pages": 0, "dropped": 0, "unsent": 0, "fail_share": 0.0, "achieved_rps": 500.0, "p50_ms": 2.76, "p95_ms": 4.3, "p99_ms": 5.44, "max_ms": 27.94, "service_p95_ms": 2.48, "lag_p99_ms": 2.66, "lag_max_ms": 9.25, "by_kind": {"read": 5186, "write": 1526, "me": 788}, "ok_by_kind": {"read": 5186, "write": 1526, "me": 788}, "kind_p95_ms": {"read": 3.96, "write": 4.76, "me": 2.89}, "instances": {"9f8f449b9655": 1875, "953c63e27ec6": 1875, "582877b26df3": 1875, "d68ca40b4f97": 1875}, "peak_inflight": 15, "gen_cpu_s": 1.255, "procs": 4, "abort": ""}
@@ -0,0 +1 @@
{"rate": 1455.0, "rate_from": 500.0, "warmup_s": 5.0, "window_s": 15.0, "window_start": 1792104353.22, "window_end": 1792104368.22, "scheduled": 21825, "sent": 21825, "ok": 21825, "errors": 0, "error_kinds": {}, "short_pages": 0, "dropped": 0, "unsent": 0, "fail_share": 0.0, "achieved_rps": 1455.0, "p50_ms": 234.35, "p95_ms": 1354.16, "p99_ms": 2183.0, "max_ms": 4325.0, "service_p95_ms": 1353.23, "lag_p99_ms": 2.17, "lag_max_ms": 9.52, "by_kind": {"read": 15294, "write": 4362, "me": 2169}, "ok_by_kind": {"read": 15294, "write": 4362, "me": 2169}, "kind_p95_ms": {"read": 1381.01, "write": 1437.09, "me": 762.19}, "instances": {"953c63e27ec6": 5457, "d68ca40b4f97": 5456, "582877b26df3": 5456, "9f8f449b9655": 5456}, "peak_inflight": 1284, "gen_cpu_s": 4.952, "procs": 4, "abort": ""}
@@ -0,0 +1 @@
{"rate": 1164.0, "rate_from": 0.0, "warmup_s": 10.0, "window_s": 15.0, "window_start": 1792104389.621, "window_end": 1792104404.621, "scheduled": 17460, "sent": 17460, "ok": 17460, "errors": 0, "error_kinds": {}, "short_pages": 0, "dropped": 0, "unsent": 0, "fail_share": 0.0, "achieved_rps": 1164.0, "p50_ms": 2.58, "p95_ms": 4.35, "p99_ms": 9.27, "max_ms": 152.95, "service_p95_ms": 3.12, "lag_p99_ms": 2.26, "lag_max_ms": 9.08, "by_kind": {"read": 12245, "write": 3468, "me": 1747}, "ok_by_kind": {"read": 12245, "write": 3468, "me": 1747}, "kind_p95_ms": {"read": 4.09, "write": 4.99, "me": 2.89}, "instances": {"582877b26df3": 4365, "9f8f449b9655": 4365, "d68ca40b4f97": 4365, "953c63e27ec6": 4365}, "peak_inflight": 46, "gen_cpu_s": 3.06, "procs": 4, "abort": ""}
@@ -0,0 +1 @@
{"rate": 1301.0, "rate_from": 1164.0, "warmup_s": 5.0, "window_s": 15.0, "window_start": 1792104410.096, "window_end": 1792104425.096, "scheduled": 19515, "sent": 19515, "ok": 19515, "errors": 0, "error_kinds": {}, "short_pages": 0, "dropped": 0, "unsent": 0, "fail_share": 0.0, "achieved_rps": 1301.0, "p50_ms": 2.66, "p95_ms": 4.63, "p99_ms": 9.81, "max_ms": 165.6, "service_p95_ms": 3.6, "lag_p99_ms": 2.08, "lag_max_ms": 8.78, "by_kind": {"read": 13594, "write": 3961, "me": 1960}, "ok_by_kind": {"read": 13594, "write": 3961, "me": 1960}, "kind_p95_ms": {"read": 4.28, "write": 5.5, "me": 2.96}, "instances": {"582877b26df3": 4879, "9f8f449b9655": 4878, "d68ca40b4f97": 4879, "953c63e27ec6": 4879}, "peak_inflight": 55, "gen_cpu_s": 3.636, "procs": 4, "abort": ""}
@@ -0,0 +1 @@
{"rate": 1376.0, "rate_from": 1301.0, "warmup_s": 5.0, "window_s": 15.0, "window_start": 1792104430.553, "window_end": 1792104445.553, "scheduled": 20640, "sent": 9643, "ok": 9643, "errors": 0, "error_kinds": {}, "short_pages": 0, "dropped": 0, "unsent": 10997, "fail_share": 0.5328, "achieved_rps": 642.9, "p50_ms": 744.15, "p95_ms": 2614.26, "p99_ms": 3707.8, "max_ms": 5197.11, "service_p95_ms": 2613.27, "lag_p99_ms": 2.87, "lag_max_ms": 7.21, "by_kind": {"read": 6769, "write": 1864, "me": 1010}, "ok_by_kind": {"read": 6769, "write": 1864, "me": 1010}, "kind_p95_ms": {"read": 2743.55, "write": 2660.43, "me": 1722.66}, "instances": {"953c63e27ec6": 2411, "9f8f449b9655": 2411, "d68ca40b4f97": 2410, "582877b26df3": 2411}, "peak_inflight": 2172, "gen_cpu_s": 3.479, "procs": 4, "abort": "p95"}
@@ -0,0 +1 @@
{"rate": 250.0, "rate_from": 0.0, "warmup_s": 10.0, "window_s": 15.0, "window_start": 1792104475.53, "window_end": 1792104490.53, "scheduled": 3750, "sent": 3750, "ok": 3750, "errors": 0, "error_kinds": {}, "short_pages": 0, "dropped": 0, "unsent": 0, "fail_share": 0.0, "achieved_rps": 250.0, "p50_ms": 4.08, "p95_ms": 6.37, "p99_ms": 7.77, "max_ms": 12.06, "service_p95_ms": 3.15, "lag_p99_ms": 5.34, "lag_max_ms": 9.73, "by_kind": {"read": 2650, "write": 734, "me": 366}, "ok_by_kind": {"read": 2650, "write": 734, "me": 366}, "kind_p95_ms": {"read": 6.07, "write": 7.06, "me": 5.0}, "instances": {"2f3005fba63a": 937, "cad87396621d": 937, "fcc44546040f": 938, "5b62311c9d5e": 938}, "peak_inflight": 4, "gen_cpu_s": 0.782, "procs": 4, "abort": ""}
@@ -0,0 +1 @@
{"rate": 500.0, "rate_from": 250.0, "warmup_s": 5.0, "window_s": 15.0, "window_start": 1792104496.022, "window_end": 1792104511.022, "scheduled": 7500, "sent": 7500, "ok": 7500, "errors": 0, "error_kinds": {}, "short_pages": 0, "dropped": 0, "unsent": 0, "fail_share": 0.0, "achieved_rps": 500.0, "p50_ms": 2.95, "p95_ms": 4.56, "p99_ms": 5.49, "max_ms": 28.51, "service_p95_ms": 2.45, "lag_p99_ms": 3.15, "lag_max_ms": 9.91, "by_kind": {"read": 5290, "write": 1485, "me": 725}, "ok_by_kind": {"read": 5290, "write": 1485, "me": 725}, "kind_p95_ms": {"read": 4.31, "write": 5.06, "me": 3.43}, "instances": {"2f3005fba63a": 1875, "fcc44546040f": 1875, "cad87396621d": 1875, "5b62311c9d5e": 1875}, "peak_inflight": 15, "gen_cpu_s": 1.238, "procs": 4, "abort": ""}
@@ -0,0 +1 @@
{"rate": 1455.0, "rate_from": 500.0, "warmup_s": 5.0, "window_s": 15.0, "window_start": 1792104516.519, "window_end": 1792104531.519, "scheduled": 21825, "sent": 21825, "ok": 21825, "errors": 0, "error_kinds": {}, "short_pages": 0, "dropped": 0, "unsent": 0, "fail_share": 0.0, "achieved_rps": 1455.0, "p50_ms": 2.47, "p95_ms": 4.77, "p99_ms": 34.55, "max_ms": 142.88, "service_p95_ms": 3.75, "lag_p99_ms": 2.01, "lag_max_ms": 5.86, "by_kind": {"read": 15316, "write": 4367, "me": 2142}, "ok_by_kind": {"read": 15316, "write": 4367, "me": 2142}, "kind_p95_ms": {"read": 4.3, "write": 5.65, "me": 2.92}, "instances": {"cad87396621d": 5456, "fcc44546040f": 5457, "2f3005fba63a": 5456, "5b62311c9d5e": 5456}, "peak_inflight": 59, "gen_cpu_s": 3.684, "procs": 4, "abort": ""}
@@ -0,0 +1 @@
{"rate": 1819.0, "rate_from": 1455.0, "warmup_s": 5.0, "window_s": 15.0, "window_start": 1792104537.003, "window_end": 1792104552.003, "scheduled": 27285, "sent": 27285, "ok": 27285, "errors": 0, "error_kinds": {}, "short_pages": 0, "dropped": 0, "unsent": 0, "fail_share": 0.0, "achieved_rps": 1819.0, "p50_ms": 3.44, "p95_ms": 9.59, "p99_ms": 101.65, "max_ms": 362.49, "service_p95_ms": 9.3, "lag_p99_ms": 1.85, "lag_max_ms": 4.04, "by_kind": {"read": 18948, "write": 5549, "me": 2788}, "ok_by_kind": {"read": 18948, "write": 5549, "me": 2788}, "kind_p95_ms": {"read": 9.1, "write": 13.56, "me": 4.91}, "instances": {"2f3005fba63a": 6821, "cad87396621d": 6822, "5b62311c9d5e": 6821, "fcc44546040f": 6821}, "peak_inflight": 133, "gen_cpu_s": 6.343, "procs": 4, "abort": ""}
@@ -0,0 +1 @@
{"rate": 2274.0, "rate_from": 1819.0, "warmup_s": 5.0, "window_s": 15.0, "window_start": 1792104557.49, "window_end": 1792104572.49, "scheduled": 34110, "sent": 31850, "ok": 27256, "errors": 4594, "error_kinds": {"503": 4569, "ConnectionResetError": 24, "IncompleteReadError": 1}, "short_pages": 0, "dropped": 0, "unsent": 2260, "fail_share": 0.20094, "achieved_rps": 1817.1, "p50_ms": 52.45, "p95_ms": 1867.9, "p99_ms": 3259.46, "max_ms": 5720.11, "service_p95_ms": 1867.19, "lag_p99_ms": 2.31, "lag_max_ms": 7.97, "by_kind": {"read": 22255, "write": 6373, "me": 3222}, "ok_by_kind": {"read": 19031, "write": 5469, "me": 2756}, "kind_p95_ms": {"read": 1941.76, "write": 1982.12, "me": 1260.25}, "instances": {"5b62311c9d5e": 6943, "fcc44546040f": 6742, "2f3005fba63a": 6781, "cad87396621d": 6790}, "peak_inflight": 2231, "gen_cpu_s": 9.084, "procs": 4, "abort": "p95"}
@@ -0,0 +1 @@
{"rate": 2034.0, "rate_from": 0.0, "warmup_s": 10.0, "window_s": 15.0, "window_start": 1792104593.162, "window_end": 1792104608.162, "scheduled": 30510, "sent": 30510, "ok": 30510, "errors": 0, "error_kinds": {}, "short_pages": 0, "dropped": 0, "unsent": 0, "fail_share": 0.0, "achieved_rps": 2034.0, "p50_ms": 5.84, "p95_ms": 413.71, "p99_ms": 1081.54, "max_ms": 3895.83, "service_p95_ms": 413.83, "lag_p99_ms": 1.92, "lag_max_ms": 9.89, "by_kind": {"read": 21287, "write": 6119, "me": 3104}, "ok_by_kind": {"read": 21287, "write": 6119, "me": 3104}, "kind_p95_ms": {"read": 428.66, "write": 434.66, "me": 204.27}, "instances": {"2f3005fba63a": 7627, "cad87396621d": 7628, "5b62311c9d5e": 7627, "fcc44546040f": 7628}, "peak_inflight": 501, "gen_cpu_s": 7.969, "procs": 4, "abort": ""}
@@ -0,0 +1 @@
{"rate": 1923.0, "rate_from": 0.0, "warmup_s": 10.0, "window_s": 15.0, "window_start": 1792104629.06, "window_end": 1792104644.06, "scheduled": 28845, "sent": 28845, "ok": 28845, "errors": 0, "error_kinds": {}, "short_pages": 0, "dropped": 0, "unsent": 0, "fail_share": 0.0, "achieved_rps": 1923.0, "p50_ms": 4.37, "p95_ms": 181.1, "p99_ms": 577.18, "max_ms": 1879.25, "service_p95_ms": 181.18, "lag_p99_ms": 1.91, "lag_max_ms": 10.39, "by_kind": {"read": 20180, "write": 5753, "me": 2912}, "ok_by_kind": {"read": 20180, "write": 5753, "me": 2912}, "kind_p95_ms": {"read": 186.44, "write": 204.93, "me": 96.34}, "instances": {"2f3005fba63a": 7212, "5b62311c9d5e": 7211, "fcc44546040f": 7211, "cad87396621d": 7211}, "peak_inflight": 381, "gen_cpu_s": 7.418, "procs": 4, "abort": ""}
@@ -0,0 +1 @@
{"rate": 250.0, "rate_from": 0.0, "warmup_s": 10.0, "window_s": 15.0, "window_start": 1792104675.758, "window_end": 1792104690.758, "scheduled": 3750, "sent": 3750, "ok": 3750, "errors": 0, "error_kinds": {}, "short_pages": 0, "dropped": 0, "unsent": 0, "fail_share": 0.0, "achieved_rps": 250.0, "p50_ms": 4.22, "p95_ms": 6.62, "p99_ms": 8.45, "max_ms": 20.62, "service_p95_ms": 3.2, "lag_p99_ms": 5.56, "lag_max_ms": 7.84, "by_kind": {"read": 2607, "write": 776, "me": 367}, "ok_by_kind": {"read": 2607, "write": 776, "me": 367}, "kind_p95_ms": {"read": 6.48, "write": 7.15, "me": 5.16}, "instances": {"a8363c9a316d": 937, "427f92730b49": 938, "216b47e9c9e7": 937, "eacea5cd5ba6": 938}, "peak_inflight": 5, "gen_cpu_s": 0.793, "procs": 4, "abort": ""}
@@ -0,0 +1 @@
{"rate": 500.0, "rate_from": 250.0, "warmup_s": 5.0, "window_s": 15.0, "window_start": 1792104696.259, "window_end": 1792104711.259, "scheduled": 7500, "sent": 7500, "ok": 7500, "errors": 0, "error_kinds": {}, "short_pages": 0, "dropped": 0, "unsent": 0, "fail_share": 0.0, "achieved_rps": 500.0, "p50_ms": 3.11, "p95_ms": 4.34, "p99_ms": 5.55, "max_ms": 25.19, "service_p95_ms": 2.5, "lag_p99_ms": 2.77, "lag_max_ms": 4.33, "by_kind": {"read": 5266, "write": 1453, "me": 781}, "ok_by_kind": {"read": 5266, "write": 1453, "me": 781}, "kind_p95_ms": {"read": 4.16, "write": 4.83, "me": 3.32}, "instances": {"a8363c9a316d": 1875, "216b47e9c9e7": 1875, "427f92730b49": 1875, "eacea5cd5ba6": 1875}, "peak_inflight": 12, "gen_cpu_s": 1.266, "procs": 4, "abort": ""}
@@ -0,0 +1 @@
{"rate": 1455.0, "rate_from": 500.0, "warmup_s": 5.0, "window_s": 15.0, "window_start": 1792104716.742, "window_end": 1792104731.742, "scheduled": 21825, "sent": 21825, "ok": 21825, "errors": 0, "error_kinds": {}, "short_pages": 0, "dropped": 0, "unsent": 0, "fail_share": 0.0, "achieved_rps": 1455.0, "p50_ms": 2.99, "p95_ms": 455.46, "p99_ms": 757.5, "max_ms": 1911.82, "service_p95_ms": 455.06, "lag_p99_ms": 2.19, "lag_max_ms": 6.91, "by_kind": {"read": 15389, "write": 4317, "me": 2119}, "ok_by_kind": {"read": 15389, "write": 4317, "me": 2119}, "kind_p95_ms": {"read": 454.83, "write": 517.81, "me": 256.54}, "instances": {"216b47e9c9e7": 5456, "eacea5cd5ba6": 5456, "a8363c9a316d": 5456, "427f92730b49": 5457}, "peak_inflight": 686, "gen_cpu_s": 4.204, "procs": 4, "abort": ""}
@@ -0,0 +1 @@
{"rate": 1164.0, "rate_from": 0.0, "warmup_s": 10.0, "window_s": 15.0, "window_start": 1792104752.794, "window_end": 1792104767.794, "scheduled": 17460, "sent": 17460, "ok": 17460, "errors": 0, "error_kinds": {}, "short_pages": 0, "dropped": 0, "unsent": 0, "fail_share": 0.0, "achieved_rps": 1164.0, "p50_ms": 2.53, "p95_ms": 4.17, "p99_ms": 5.11, "max_ms": 17.37, "service_p95_ms": 2.96, "lag_p99_ms": 2.2, "lag_max_ms": 3.03, "by_kind": {"read": 12308, "write": 3407, "me": 1745}, "ok_by_kind": {"read": 12308, "write": 3407, "me": 1745}, "kind_p95_ms": {"read": 3.91, "write": 4.84, "me": 2.82}, "instances": {"a8363c9a316d": 4366, "216b47e9c9e7": 4365, "427f92730b49": 4365, "eacea5cd5ba6": 4364}, "peak_inflight": 15, "gen_cpu_s": 3.06, "procs": 4, "abort": ""}
@@ -0,0 +1 @@
{"rate": 1301.0, "rate_from": 1164.0, "warmup_s": 5.0, "window_s": 15.0, "window_start": 1792104773.273, "window_end": 1792104788.273, "scheduled": 19515, "sent": 19515, "ok": 19515, "errors": 0, "error_kinds": {}, "short_pages": 0, "dropped": 0, "unsent": 0, "fail_share": 0.0, "achieved_rps": 1301.0, "p50_ms": 2.72, "p95_ms": 4.82, "p99_ms": 14.13, "max_ms": 145.87, "service_p95_ms": 3.82, "lag_p99_ms": 2.09, "lag_max_ms": 4.82, "by_kind": {"read": 13589, "write": 4018, "me": 1908}, "ok_by_kind": {"read": 13589, "write": 4018, "me": 1908}, "kind_p95_ms": {"read": 4.43, "write": 5.95, "me": 2.97}, "instances": {"427f92730b49": 4878, "eacea5cd5ba6": 4879, "216b47e9c9e7": 4879, "a8363c9a316d": 4879}, "peak_inflight": 59, "gen_cpu_s": 3.665, "procs": 4, "abort": ""}
@@ -0,0 +1 @@
{"rate": 1376.0, "rate_from": 1301.0, "warmup_s": 5.0, "window_s": 15.0, "window_start": 1792104793.728, "window_end": 1792104808.728, "scheduled": 20640, "sent": 11025, "ok": 11025, "errors": 0, "error_kinds": {}, "short_pages": 0, "dropped": 0, "unsent": 9615, "fail_share": 0.46584, "achieved_rps": 735.0, "p50_ms": 406.38, "p95_ms": 2656.21, "p99_ms": 3634.3, "max_ms": 5168.25, "service_p95_ms": 2654.77, "lag_p99_ms": 2.62, "lag_max_ms": 8.84, "by_kind": {"read": 7782, "write": 2207, "me": 1036}, "ok_by_kind": {"read": 7782, "write": 2207, "me": 1036}, "kind_p95_ms": {"read": 2719.67, "write": 2813.85, "me": 1674.64}, "instances": {"a8363c9a316d": 2757, "427f92730b49": 2756, "eacea5cd5ba6": 2756, "216b47e9c9e7": 2756}, "peak_inflight": 2100, "gen_cpu_s": 3.55, "procs": 4, "abort": "p95"}
@@ -0,0 +1 @@
{"rate": 250.0, "rate_from": 0.0, "warmup_s": 10.0, "window_s": 15.0, "window_start": 1792104840.392, "window_end": 1792104855.392, "scheduled": 3750, "sent": 3750, "ok": 3750, "errors": 0, "error_kinds": {}, "short_pages": 0, "dropped": 0, "unsent": 0, "fail_share": 0.0, "achieved_rps": 250.0, "p50_ms": 4.08, "p95_ms": 6.5, "p99_ms": 8.51, "max_ms": 20.41, "service_p95_ms": 3.15, "lag_p99_ms": 5.55, "lag_max_ms": 9.88, "by_kind": {"read": 2629, "write": 724, "me": 397}, "ok_by_kind": {"read": 2629, "write": 724, "me": 397}, "kind_p95_ms": {"read": 6.19, "write": 7.23, "me": 5.37}, "instances": {"c9ffede2b04e": 937, "a6c3da659dc3": 938, "51af0c267242": 937, "f8166e538737": 938}, "peak_inflight": 5, "gen_cpu_s": 0.787, "procs": 4, "abort": ""}
@@ -0,0 +1 @@
{"rate": 500.0, "rate_from": 250.0, "warmup_s": 5.0, "window_s": 15.0, "window_start": 1792104860.868, "window_end": 1792104875.868, "scheduled": 7500, "sent": 7500, "ok": 7500, "errors": 0, "error_kinds": {}, "short_pages": 0, "dropped": 0, "unsent": 0, "fail_share": 0.0, "achieved_rps": 500.0, "p50_ms": 3.02, "p95_ms": 4.47, "p99_ms": 5.48, "max_ms": 25.39, "service_p95_ms": 2.47, "lag_p99_ms": 2.95, "lag_max_ms": 4.95, "by_kind": {"read": 5192, "write": 1523, "me": 785}, "ok_by_kind": {"read": 5192, "write": 1523, "me": 785}, "kind_p95_ms": {"read": 4.28, "write": 4.87, "me": 3.15}, "instances": {"c9ffede2b04e": 1875, "f8166e538737": 1875, "a6c3da659dc3": 1875, "51af0c267242": 1875}, "peak_inflight": 13, "gen_cpu_s": 1.251, "procs": 4, "abort": ""}
@@ -0,0 +1 @@
{"rate": 1455.0, "rate_from": 500.0, "warmup_s": 5.0, "window_s": 15.0, "window_start": 1792104881.338, "window_end": 1792104896.338, "scheduled": 21825, "sent": 21825, "ok": 21825, "errors": 0, "error_kinds": {}, "short_pages": 0, "dropped": 0, "unsent": 0, "fail_share": 0.0, "achieved_rps": 1455.0, "p50_ms": 2.61, "p95_ms": 4.91, "p99_ms": 15.36, "max_ms": 153.89, "service_p95_ms": 3.97, "lag_p99_ms": 1.98, "lag_max_ms": 2.9, "by_kind": {"read": 15224, "write": 4398, "me": 2203}, "ok_by_kind": {"read": 15224, "write": 4398, "me": 2203}, "kind_p95_ms": {"read": 4.36, "write": 5.93, "me": 2.92}, "instances": {"c9ffede2b04e": 5456, "a6c3da659dc3": 5457, "51af0c267242": 5456, "f8166e538737": 5456}, "peak_inflight": 60, "gen_cpu_s": 3.731, "procs": 4, "abort": ""}
@@ -0,0 +1 @@
{"rate": 1819.0, "rate_from": 1455.0, "warmup_s": 5.0, "window_s": 15.0, "window_start": 1792104901.829, "window_end": 1792104916.829, "scheduled": 27285, "sent": 27285, "ok": 27285, "errors": 0, "error_kinds": {}, "short_pages": 0, "dropped": 0, "unsent": 0, "fail_share": 0.0, "achieved_rps": 1819.0, "p50_ms": 4.43, "p95_ms": 78.31, "p99_ms": 195.84, "max_ms": 598.57, "service_p95_ms": 78.17, "lag_p99_ms": 1.94, "lag_max_ms": 8.3, "by_kind": {"read": 19042, "write": 5491, "me": 2752}, "ok_by_kind": {"read": 19042, "write": 5491, "me": 2752}, "kind_p95_ms": {"read": 81.44, "write": 92.11, "me": 31.41}, "instances": {"a6c3da659dc3": 6821, "c9ffede2b04e": 6822, "51af0c267242": 6821, "f8166e538737": 6821}, "peak_inflight": 278, "gen_cpu_s": 7.06, "procs": 4, "abort": ""}
@@ -0,0 +1 @@
{"rate": 2274.0, "rate_from": 1819.0, "warmup_s": 5.0, "window_s": 15.0, "window_start": 1792104922.388, "window_end": 1792104937.388, "scheduled": 34110, "sent": 11389, "ok": 6679, "errors": 4710, "error_kinds": {"503": 4541, "ConnectionResetError": 104, "timeout": 64, "IncompleteReadError": 1}, "short_pages": 0, "dropped": 0, "unsent": 22721, "fail_share": 0.80419, "achieved_rps": 445.3, "p50_ms": 783.98, "p95_ms": 3079.38, "p99_ms": 4212.45, "max_ms": 5428.06, "service_p95_ms": 3078.12, "lag_p99_ms": 1.98, "lag_max_ms": 5.5, "by_kind": {"read": 8021, "write": 2264, "me": 1104}, "ok_by_kind": {"read": 4700, "write": 1342, "me": 637}, "kind_p95_ms": {"read": 3107.95, "write": 2972.44, "me": 2407.65}, "instances": {"51af0c267242": 1295, "c9ffede2b04e": 1312, "a6c3da659dc3": 2851, "f8166e538737": 1221}, "peak_inflight": 2721, "gen_cpu_s": 5.226, "procs": 4, "abort": "p95"}
@@ -0,0 +1 @@
{"rate": 2034.0, "rate_from": 0.0, "warmup_s": 10.0, "window_s": 15.0, "window_start": 1792104955.327, "window_end": 1792104970.327, "scheduled": 30510, "sent": 12232, "ok": 11989, "errors": 243, "error_kinds": {"503": 209, "IncompleteReadError": 1, "ConnectionResetError": 33}, "short_pages": 0, "dropped": 0, "unsent": 18278, "fail_share": 0.60705, "achieved_rps": 799.3, "p50_ms": 495.05, "p95_ms": 2814.19, "p99_ms": 4026.26, "max_ms": 5956.63, "service_p95_ms": 2812.59, "lag_p99_ms": 2.29, "lag_max_ms": 18.6, "by_kind": {"read": 8538, "write": 2466, "me": 1228}, "ok_by_kind": {"read": 8381, "write": 2407, "me": 1201}, "kind_p95_ms": {"read": 2889.21, "write": 2916.61, "me": 1845.37}, "instances": {"51af0c267242": 3010, "a6c3da659dc3": 2977, "c9ffede2b04e": 2997, "f8166e538737": 3005}, "peak_inflight": 2512, "gen_cpu_s": 5.549, "procs": 4, "abort": "p95"}
@@ -0,0 +1 @@
{"rate": 1923.0, "rate_from": 0.0, "warmup_s": 10.0, "window_s": 15.0, "window_start": 1792104984.644, "window_end": 1792104999.644, "scheduled": 28845, "sent": 28845, "ok": 28761, "errors": 84, "error_kinds": {"503": 84}, "short_pages": 0, "dropped": 0, "unsent": 0, "fail_share": 0.00291, "achieved_rps": 1917.4, "p50_ms": 60.78, "p95_ms": 1695.09, "p99_ms": 3654.47, "max_ms": 8115.92, "service_p95_ms": 1694.94, "lag_p99_ms": 1.97, "lag_max_ms": 8.92, "by_kind": {"read": 20065, "write": 5883, "me": 2897}, "ok_by_kind": {"read": 20004, "write": 5866, "me": 2891}, "kind_p95_ms": {"read": 1710.84, "write": 1742.57, "me": 1122.95}, "instances": {"c9ffede2b04e": 7127, "a6c3da659dc3": 7211, "f8166e538737": 7211, "51af0c267242": 7212}, "peak_inflight": 1249, "gen_cpu_s": 8.43, "procs": 4, "abort": ""}
@@ -0,0 +1 @@
{"rate": 250.0, "rate_from": 0.0, "warmup_s": 10.0, "window_s": 15.0, "window_start": 1792105042.302, "window_end": 1792105057.302, "scheduled": 3750, "sent": 3750, "ok": 3750, "errors": 0, "error_kinds": {}, "short_pages": 0, "dropped": 0, "unsent": 0, "fail_share": 0.0, "achieved_rps": 250.0, "p50_ms": 4.13, "p95_ms": 6.56, "p99_ms": 8.21, "max_ms": 18.7, "service_p95_ms": 3.18, "lag_p99_ms": 5.32, "lag_max_ms": 9.31, "by_kind": {"read": 2613, "write": 761, "me": 376}, "ok_by_kind": {"read": 2613, "write": 761, "me": 376}, "kind_p95_ms": {"read": 6.39, "write": 7.26, "me": 5.16}, "instances": {"ff4dfc8f2ca3": 937, "92229b903242": 938, "26ae7a4d666e": 938, "6a7f46857c82": 937}, "peak_inflight": 5, "gen_cpu_s": 0.796, "procs": 4, "abort": ""}
@@ -0,0 +1 @@
{"rate": 500.0, "rate_from": 250.0, "warmup_s": 5.0, "window_s": 15.0, "window_start": 1792105062.803, "window_end": 1792105077.803, "scheduled": 7500, "sent": 7500, "ok": 7500, "errors": 0, "error_kinds": {}, "short_pages": 0, "dropped": 0, "unsent": 0, "fail_share": 0.0, "achieved_rps": 500.0, "p50_ms": 3.12, "p95_ms": 4.37, "p99_ms": 5.38, "max_ms": 21.11, "service_p95_ms": 2.52, "lag_p99_ms": 2.79, "lag_max_ms": 4.79, "by_kind": {"read": 5261, "write": 1470, "me": 769}, "ok_by_kind": {"read": 5261, "write": 1470, "me": 769}, "kind_p95_ms": {"read": 4.2, "write": 4.91, "me": 3.12}, "instances": {"ff4dfc8f2ca3": 1875, "92229b903242": 1875, "6a7f46857c82": 1875, "26ae7a4d666e": 1875}, "peak_inflight": 10, "gen_cpu_s": 1.26, "procs": 4, "abort": ""}
@@ -0,0 +1 @@
{"rate": 1455.0, "rate_from": 500.0, "warmup_s": 5.0, "window_s": 15.0, "window_start": 1792105083.299, "window_end": 1792105098.299, "scheduled": 21825, "sent": 21825, "ok": 21819, "errors": 6, "error_kinds": {"503": 6}, "short_pages": 0, "dropped": 0, "unsent": 0, "fail_share": 0.00027, "achieved_rps": 1454.6, "p50_ms": 270.95, "p95_ms": 1736.93, "p99_ms": 2761.79, "max_ms": 5874.03, "service_p95_ms": 1736.22, "lag_p99_ms": 2.62, "lag_max_ms": 6.17, "by_kind": {"read": 15324, "write": 4321, "me": 2180}, "ok_by_kind": {"read": 15319, "write": 4320, "me": 2180}, "kind_p95_ms": {"read": 1793.83, "write": 1736.05, "me": 1080.14}, "instances": {"92229b903242": 5457, "6a7f46857c82": 5456, "ff4dfc8f2ca3": 5456, "26ae7a4d666e": 5450}, "peak_inflight": 1621, "gen_cpu_s": 5.207, "procs": 4, "abort": ""}
@@ -0,0 +1 @@
{"rate": 1164.0, "rate_from": 0.0, "warmup_s": 10.0, "window_s": 15.0, "window_start": 1792105120.154, "window_end": 1792105135.154, "scheduled": 17460, "sent": 17460, "ok": 17460, "errors": 0, "error_kinds": {}, "short_pages": 0, "dropped": 0, "unsent": 0, "fail_share": 0.0, "achieved_rps": 1164.0, "p50_ms": 2.6, "p95_ms": 4.53, "p99_ms": 29.11, "max_ms": 198.48, "service_p95_ms": 3.28, "lag_p99_ms": 2.25, "lag_max_ms": 9.41, "by_kind": {"read": 12183, "write": 3548, "me": 1729}, "ok_by_kind": {"read": 12183, "write": 3548, "me": 1729}, "kind_p95_ms": {"read": 4.22, "write": 5.11, "me": 2.93}, "instances": {"6a7f46857c82": 4365, "ff4dfc8f2ca3": 4365, "26ae7a4d666e": 4365, "92229b903242": 4365}, "peak_inflight": 69, "gen_cpu_s": 3.135, "procs": 4, "abort": ""}
@@ -0,0 +1 @@
{"rate": 1301.0, "rate_from": 1164.0, "warmup_s": 5.0, "window_s": 15.0, "window_start": 1792105140.63, "window_end": 1792105155.63, "scheduled": 19515, "sent": 19515, "ok": 19515, "errors": 0, "error_kinds": {}, "short_pages": 0, "dropped": 0, "unsent": 0, "fail_share": 0.0, "achieved_rps": 1301.0, "p50_ms": 2.69, "p95_ms": 4.72, "p99_ms": 7.47, "max_ms": 48.73, "service_p95_ms": 3.69, "lag_p99_ms": 2.08, "lag_max_ms": 6.17, "by_kind": {"read": 13620, "write": 4001, "me": 1894}, "ok_by_kind": {"read": 13620, "write": 4001, "me": 1894}, "kind_p95_ms": {"read": 4.33, "write": 5.62, "me": 2.92}, "instances": {"26ae7a4d666e": 4879, "92229b903242": 4878, "6a7f46857c82": 4879, "ff4dfc8f2ca3": 4879}, "peak_inflight": 52, "gen_cpu_s": 3.669, "procs": 4, "abort": ""}
@@ -0,0 +1 @@
{"rate": 1376.0, "rate_from": 1301.0, "warmup_s": 5.0, "window_s": 15.0, "window_start": 1792105161.102, "window_end": 1792105176.102, "scheduled": 20640, "sent": 8617, "ok": 8617, "errors": 0, "error_kinds": {}, "short_pages": 0, "dropped": 0, "unsent": 12023, "fail_share": 0.58251, "achieved_rps": 574.5, "p50_ms": 852.85, "p95_ms": 2989.41, "p99_ms": 3880.4, "max_ms": 5258.9, "service_p95_ms": 2989.81, "lag_p99_ms": 2.79, "lag_max_ms": 10.36, "by_kind": {"read": 6014, "write": 1742, "me": 861}, "ok_by_kind": {"read": 6014, "write": 1742, "me": 861}, "kind_p95_ms": {"read": 3049.8, "write": 3065.85, "me": 1845.94}, "instances": {"ff4dfc8f2ca3": 2155, "92229b903242": 2154, "6a7f46857c82": 2154, "26ae7a4d666e": 2154}, "peak_inflight": 2356, "gen_cpu_s": 3.45, "procs": 4, "abort": "p95"}
@@ -0,0 +1,40 @@
series,config,repeat,cell,step,phase,rate,rate_from,warmup_s,window_s,scheduled,ok,errors,short_pages,dropped,unsent,fail_share,achieved_rps,p50_ms,p95_ms,p99_ms,max_ms,service_p95_ms,lag_p99_ms,slo_pass,abort,api_cpu_cores,api_cpu_max,api_throttled_max,api_memory_max_mib,db_cpu_cores,db_throttled_share,lb_cpu_cores,cache_cpu_cores,gen_cpu_cores,vm_busy_share,pg_conn_max,pg_conn_replica_max,pg_active_mean,pg_lock_wait_mean,pg_new_sessions,pg_commits_per_s,lb_retries,lb_redispatches,lb_conn_errors,api_cpu_us_per_req,db_cpu_us_per_req,instances,instance_share_min,signals,error_kinds
ab,4x1,1,1,1,fixed,250.0,0.0,10.0,15.0,3750,3750,0,0,0,0,0.0,250.0,4.03,5.66,6.86,13.37,3.03,4.13,True,,0.449,0.113,0.0,70.3,0.06,0.0,0.017,0.007,0.036,0.0694,37,10,0.0,0.0,3,949.4,0,0,0,1796.0,240.0,4,0.25,,
ab,4x1,1,1,2,fixed,500.0,250.0,5.0,15.0,7500,7500,0,0,0,0,0.0,500.0,2.94,3.84,4.47,22.6,2.37,2.32,True,,0.707,0.179,0.0,70.8,0.09,0.0,0.028,0.01,0.061,0.0954,37,10,0.06,0.0,3,1872.1,0,0,0,1414.0,180.0,4,0.25,,
ab,4x1,1,1,3,ladder,1455.0,500.0,5.0,15.0,21825,21825,0,0,0,0,0.0,1455.0,2.42,4.84,46.53,198.06,3.91,1.95,True,,2.325,0.59,0.0,72.5,0.326,0.0,0.108,0.032,0.191,0.3372,40,10,0.38,0.0,26,5578.6,0,0,0,1597.9,224.1,4,0.25,churn,
ab,4x1,1,1,4,ladder,1819.0,1455.0,5.0,15.0,27285,27285,0,0,0,0,0.0,1819.0,3.26,10.2,106.96,366.06,9.73,1.86,True,,3.271,0.829,0.0,76.1,0.593,0.0,0.174,0.054,0.32,0.493,45,15,0.81,0.0,38,6863.1,0,0,0,1798.2,326.0,4,0.25,pool;churn,
ab,4x1,1,1,5,ladder,2274.0,1819.0,5.0,15.0,34110,30888,3222,0,0,0,0.09446,2059.2,118.34,2273.2,3693.09,6195.99,2272.52,1.93,False,,3.515,0.991,0.0375,135.5,0.725,0.0,0.236,0.053,0.482,0.5554,60,15,0.59,0.0,29,7499.5,0,0,0,1707.0,352.1,4,0.211,app;pool;churn,503:3216;ConnectionResetError:5;IncompleteReadError:1
ab,4x1,1,1,6,bisect,2034.0,0.0,10.0,15.0,30510,30510,0,0,0,0,0.0,2034.0,5.37,244.99,533.67,1961.36,244.49,1.93,False,,3.768,0.948,0.02,132.5,0.81,0.0,0.22,0.061,0.423,0.5835,60,15,0.44,0.0,79,7770.2,0,0,0,1852.5,398.2,4,0.25,app;pool;churn,
ab,4x1,1,1,7,bisect,1923.0,0.0,10.0,15.0,28845,28843,2,0,0,0,7e-05,1922.9,67.31,1362.95,2439.09,6389.3,1363.51,1.98,False,,3.911,0.993,0.125,134.6,0.739,0.0,0.222,0.059,0.442,0.5914,60,15,0.65,0.0,33,7095.9,0,0,0,2033.9,384.3,4,0.25,app;pool;churn,503:2
ab,4x1-pg0.5,1,2,1,fixed,250.0,0.0,10.0,15.0,3750,3750,0,0,0,0,0.0,250.0,3.99,5.92,7.03,19.66,3.08,4.23,True,,0.454,0.114,0.0,70.9,0.061,0.0,0.018,0.007,0.037,0.0695,40,10,0.06,0.0,3,949.9,0,0,0,1816.0,244.0,4,0.25,,
ab,4x1-pg0.5,1,2,2,fixed,500.0,250.0,5.0,15.0,7500,7500,0,0,0,0,0.0,500.0,2.76,4.3,5.44,27.94,2.48,2.66,True,,0.742,0.187,0.0,71.0,0.094,0.0,0.029,0.01,0.065,0.102,40,10,0.12,0.0,3,1873.1,0,0,0,1484.0,188.0,4,0.25,,
ab,4x1-pg0.5,1,2,3,ladder,1455.0,500.0,5.0,15.0,21825,21825,0,0,0,0,0.0,1455.0,234.35,1354.16,2183.0,4325.0,1353.23,2.17,False,,2.297,0.582,0.0,104.5,0.447,0.6937,0.143,0.035,0.274,0.3501,60,15,2.18,0.0,36,5320.6,0,0,0,1578.7,307.2,4,0.25,db_cpu;pool;churn,
ab,4x1-pg0.5,1,2,4,ladder,1164.0,0.0,10.0,15.0,17460,17460,0,0,0,0,0.0,1164.0,2.58,4.35,9.27,152.95,3.12,2.26,True,,1.884,0.476,0.0,102.0,0.246,0.0,0.081,0.024,0.151,0.269,40,10,0.31,0.0,8,4443.1,0,0,0,1618.6,211.3,4,0.25,,
ab,4x1-pg0.5,1,2,5,bisect,1301.0,1164.0,5.0,15.0,19515,19515,0,0,0,0,0.0,1301.0,2.66,4.63,9.81,165.6,3.6,2.08,True,,2.246,0.568,0.0133,102.4,0.302,0.0067,0.101,0.03,0.185,0.3263,40,10,0.25,0.0,13,4992.4,0,0,0,1726.4,232.1,4,0.25,,
ab,4x1-pg0.5,1,2,6,bisect,1376.0,1301.0,5.0,15.0,20640,9643,0,0,0,10997,0.5328,642.9,744.15,2614.26,3707.8,5197.11,2613.27,2.87,False,p95,2.017,0.511,0.0,112.6,0.499,0.9667,0.14,0.031,0.293,0.3242,60,15,3.5,0.0,27,4422.6,0,0,0,3137.3,776.2,4,0.25,db_cpu;pool;churn,
ab,4x1,2,3,1,fixed,250.0,0.0,10.0,15.0,3750,3750,0,0,0,0,0.0,250.0,4.08,6.37,7.77,12.06,3.15,5.34,True,,0.461,0.116,0.0,71.0,0.062,0.0,0.018,0.007,0.037,0.0715,40,10,0.0,0.0,3,966.3,0,0,0,1844.0,248.0,4,0.25,,
ab,4x1,2,3,2,fixed,500.0,250.0,5.0,15.0,7500,7500,0,0,0,0,0.0,500.0,2.95,4.56,5.49,28.51,2.45,3.15,True,,0.727,0.183,0.0,71.1,0.092,0.0,0.029,0.01,0.064,0.108,40,10,0.18,0.0,3,1934.3,0,0,0,1454.0,184.0,4,0.25,,
ab,4x1,2,3,3,ladder,1455.0,500.0,5.0,15.0,21825,21825,0,0,0,0,0.0,1455.0,2.47,4.77,34.55,142.88,3.75,2.01,True,,2.352,0.598,0.0067,71.6,0.329,0.0,0.109,0.033,0.203,0.3442,45,15,0.38,0.0,24,5556.6,0,0,0,1616.5,226.1,4,0.25,pool;churn,
ab,4x1,2,3,4,ladder,1819.0,1455.0,5.0,15.0,27285,27285,0,0,0,0,0.0,1819.0,3.44,9.59,101.65,362.49,9.3,1.85,True,,3.348,0.844,0.0,75.5,0.623,0.0,0.183,0.055,0.334,0.5095,45,15,0.41,0.0,28,6650.3,0,0,0,1840.6,342.5,4,0.25,pool;churn,
ab,4x1,2,3,5,ladder,2274.0,1819.0,5.0,15.0,34110,27256,4594,0,0,2260,0.20094,1817.1,52.45,1867.9,3259.46,5720.11,1867.19,2.31,False,p95,3.404,0.866,0.0284,126.5,0.695,0.0,0.232,0.056,0.479,0.54,60,15,0.31,0.0,30,7065.9,1048,1700,4979,1873.3,382.5,4,0.247,app;pool;churn,503:4569;ConnectionResetError:24;IncompleteReadError:1
ab,4x1,2,3,6,bisect,2034.0,0.0,10.0,15.0,30510,30510,0,0,0,0,0.0,2034.0,5.84,413.71,1081.54,3895.83,413.83,1.92,False,,3.787,0.953,0.02,123.7,0.815,0.0,0.223,0.055,0.427,0.5865,60,15,0.81,0.0,82,7711.2,0,0,0,1861.8,400.7,4,0.25,app;pool;churn,
ab,4x1,2,3,7,bisect,1923.0,0.0,10.0,15.0,28845,28845,0,0,0,0,0.0,1923.0,4.37,181.1,577.18,1879.25,181.18,1.91,True,,3.665,0.923,0.0125,125.4,0.713,0.0,0.209,0.056,0.398,0.5599,60,15,0.29,0.0,74,7294.4,0,0,0,1905.9,370.8,4,0.25,app;pool;churn,
ab,4x1-pg0.5,2,4,1,fixed,250.0,0.0,10.0,15.0,3750,3750,0,0,0,0,0.0,250.0,4.22,6.62,8.45,20.62,3.2,5.56,True,,0.471,0.119,0.0,71.1,0.064,0.0,0.018,0.007,0.038,0.0759,40,10,0.06,0.0,3,963.1,0,0,0,1884.0,256.0,4,0.25,,
ab,4x1-pg0.5,2,4,2,fixed,500.0,250.0,5.0,15.0,7500,7500,0,0,0,0,0.0,500.0,3.11,4.34,5.55,25.19,2.5,2.77,True,,0.749,0.189,0.0,71.2,0.095,0.0,0.029,0.01,0.065,0.1137,40,10,0.12,0.0,3,1917.2,0,0,0,1498.0,190.0,4,0.25,,
ab,4x1-pg0.5,2,4,3,ladder,1455.0,500.0,5.0,15.0,21825,21825,0,0,0,0,0.0,1455.0,2.99,455.46,757.5,1911.82,455.06,2.19,False,,2.411,0.604,0.0067,85.2,0.374,0.2133,0.122,0.036,0.228,0.3584,60,15,0.62,0.0,41,5436.6,0,0,0,1657.0,257.0,4,0.25,pool;churn,
ab,4x1-pg0.5,2,4,4,ladder,1164.0,0.0,10.0,15.0,17460,17460,0,0,0,0,0.0,1164.0,2.53,4.17,5.11,17.37,2.96,2.2,True,,1.851,0.465,0.0,86.0,0.244,0.0,0.079,0.024,0.151,0.2655,40,10,0.31,0.0,3,4372.4,0,0,0,1590.2,209.6,4,0.25,,
ab,4x1-pg0.5,2,4,5,bisect,1301.0,1164.0,5.0,15.0,19515,19515,0,0,0,0,0.0,1301.0,2.72,4.82,14.13,145.87,3.82,2.09,True,,2.277,0.574,0.0,86.1,0.311,0.0252,0.102,0.031,0.188,0.3309,40,10,0.24,0.0,13,4985.1,0,0,0,1750.2,239.0,4,0.25,,
ab,4x1-pg0.5,2,4,6,bisect,1376.0,1301.0,5.0,15.0,20640,11025,0,0,0,9615,0.46584,735.0,406.38,2656.21,3634.3,5168.25,2654.77,2.62,False,p95,2.16,0.547,0.0,108.4,0.439,0.6333,0.13,0.031,0.274,0.3342,60,15,1.0,0.0,22,4643.4,0,0,0,2938.8,597.3,4,0.25,db_cpu;pool;churn,
ab,4x1,3,5,1,fixed,250.0,0.0,10.0,15.0,3750,3750,0,0,0,0,0.0,250.0,4.08,6.5,8.51,20.41,3.15,5.55,True,,0.463,0.117,0.0,70.6,0.061,0.0,0.018,0.007,0.037,0.0719,40,10,0.19,0.0,3,949.0,0,0,0,1852.0,244.0,4,0.25,,
ab,4x1,3,5,2,fixed,500.0,250.0,5.0,15.0,7500,7500,0,0,0,0,0.0,500.0,3.02,4.47,5.48,25.39,2.47,2.95,True,,0.728,0.185,0.0,71.0,0.092,0.0,0.029,0.01,0.065,0.1074,40,10,0.12,0.0,3,1925.3,0,0,0,1456.0,184.0,4,0.25,,
ab,4x1,3,5,3,ladder,1455.0,500.0,5.0,15.0,21825,21825,0,0,0,0,0.0,1455.0,2.61,4.91,15.36,153.89,3.97,1.98,True,,2.464,0.627,0.0,71.6,0.346,0.0,0.116,0.035,0.206,0.3608,40,10,0.25,0.0,18,5483.4,0,0,0,1693.5,237.8,4,0.25,,
ab,4x1,3,5,4,ladder,1819.0,1455.0,5.0,15.0,27285,27285,0,0,0,0,0.0,1819.0,4.43,78.31,195.84,598.57,78.17,1.94,True,,3.642,0.919,0.0063,80.3,0.693,0.0,0.198,0.058,0.375,0.5528,52,15,0.71,0.0,61,6869.5,0,0,0,2002.2,381.0,4,0.25,app;pool;churn,
ab,4x1,3,5,5,ladder,2274.0,1819.0,5.0,15.0,34110,6679,4710,0,0,22721,0.80419,445.3,783.98,3079.38,4212.45,5428.06,3078.12,1.98,False,p95,1.489,0.5,0.0133,138.4,0.268,0.0,0.11,0.024,0.247,0.2378,60,15,0.46,0.0,3,2719.8,0,0,0,3343.8,601.8,4,0.183,pool,503:4541;ConnectionResetError:104;IncompleteReadError:1;timeout:64
ab,4x1,3,5,6,bisect,2034.0,0.0,10.0,15.0,30510,11989,243,0,0,18278,0.60705,799.3,495.05,2814.19,4026.26,5956.63,2812.59,2.29,False,p95,3.236,0.819,0.0244,142.1,0.583,0.0,0.199,0.047,0.456,0.4971,60,15,0.3,0.0,22,5330.5,0,0,0,4048.5,729.4,4,0.248,pool;churn,503:209;ConnectionResetError:33;IncompleteReadError:1
ab,4x1,3,5,7,bisect,1923.0,0.0,10.0,15.0,28845,28761,84,0,0,0,0.00291,1917.4,60.78,1695.09,3654.47,8115.92,1694.94,1.97,False,,3.927,0.987,0.1062,141.9,0.737,0.0,0.225,0.056,0.452,0.5944,60,15,0.53,0.0,39,7159.4,0,0,0,2048.1,384.4,4,0.248,app;pool;churn,503:84
ab,4x1-pg0.5,3,6,1,fixed,250.0,0.0,10.0,15.0,3750,3750,0,0,0,0,0.0,250.0,4.13,6.56,8.21,18.7,3.18,5.32,True,,0.466,0.117,0.0,70.7,0.061,0.0,0.018,0.007,0.038,0.0751,39,10,0.31,0.0,3,951.1,0,0,0,1864.0,244.0,4,0.25,,
ab,4x1-pg0.5,3,6,2,fixed,500.0,250.0,5.0,15.0,7500,7500,0,0,0,0,0.0,500.0,3.12,4.37,5.38,21.11,2.52,2.79,True,,0.746,0.188,0.0,71.1,0.093,0.0,0.029,0.01,0.065,0.1115,39,10,0.12,0.0,3,1927.4,0,0,0,1492.0,186.0,4,0.25,,
ab,4x1-pg0.5,3,6,3,ladder,1455.0,500.0,5.0,15.0,21825,21819,6,0,0,0,0.00027,1454.6,270.95,1736.93,2761.79,5874.03,1736.22,2.62,False,,2.299,0.575,0.0,110.1,0.452,0.725,0.144,0.035,0.284,0.3535,60,15,1.59,0.0,40,5225.0,0,0,0,1580.5,310.7,4,0.25,db_cpu;pool;churn,503:6
ab,4x1-pg0.5,3,6,4,ladder,1164.0,0.0,10.0,15.0,17460,17460,0,0,0,0,0.0,1164.0,2.6,4.53,29.11,198.48,3.28,2.25,True,,1.921,0.483,0.0,107.7,0.254,0.0067,0.083,0.025,0.157,0.2745,40,10,0.31,0.0,18,4404.0,0,0,0,1650.3,218.2,4,0.25,,
ab,4x1-pg0.5,3,6,5,bisect,1301.0,1164.0,5.0,15.0,19515,19515,0,0,0,0,0.0,1301.0,2.69,4.72,7.47,48.73,3.69,2.08,True,,2.263,0.568,0.0,107.8,0.303,0.0133,0.1,0.03,0.184,0.3277,40,10,0.19,0.0,3,4955.7,0,0,0,1739.4,232.9,4,0.25,,
ab,4x1-pg0.5,3,6,6,bisect,1376.0,1301.0,5.0,15.0,20640,8617,0,0,0,12023,0.58251,574.5,852.85,2989.41,3880.4,5258.9,2989.81,2.79,False,p95,1.975,0.496,0.0,113.4,0.5,1.0,0.141,0.031,0.305,0.3206,60,15,2.67,0.0,15,4364.5,0,0,0,3437.8,870.3,4,0.25,db_cpu;pool,
1 series config repeat cell step phase rate rate_from warmup_s window_s scheduled ok errors short_pages dropped unsent fail_share achieved_rps p50_ms p95_ms p99_ms max_ms service_p95_ms lag_p99_ms slo_pass abort api_cpu_cores api_cpu_max api_throttled_max api_memory_max_mib db_cpu_cores db_throttled_share lb_cpu_cores cache_cpu_cores gen_cpu_cores vm_busy_share pg_conn_max pg_conn_replica_max pg_active_mean pg_lock_wait_mean pg_new_sessions pg_commits_per_s lb_retries lb_redispatches lb_conn_errors api_cpu_us_per_req db_cpu_us_per_req instances instance_share_min signals error_kinds
2 ab 4x1 1 1 1 fixed 250.0 0.0 10.0 15.0 3750 3750 0 0 0 0 0.0 250.0 4.03 5.66 6.86 13.37 3.03 4.13 True 0.449 0.113 0.0 70.3 0.06 0.0 0.017 0.007 0.036 0.0694 37 10 0.0 0.0 3 949.4 0 0 0 1796.0 240.0 4 0.25
3 ab 4x1 1 1 2 fixed 500.0 250.0 5.0 15.0 7500 7500 0 0 0 0 0.0 500.0 2.94 3.84 4.47 22.6 2.37 2.32 True 0.707 0.179 0.0 70.8 0.09 0.0 0.028 0.01 0.061 0.0954 37 10 0.06 0.0 3 1872.1 0 0 0 1414.0 180.0 4 0.25
4 ab 4x1 1 1 3 ladder 1455.0 500.0 5.0 15.0 21825 21825 0 0 0 0 0.0 1455.0 2.42 4.84 46.53 198.06 3.91 1.95 True 2.325 0.59 0.0 72.5 0.326 0.0 0.108 0.032 0.191 0.3372 40 10 0.38 0.0 26 5578.6 0 0 0 1597.9 224.1 4 0.25 churn
5 ab 4x1 1 1 4 ladder 1819.0 1455.0 5.0 15.0 27285 27285 0 0 0 0 0.0 1819.0 3.26 10.2 106.96 366.06 9.73 1.86 True 3.271 0.829 0.0 76.1 0.593 0.0 0.174 0.054 0.32 0.493 45 15 0.81 0.0 38 6863.1 0 0 0 1798.2 326.0 4 0.25 pool;churn
6 ab 4x1 1 1 5 ladder 2274.0 1819.0 5.0 15.0 34110 30888 3222 0 0 0 0.09446 2059.2 118.34 2273.2 3693.09 6195.99 2272.52 1.93 False 3.515 0.991 0.0375 135.5 0.725 0.0 0.236 0.053 0.482 0.5554 60 15 0.59 0.0 29 7499.5 0 0 0 1707.0 352.1 4 0.211 app;pool;churn 503:3216;ConnectionResetError:5;IncompleteReadError:1
7 ab 4x1 1 1 6 bisect 2034.0 0.0 10.0 15.0 30510 30510 0 0 0 0 0.0 2034.0 5.37 244.99 533.67 1961.36 244.49 1.93 False 3.768 0.948 0.02 132.5 0.81 0.0 0.22 0.061 0.423 0.5835 60 15 0.44 0.0 79 7770.2 0 0 0 1852.5 398.2 4 0.25 app;pool;churn
8 ab 4x1 1 1 7 bisect 1923.0 0.0 10.0 15.0 28845 28843 2 0 0 0 7e-05 1922.9 67.31 1362.95 2439.09 6389.3 1363.51 1.98 False 3.911 0.993 0.125 134.6 0.739 0.0 0.222 0.059 0.442 0.5914 60 15 0.65 0.0 33 7095.9 0 0 0 2033.9 384.3 4 0.25 app;pool;churn 503:2
9 ab 4x1-pg0.5 1 2 1 fixed 250.0 0.0 10.0 15.0 3750 3750 0 0 0 0 0.0 250.0 3.99 5.92 7.03 19.66 3.08 4.23 True 0.454 0.114 0.0 70.9 0.061 0.0 0.018 0.007 0.037 0.0695 40 10 0.06 0.0 3 949.9 0 0 0 1816.0 244.0 4 0.25
10 ab 4x1-pg0.5 1 2 2 fixed 500.0 250.0 5.0 15.0 7500 7500 0 0 0 0 0.0 500.0 2.76 4.3 5.44 27.94 2.48 2.66 True 0.742 0.187 0.0 71.0 0.094 0.0 0.029 0.01 0.065 0.102 40 10 0.12 0.0 3 1873.1 0 0 0 1484.0 188.0 4 0.25
11 ab 4x1-pg0.5 1 2 3 ladder 1455.0 500.0 5.0 15.0 21825 21825 0 0 0 0 0.0 1455.0 234.35 1354.16 2183.0 4325.0 1353.23 2.17 False 2.297 0.582 0.0 104.5 0.447 0.6937 0.143 0.035 0.274 0.3501 60 15 2.18 0.0 36 5320.6 0 0 0 1578.7 307.2 4 0.25 db_cpu;pool;churn
12 ab 4x1-pg0.5 1 2 4 ladder 1164.0 0.0 10.0 15.0 17460 17460 0 0 0 0 0.0 1164.0 2.58 4.35 9.27 152.95 3.12 2.26 True 1.884 0.476 0.0 102.0 0.246 0.0 0.081 0.024 0.151 0.269 40 10 0.31 0.0 8 4443.1 0 0 0 1618.6 211.3 4 0.25
13 ab 4x1-pg0.5 1 2 5 bisect 1301.0 1164.0 5.0 15.0 19515 19515 0 0 0 0 0.0 1301.0 2.66 4.63 9.81 165.6 3.6 2.08 True 2.246 0.568 0.0133 102.4 0.302 0.0067 0.101 0.03 0.185 0.3263 40 10 0.25 0.0 13 4992.4 0 0 0 1726.4 232.1 4 0.25
14 ab 4x1-pg0.5 1 2 6 bisect 1376.0 1301.0 5.0 15.0 20640 9643 0 0 0 10997 0.5328 642.9 744.15 2614.26 3707.8 5197.11 2613.27 2.87 False p95 2.017 0.511 0.0 112.6 0.499 0.9667 0.14 0.031 0.293 0.3242 60 15 3.5 0.0 27 4422.6 0 0 0 3137.3 776.2 4 0.25 db_cpu;pool;churn
15 ab 4x1 2 3 1 fixed 250.0 0.0 10.0 15.0 3750 3750 0 0 0 0 0.0 250.0 4.08 6.37 7.77 12.06 3.15 5.34 True 0.461 0.116 0.0 71.0 0.062 0.0 0.018 0.007 0.037 0.0715 40 10 0.0 0.0 3 966.3 0 0 0 1844.0 248.0 4 0.25
16 ab 4x1 2 3 2 fixed 500.0 250.0 5.0 15.0 7500 7500 0 0 0 0 0.0 500.0 2.95 4.56 5.49 28.51 2.45 3.15 True 0.727 0.183 0.0 71.1 0.092 0.0 0.029 0.01 0.064 0.108 40 10 0.18 0.0 3 1934.3 0 0 0 1454.0 184.0 4 0.25
17 ab 4x1 2 3 3 ladder 1455.0 500.0 5.0 15.0 21825 21825 0 0 0 0 0.0 1455.0 2.47 4.77 34.55 142.88 3.75 2.01 True 2.352 0.598 0.0067 71.6 0.329 0.0 0.109 0.033 0.203 0.3442 45 15 0.38 0.0 24 5556.6 0 0 0 1616.5 226.1 4 0.25 pool;churn
18 ab 4x1 2 3 4 ladder 1819.0 1455.0 5.0 15.0 27285 27285 0 0 0 0 0.0 1819.0 3.44 9.59 101.65 362.49 9.3 1.85 True 3.348 0.844 0.0 75.5 0.623 0.0 0.183 0.055 0.334 0.5095 45 15 0.41 0.0 28 6650.3 0 0 0 1840.6 342.5 4 0.25 pool;churn
19 ab 4x1 2 3 5 ladder 2274.0 1819.0 5.0 15.0 34110 27256 4594 0 0 2260 0.20094 1817.1 52.45 1867.9 3259.46 5720.11 1867.19 2.31 False p95 3.404 0.866 0.0284 126.5 0.695 0.0 0.232 0.056 0.479 0.54 60 15 0.31 0.0 30 7065.9 1048 1700 4979 1873.3 382.5 4 0.247 app;pool;churn 503:4569;ConnectionResetError:24;IncompleteReadError:1
20 ab 4x1 2 3 6 bisect 2034.0 0.0 10.0 15.0 30510 30510 0 0 0 0 0.0 2034.0 5.84 413.71 1081.54 3895.83 413.83 1.92 False 3.787 0.953 0.02 123.7 0.815 0.0 0.223 0.055 0.427 0.5865 60 15 0.81 0.0 82 7711.2 0 0 0 1861.8 400.7 4 0.25 app;pool;churn
21 ab 4x1 2 3 7 bisect 1923.0 0.0 10.0 15.0 28845 28845 0 0 0 0 0.0 1923.0 4.37 181.1 577.18 1879.25 181.18 1.91 True 3.665 0.923 0.0125 125.4 0.713 0.0 0.209 0.056 0.398 0.5599 60 15 0.29 0.0 74 7294.4 0 0 0 1905.9 370.8 4 0.25 app;pool;churn
22 ab 4x1-pg0.5 2 4 1 fixed 250.0 0.0 10.0 15.0 3750 3750 0 0 0 0 0.0 250.0 4.22 6.62 8.45 20.62 3.2 5.56 True 0.471 0.119 0.0 71.1 0.064 0.0 0.018 0.007 0.038 0.0759 40 10 0.06 0.0 3 963.1 0 0 0 1884.0 256.0 4 0.25
23 ab 4x1-pg0.5 2 4 2 fixed 500.0 250.0 5.0 15.0 7500 7500 0 0 0 0 0.0 500.0 3.11 4.34 5.55 25.19 2.5 2.77 True 0.749 0.189 0.0 71.2 0.095 0.0 0.029 0.01 0.065 0.1137 40 10 0.12 0.0 3 1917.2 0 0 0 1498.0 190.0 4 0.25
24 ab 4x1-pg0.5 2 4 3 ladder 1455.0 500.0 5.0 15.0 21825 21825 0 0 0 0 0.0 1455.0 2.99 455.46 757.5 1911.82 455.06 2.19 False 2.411 0.604 0.0067 85.2 0.374 0.2133 0.122 0.036 0.228 0.3584 60 15 0.62 0.0 41 5436.6 0 0 0 1657.0 257.0 4 0.25 pool;churn
25 ab 4x1-pg0.5 2 4 4 ladder 1164.0 0.0 10.0 15.0 17460 17460 0 0 0 0 0.0 1164.0 2.53 4.17 5.11 17.37 2.96 2.2 True 1.851 0.465 0.0 86.0 0.244 0.0 0.079 0.024 0.151 0.2655 40 10 0.31 0.0 3 4372.4 0 0 0 1590.2 209.6 4 0.25
26 ab 4x1-pg0.5 2 4 5 bisect 1301.0 1164.0 5.0 15.0 19515 19515 0 0 0 0 0.0 1301.0 2.72 4.82 14.13 145.87 3.82 2.09 True 2.277 0.574 0.0 86.1 0.311 0.0252 0.102 0.031 0.188 0.3309 40 10 0.24 0.0 13 4985.1 0 0 0 1750.2 239.0 4 0.25
27 ab 4x1-pg0.5 2 4 6 bisect 1376.0 1301.0 5.0 15.0 20640 11025 0 0 0 9615 0.46584 735.0 406.38 2656.21 3634.3 5168.25 2654.77 2.62 False p95 2.16 0.547 0.0 108.4 0.439 0.6333 0.13 0.031 0.274 0.3342 60 15 1.0 0.0 22 4643.4 0 0 0 2938.8 597.3 4 0.25 db_cpu;pool;churn
28 ab 4x1 3 5 1 fixed 250.0 0.0 10.0 15.0 3750 3750 0 0 0 0 0.0 250.0 4.08 6.5 8.51 20.41 3.15 5.55 True 0.463 0.117 0.0 70.6 0.061 0.0 0.018 0.007 0.037 0.0719 40 10 0.19 0.0 3 949.0 0 0 0 1852.0 244.0 4 0.25
29 ab 4x1 3 5 2 fixed 500.0 250.0 5.0 15.0 7500 7500 0 0 0 0 0.0 500.0 3.02 4.47 5.48 25.39 2.47 2.95 True 0.728 0.185 0.0 71.0 0.092 0.0 0.029 0.01 0.065 0.1074 40 10 0.12 0.0 3 1925.3 0 0 0 1456.0 184.0 4 0.25
30 ab 4x1 3 5 3 ladder 1455.0 500.0 5.0 15.0 21825 21825 0 0 0 0 0.0 1455.0 2.61 4.91 15.36 153.89 3.97 1.98 True 2.464 0.627 0.0 71.6 0.346 0.0 0.116 0.035 0.206 0.3608 40 10 0.25 0.0 18 5483.4 0 0 0 1693.5 237.8 4 0.25
31 ab 4x1 3 5 4 ladder 1819.0 1455.0 5.0 15.0 27285 27285 0 0 0 0 0.0 1819.0 4.43 78.31 195.84 598.57 78.17 1.94 True 3.642 0.919 0.0063 80.3 0.693 0.0 0.198 0.058 0.375 0.5528 52 15 0.71 0.0 61 6869.5 0 0 0 2002.2 381.0 4 0.25 app;pool;churn
32 ab 4x1 3 5 5 ladder 2274.0 1819.0 5.0 15.0 34110 6679 4710 0 0 22721 0.80419 445.3 783.98 3079.38 4212.45 5428.06 3078.12 1.98 False p95 1.489 0.5 0.0133 138.4 0.268 0.0 0.11 0.024 0.247 0.2378 60 15 0.46 0.0 3 2719.8 0 0 0 3343.8 601.8 4 0.183 pool 503:4541;ConnectionResetError:104;IncompleteReadError:1;timeout:64
33 ab 4x1 3 5 6 bisect 2034.0 0.0 10.0 15.0 30510 11989 243 0 0 18278 0.60705 799.3 495.05 2814.19 4026.26 5956.63 2812.59 2.29 False p95 3.236 0.819 0.0244 142.1 0.583 0.0 0.199 0.047 0.456 0.4971 60 15 0.3 0.0 22 5330.5 0 0 0 4048.5 729.4 4 0.248 pool;churn 503:209;ConnectionResetError:33;IncompleteReadError:1
34 ab 4x1 3 5 7 bisect 1923.0 0.0 10.0 15.0 28845 28761 84 0 0 0 0.00291 1917.4 60.78 1695.09 3654.47 8115.92 1694.94 1.97 False 3.927 0.987 0.1062 141.9 0.737 0.0 0.225 0.056 0.452 0.5944 60 15 0.53 0.0 39 7159.4 0 0 0 2048.1 384.4 4 0.248 app;pool;churn 503:84
35 ab 4x1-pg0.5 3 6 1 fixed 250.0 0.0 10.0 15.0 3750 3750 0 0 0 0 0.0 250.0 4.13 6.56 8.21 18.7 3.18 5.32 True 0.466 0.117 0.0 70.7 0.061 0.0 0.018 0.007 0.038 0.0751 39 10 0.31 0.0 3 951.1 0 0 0 1864.0 244.0 4 0.25
36 ab 4x1-pg0.5 3 6 2 fixed 500.0 250.0 5.0 15.0 7500 7500 0 0 0 0 0.0 500.0 3.12 4.37 5.38 21.11 2.52 2.79 True 0.746 0.188 0.0 71.1 0.093 0.0 0.029 0.01 0.065 0.1115 39 10 0.12 0.0 3 1927.4 0 0 0 1492.0 186.0 4 0.25
37 ab 4x1-pg0.5 3 6 3 ladder 1455.0 500.0 5.0 15.0 21825 21819 6 0 0 0 0.00027 1454.6 270.95 1736.93 2761.79 5874.03 1736.22 2.62 False 2.299 0.575 0.0 110.1 0.452 0.725 0.144 0.035 0.284 0.3535 60 15 1.59 0.0 40 5225.0 0 0 0 1580.5 310.7 4 0.25 db_cpu;pool;churn 503:6
38 ab 4x1-pg0.5 3 6 4 ladder 1164.0 0.0 10.0 15.0 17460 17460 0 0 0 0 0.0 1164.0 2.6 4.53 29.11 198.48 3.28 2.25 True 1.921 0.483 0.0 107.7 0.254 0.0067 0.083 0.025 0.157 0.2745 40 10 0.31 0.0 18 4404.0 0 0 0 1650.3 218.2 4 0.25
39 ab 4x1-pg0.5 3 6 5 bisect 1301.0 1164.0 5.0 15.0 19515 19515 0 0 0 0 0.0 1301.0 2.69 4.72 7.47 48.73 3.69 2.08 True 2.263 0.568 0.0 107.8 0.303 0.0133 0.1 0.03 0.184 0.3277 40 10 0.19 0.0 3 4955.7 0 0 0 1739.4 232.9 4 0.25
40 ab 4x1-pg0.5 3 6 6 bisect 1376.0 1301.0 5.0 15.0 20640 8617 0 0 0 12023 0.58251 574.5 852.85 2989.41 3880.4 5258.9 2989.81 2.79 False p95 1.975 0.496 0.0 113.4 0.5 1.0 0.141 0.031 0.305 0.3206 60 15 2.67 0.0 15 4364.5 0 0 0 3437.8 870.3 4 0.25 db_cpu;pool
File diff suppressed because it is too large Load Diff
@@ -0,0 +1,7 @@
series,config,replicas,api_cpus,db_cpus,repeat,cell,r_star,first_fail,p95_at_r_star,signals_at_fail,generator_bound,steps,fill_rps,duration_s,flags
ab,4x1,4,1.0,2.0,1,1,1819,1923,10.2,app;pool;churn,False,7,1926.9,204.6,
ab,4x1-pg0.5,4,1.0,0.5,1,2,1301,1376,4.63,db_cpu;pool;churn,False,6,953.1,166.7,
ab,4x1,4,1.0,2.0,2,3,1923,2034,181.1,app;pool;churn,False,7,1739.9,193.6,
ab,4x1-pg0.5,4,1.0,0.5,2,4,1301,1376,4.82,db_cpu;pool;churn,False,6,944.2,167.6,
ab,4x1,4,1.0,2.0,3,5,1819,1923,78.31,app;pool;churn,False,7,1691.3,195.6,
ab,4x1-pg0.5,4,1.0,0.5,3,6,1301,1376,4.72,db_cpu;pool,False,6,946.7,166.9,
1 series config replicas api_cpus db_cpus repeat cell r_star first_fail p95_at_r_star signals_at_fail generator_bound steps fill_rps duration_s flags
2 ab 4x1 4 1.0 2.0 1 1 1819 1923 10.2 app;pool;churn False 7 1926.9 204.6
3 ab 4x1-pg0.5 4 1.0 0.5 1 2 1301 1376 4.63 db_cpu;pool;churn False 6 953.1 166.7
4 ab 4x1 4 1.0 2.0 2 3 1923 2034 181.1 app;pool;churn False 7 1739.9 193.6
5 ab 4x1-pg0.5 4 1.0 0.5 2 4 1301 1376 4.82 db_cpu;pool;churn False 6 944.2 167.6
6 ab 4x1 4 1.0 2.0 3 5 1819 1923 78.31 app;pool;churn False 7 1691.3 195.6
7 ab 4x1-pg0.5 4 1.0 0.5 3 6 1301 1376 4.72 db_cpu;pool False 6 946.7 166.9
@@ -0,0 +1,65 @@
{
"postgres": {
"image": "postgres:18.6-trixie@sha256:5a5a84b19854a9ffaa54082c166ff4ec27473a361e496e5ea167f298f2da9722",
"version": "18.6 (Debian 18.6-1.pgdg13+2)",
"settings": {
"checkpoint_timeout": "5min",
"fsync": "on",
"jit": "on",
"max_connections": "100",
"max_wal_size": "1GB",
"password_encryption": "scram-sha-256",
"shared_buffers": "128MB",
"synchronous_commit": "on",
"wal_level": "replica"
}
},
"valkey": {
"image": "valkey/valkey:9.1.2-trixie@sha256:418652cfb58ef879d4978c33553735d7147016032d5aefaa14c828e611eb9dfd",
"version": "9.1.2"
},
"haproxy": {
"image": "haproxy:3.4.6-trixie@sha256:e273915691a8eab3f105bf3e39fd4c29a4ecf334e33421903b5589d25e14db26"
},
"limits": {
"api": {
"nano_cpus": 1000000000,
"memory": 536870912,
"memory_swap": 536870912,
"published_ports": {}
},
"postgres": {
"nano_cpus": 2000000000,
"memory": 1073741824,
"memory_swap": 1073741824,
"published_ports": {}
},
"valkey": {
"nano_cpus": 500000000,
"memory": 134217728,
"memory_swap": 134217728,
"published_ports": {}
},
"haproxy": {
"nano_cpus": 1000000000,
"memory": 268435456,
"memory_swap": 268435456,
"published_ports": {}
}
},
"api_replicas": 4,
"app_env": {
"APP_HOST": "0.0.0.0",
"APP_PORT": "8080",
"CACHE_HOST": "valkey",
"CACHE_PORT": "6379",
"DB_HOST": "postgres",
"DB_NAME": "bench",
"DB_PORT": "5432",
"DB_USER": "bench",
"IDEMPOTENCY_TTL_SECONDS": "86400",
"LOG_LEVEL": "INFO",
"SESSION_TTL_SECONDS": "21600",
"SHUTDOWN_TIMEOUT": "5"
}
}
@@ -0,0 +1,14 @@
# Серия трека 1 «ab»: scaling-h7-after
Код: src_sha256 `5880b0252c5fd7bb`, commit e2be4787c755. Хост: Apple M4, 16.0 ГиБ; ВМ Docker 10 CPU, 7.7 ГиБ, Docker 28.0.4, compose 2.34.0-desktop.1. Начало 2026-10-15T22:41:16Z, конец 2026-10-15T22:59:40Z.
Открытая модель через HAProxy стенда, смесь read/write/me 70,20,10 (страница истории читаемого чата из 10000 сообщений, отправка с новым ключом в один из 10 чатов, профиль). Ступень: прогрев 10 с с нуля или 5 с подъёма, окно 15 с. Фиксированные уровни 250, 500/с, затем поиск R*: лестница 100 × 1.25^i от 300 × реплик, 2 деления. SLO: p95 успешных ≤ 200 мс и (ошибки + неполные страницы + недосланные) ≤ 1 %. Ячейка — конфигурация × повтор (3), свежий стенд.
| Конфигурация | Реплик × CPU | PostgreSQL CPU | R*, медиана (min–max) | Эффективность к 1 × 1 | p95 на 250 / 500 /с, мс | API мкс/запрос на 500/с | PostgreSQL мкс/запрос | Признаки на первой нарушившей |
|---|---|---|---|---|---|---|---|---|
| 4x1-pg0.5 | 4 × 1 | 0.5 | 1301 (1301–1301) | — | 6.56 / 4.34 | 1492 | 188 | churn ×2, db_cpu ×3, pool ×3 |
| 4x1 | 4 × 1 | 2 | 1819 (1819–1923) | — | 6.37 / 4.47 | 1454 | 184 | app ×3, churn ×3, pool ×3 |
Признаки (пороги — `THRESHOLDS` в `bench/analysis.py`, заданы до замеров): `app` — CPU реплики у лимита или троттлинг; `db_cpu` — CPU PostgreSQL у лимита; `db_lock` — ожидание блокировок; `pool` — соединений реплики у предела пула; `churn` — переоткрытие соединений (новые сессии PostgreSQL за окно); `lb` — CPU HAProxy; `host` — ВМ Docker занята; `generator` — генератор у своего лимита или отстаёт от расписания (R* — нижняя граница).
Файлы: `runs.csv` — строка на ступень, `searches.csv` — строка на ячейку, `samples.csv` — посекундно по контейнерам в окнах ступеней, `p95-by-rate.svg`, `cpu-by-component.svg`, `raw/` — итоги генератора.
+54
View File
@@ -0,0 +1,54 @@
# Что доказывает: аудит условий H7, записанных до измерения кандидата.
# Дата аудита UTC: 2026-10-16. Данные сняты 2026-10-15 на Apple M4,
# macOS 26.6.2, Docker 28.0.4, Compose 2.34.0-desktop.1.
# Это чтение готовых CSV/JSON, без нагрузки на API.
# Исходный код: 0349e9a270178467; H7: 5880b0252c5fd7bb, commit e2be478.
# Как повторить — из корня репозитория:
$ .venv/bin/python - <<'PY'
import csv,json,statistics
from pathlib import Path
root=Path('evidence/scaling')
labels=['scaling-h5-before','scaling-h5-aa','scaling-h7-after']
searches=[list(csv.DictReader((root/x/'searches.csv').open())) for x in labels]
metas=[json.loads((root/x/'meta.json').read_text()) for x in labels]
runs=[list(csv.DictReader((root/x/'runs.csv').open())) for x in labels]
def rates(i,c):return [float(r['r_star']) for r in searches[i] if r['config']==c]
def median(i,c):return statistics.median(rates(i,c))
def cpu(i):return statistics.median(float(r['db_cpu_us_per_req']) for r in runs[i] if r['config']=='4x1-pg0.5' and r['phase']=='fixed' and float(r['rate'])==500)
main='4x1-pg0.5'
verdicts=[]
for x in labels[:2]:
s=Path('evidence/compare',x+'__scaling-h7-after.md').read_text()
verdicts.append(next(line.split('|')[5].strip() for line in s.splitlines() if line.startswith('| 4x1-pg0.5 |')))
criteria={
'all_cells_complete':all(len(s)==6 for s in searches) and all(m.get('finished') and not m.get('aborted') for m in metas),
'no_flags_or_host_warnings':all(not r['flags'] and r['generator_bound']=='False' for s in searches for r in s) and all(not m['host_warnings'] for m in metas),
'same_profile_and_limits':all(m['profile']==metas[0]['profile'] and m['configs']==metas[0]['configs'] for m in metas),
'main_median_growth_at_least_50_percent':median(2,main)/median(0,main)>=1.5,
'each_after_above_all_controls':min(rates(2,main))>max(rates(0,main)+rates(1,main)),
'both_comparisons_show_effect':verdicts==['эффект','эффект'],
'control_regression_within_5_7_percent':median(2,'4x1')/median(0,'4x1')>=0.943,
'all_fixed_steps_pass':all(r['slo_pass']=='True' for r in runs[2] if r['phase']=='fixed'),
'lower_database_cpu_at_fixed_500':cpu(2)<cpu(0),
}
print(json.dumps(criteria,ensure_ascii=False,indent=2))
print('H7: PASS' if all(criteria.values()) else 'H7: FAIL')
print('PostgreSQL CPU us/request at fixed 500:',cpu(0),'->',cpu(2))
print('After host state:',json.dumps(metas[2]['host_state_end'],ensure_ascii=False))
assert all(criteria.values())
PY
{
"all_cells_complete": true,
"no_flags_or_host_warnings": true,
"same_profile_and_limits": true,
"main_median_growth_at_least_50_percent": true,
"each_after_above_all_controls": true,
"both_comparisons_show_effect": true,
"control_regression_within_5_7_percent": true,
"all_fixed_steps_pass": true,
"lower_database_cpu_at_fixed_500": true
}
H7: PASS
PostgreSQL CPU us/request at fixed 500: 290.0 -> 188.0
After host state: {"slept_seconds": 0.0, "swapouts_start": 0, "swapouts_end": 0, "power_end": "AC Power", "swapouts_delta": 0}
+3 -1
View File
@@ -1,4 +1,5 @@
#!/bin/sh
# Цепочка baseline/after относится к исходному опыту H4; H5–H7 — REPORT.md.
# bash ./run-remaining.sh # исходные серии и A/A, без изменения кода
# bash ./run-remaining.sh status # только состояние результатов
# bash ./run-remaining.sh after # ПОСЛЕ анализа и изменения overflow 5 -> 0
@@ -22,7 +23,8 @@ import time
ROOT = Path.cwd()
SCALING = ROOT / "evidence/scaling"
LABELS = ("scaling-a", "scaling-b", "scaling-db", "scaling-ab-before",
"scaling-ab-aa", "scaling-ab-after")
"scaling-ab-aa", "scaling-ab-after", "scaling-h5-before",
"scaling-h5-aa", "scaling-h6-after", "scaling-h7-after")
parser = argparse.ArgumentParser(description="Оставшиеся замеры ЛР3")
parser.add_argument("mode", nargs="?", default="baseline", choices=("baseline", "after", "status"))
args = parser.parse_args()
+1 -1
View File
@@ -41,7 +41,7 @@ SQLAlchemy Core для запросов и `alembic check`. Собирает ц
`NotFound` (внешний ключ сообщения или ключа идемпотентности),
`IdempotencyConflict` (ключ занят другим телом). Бизнес-правил
(членство, дубликаты в запросе) здесь нет — они в сервисах.
7. **Отказ базы — не здесь**: `Db.transaction()` (`src/db.py`) переводит
7. **Отказ базы — не здесь**: `Db.transaction()` / `Db.read()` (`src/db.py`) переводят
недоступность (остановлен, завис, пул исчерпан, `statement_timeout`,
обрыв) в `Unavailable` и пишет одну строку `warning`. Остальные
`DBAPIError` (нарушенный `CHECK`, синтаксис) — дефект, 500.