From 7f2deec511b85f42c10e26c0506c5a1ae795a5d5 Mon Sep 17 00:00:00 2001 From: Artyom Date: Fri, 30 Oct 2026 05:59:38 +0300 Subject: [PATCH] Record levels 3 and 4 again after the second review fixes Every level 3 and 4 record is taken anew on e049c26 from a reset stand: checks with the upstream diff of the contract, the public tests and the task (empty) and of .github (only the own CI job), student tests with the 503 answer to a request cancelled at shutdown, smoke, stack, storage on the filled database, both failover runs with the service.draining event, persistence, hooks, faults, limits, lb-check, the new retry-check, three detection runs, failover-each and both rolling updates with the database size, a docker stats snapshot and the tag and id of every replaced image. The clean clone run executes the launch block of the report verbatim and marks the observations made between its steps. Co-Authored-By: Claude Opus 5.5 (1M context) Claude-Session: https://claude.ai/code/session_01V1d3RLHNBBMA6UqBLLJv27 --- evidence/README.md | 45 +- evidence/checks.txt | 10 +- evidence/clean-clone.txt | 263 ++- evidence/detection/run1/kill.json | 8 +- evidence/detection/run1/pause.json | 10 +- evidence/detection/run1/postgres.json | 10 +- evidence/detection/run1/sigterm.json | 8 +- evidence/detection/run2/kill.json | 8 +- evidence/detection/run2/pause.json | 10 +- evidence/detection/run2/postgres.json | 10 +- evidence/detection/run2/sigterm.json | 8 +- evidence/detection/run3/kill.json | 8 +- evidence/detection/run3/pause.json | 10 +- evidence/detection/run3/postgres.json | 10 +- evidence/detection/run3/sigterm.json | 8 +- evidence/environment.txt | 2 +- evidence/failover-286766bf2b32.txt | 39 - .../failover-each/286766bf2b32/action.txt | 9 - evidence/failover-each/286766bf2b32/k6/k6.txt | 2 - evidence/failover-each/286766bf2b32/lb_up.csv | 668 ------ evidence/failover-each/286766bf2b32/probe.csv | 656 ------ .../failover-each/fa81adafcb69/action.txt | 9 - evidence/failover-each/fa81adafcb69/k6/k6.txt | 2 - evidence/failover-each/fa81adafcb69/lb_up.csv | 668 ------ evidence/failover-each/fa81adafcb69/probe.csv | 656 ------ .../failover-each/fe75c6c37e5a/action.txt | 14 + evidence/failover-each/fe75c6c37e5a/k6/k6.txt | 2 + .../k6/summary.json | 488 ++--- evidence/failover-each/fe75c6c37e5a/lb_up.csv | 653 ++++++ evidence/failover-each/fe75c6c37e5a/probe.csv | 647 ++++++ .../result.json | 28 +- .../failover-each/ff81f93e8b0d/action.txt | 14 + evidence/failover-each/ff81f93e8b0d/k6/k6.txt | 2 + .../k6/summary.json | 406 ++-- evidence/failover-each/ff81f93e8b0d/lb_up.csv | 655 ++++++ evidence/failover-each/ff81f93e8b0d/probe.csv | 647 ++++++ .../result.json | 34 +- evidence/failover-each/summary.json | 148 +- evidence/failover-fa81adafcb69.txt | 38 - evidence/failover-fe75c6c37e5a.txt | 39 + evidence/failover-ff81f93e8b0d.txt | 38 + evidence/faults.txt | 18 +- evidence/hooks.txt | 12 +- evidence/kdf.txt | 6 +- evidence/lb-check.json | 8 +- evidence/limits-violations.txt | 2 +- evidence/limits.txt | 12 +- evidence/migrations.txt | 16 +- evidence/persistence.txt | 26 +- evidence/retry.json | 47 + evidence/rolling-from-8d28d45/action.txt | 20 +- evidence/rolling-from-8d28d45/k6/k6.txt | 2 +- evidence/rolling-from-8d28d45/k6/summary.json | 564 ++--- evidence/rolling-from-8d28d45/lb_up.csv | 1859 ++++++++-------- evidence/rolling-from-8d28d45/probe.csv | 1847 ++++++++-------- evidence/rolling-from-8d28d45/result.json | 20 +- evidence/rolling/action.txt | 16 +- evidence/rolling/k6/k6.txt | 2 +- evidence/rolling/k6/summary.json | 428 ++-- evidence/rolling/lb_up.csv | 1867 ++++++++--------- evidence/rolling/probe.csv | 1861 ++++++++-------- evidence/rolling/result.json | 18 +- evidence/schema.txt | 6 +- evidence/secrets.txt | 2 +- evidence/smoke.txt | 2 +- evidence/stack.txt | 34 +- evidence/student-tests.txt | 11 +- 67 files changed, 7841 insertions(+), 7855 deletions(-) delete mode 100644 evidence/failover-286766bf2b32.txt delete mode 100644 evidence/failover-each/286766bf2b32/action.txt delete mode 100644 evidence/failover-each/286766bf2b32/k6/k6.txt delete mode 100644 evidence/failover-each/286766bf2b32/lb_up.csv delete mode 100644 evidence/failover-each/286766bf2b32/probe.csv delete mode 100644 evidence/failover-each/fa81adafcb69/action.txt delete mode 100644 evidence/failover-each/fa81adafcb69/k6/k6.txt delete mode 100644 evidence/failover-each/fa81adafcb69/lb_up.csv delete mode 100644 evidence/failover-each/fa81adafcb69/probe.csv create mode 100644 evidence/failover-each/fe75c6c37e5a/action.txt create mode 100644 evidence/failover-each/fe75c6c37e5a/k6/k6.txt rename evidence/failover-each/{fa81adafcb69 => fe75c6c37e5a}/k6/summary.json (58%) create mode 100644 evidence/failover-each/fe75c6c37e5a/lb_up.csv create mode 100644 evidence/failover-each/fe75c6c37e5a/probe.csv rename evidence/failover-each/{fa81adafcb69 => fe75c6c37e5a}/result.json (66%) create mode 100644 evidence/failover-each/ff81f93e8b0d/action.txt create mode 100644 evidence/failover-each/ff81f93e8b0d/k6/k6.txt rename evidence/failover-each/{286766bf2b32 => ff81f93e8b0d}/k6/summary.json (54%) create mode 100644 evidence/failover-each/ff81f93e8b0d/lb_up.csv create mode 100644 evidence/failover-each/ff81f93e8b0d/probe.csv rename evidence/failover-each/{286766bf2b32 => ff81f93e8b0d}/result.json (61%) delete mode 100644 evidence/failover-fa81adafcb69.txt create mode 100644 evidence/failover-fe75c6c37e5a.txt create mode 100644 evidence/failover-ff81f93e8b0d.txt create mode 100644 evidence/retry.json diff --git a/evidence/README.md b/evidence/README.md index 059a3e00..46d8b6fc 100644 --- a/evidence/README.md +++ b/evidence/README.md @@ -2,7 +2,7 @@ Обезличенные результаты прогонов лабы 3. Пользователи, чаты и тексты синтетические; паролей, токенов, `.env`, содержимого `secrets/` и дампов здесь нет. В первой строке каждого отчёта `*.txt` в `evidence/` и `track1/` — дата -(UTC) и коммит прогона. У `lb-check.json` и у сырья в каталогах прогонов (`detection/`, `failover-each/`, `rolling*/`, +(UTC) и коммит прогона. У `lb-check.json`, `retry.json` и у сырья в каталогах прогонов (`detection/`, `failover-each/`, `rolling*/`, `track1/<серия>/`: JSON, CSV, `action.txt`, `k6/k6.txt`) даты и коммита внутри нет: коммит — в столбце «Коммит» таблиц ниже, время — в `started` строк `summary.csv` трека и в метках времени `action.txt`. Проверки через балансировщик шли на порт 18083 (`LB_HTTP_PORT`; 8080 на машине был занят стендами других лаб): цели `make` берут `BASE_URL` из @@ -12,32 +12,33 @@ | Файл | Что доказывает | Команда | Коммит | | --- | --- | --- | --- | -| `clean-clone.txt` | запуск из свежего clone на пустых volumes: секреты, `config`, `make up` с миграциями `0001`/`0002`, готовность, smoke, ≥2 реплики и гонки ключа, failover обеих реплик, persistence (всё без явного `BASE_URL` при `LB_HTTP_PORT=18083`), `storage-evidence` в клоне, повтор миграций, `make down` (volumes остаются), `make reset-data` (volumes удалены) | последовательность из `REPORT.md`, раздел «Запуск» | `f5fea5c` (код `b1c80ee`) | -| `checks.txt` | реальный вывод `make check`, `make validate` (`openapi-spec-validator` из dev-группы `.venv`) и `make lint` | команды внутри файла | `b1c80ee` | -| `smoke.txt` | публичный smoke через LB | `make test` | `b1c80ee` | -| `stack.txt` | сервисы, только `lb` публикует порты, `container_name` 0, `docker port` реплик пуст, hostname ↔ `X-Instance-Id`, лимиты, сети, uid, взгляд LB | `make stack-evidence` | `b1c80ee` | -| `environment.txt` | host, Docker, образы по digest, версии пакетов, uid процессов | `make stack-evidence` | `b1c80ee` | -| `lb-check.json` | 40 `GET /users/me` одним токеном — 20 + 20 по двум репликам; 20 раундов × 8 параллельных POST с одним ключом — 160 × `201`, одна копия, `409` на другой body | `make lb-check` | `b1c80ee` | -| `failover-286766bf2b32.txt`, `failover-fa81adafcb69.txt` | `make test-failover ACTION_SCRIPT=scripts/stop-one.sh` для каждой реплики: `docker inspect` до/после, остановлен именно target, лог его остановки, `restore` | `make failover-evidence`, затем `make failover-evidence SHIFT=1` | `b1c80ee` | -| `hooks.txt` | `stop-one.sh`: длительность, код, остановлен только target; неизвестный ID → 3; без переменной → 1; все реплики остановлены → `503` LB в формате контракта | команды внутри файла | `b1c80ee` | -| `persistence.txt` | `make test-persistence ACTION_SCRIPT=scripts/restart.sh` и `StartedAt` всех контейнеров до и после | `make persistence-evidence` | `b1c80ee` | -| `faults.txt` | тесты стенда лабы 2 через LB: гонка регистрации, остановка Valkey и PostgreSQL, рестарт API, полный рестарт с выходом, срок сессии после рестарта | `make faults-evidence` | `b1c80ee` | -| `student-tests.txt` | все собственные тесты по именам (идемпотентность, `X-Instance-Id`, сессии, конвейер) и вывод теста `SIGTERM`-окна и цепочки таймаутов | `PYTEST_ADDOPTS=-vv make student-test`; `pytest -s` двух файлов | `b1c80ee` | -| `schema.txt` | `\d+` всех таблиц и применённые миграции | `make storage-evidence` | `b1c80ee` | -| `migrations.txt` | повторный `migrate` → `up to date`, счётчики строк до и после равны | `make storage-evidence` | `b1c80ee` | -| `kdf.txt` | Argon2id у всех пользователей, в `sessions` только 32-байтовые SHA-256 | `make storage-evidence` | `b1c80ee` | -| `secrets.txt` | секреты, `.env`, дампы и volumes не в Git и игнорируются | `make storage-evidence` | `b1c80ee` | +| `clean-clone.txt` | запуск из свежего clone на пустых volumes: секреты, `config`, `make up` с миграциями `0001`/`0002` и ожиданием всех реплик в LB, smoke, `lb-check`, `retry-check`, failover обеих реплик, persistence (всё без явного `BASE_URL` при `LB_HTTP_PORT=18083`), повтор миграций, `storage-evidence` в клоне, `make down` (volumes остаются), `make reset-data` (volumes удалены) | команды блока «Запуск из чистого clone» `REPORT.md` дословно, между ними — наблюдения (`docker compose ps`, статистика LB, `docker volume ls`) | `e049c26` | +| `checks.txt` | реальный вывод `make check`, `make validate` (`openapi-spec-validator` из dev-группы `.venv`) и `make lint`; `git diff --stat upstream/main` контракта, публичных тестов и задания (пусто) и `.github` (только свой CI job) | команды внутри файла | `e049c26` | +| `smoke.txt` | публичный smoke через LB | `make test` | `e049c26` | +| `stack.txt` | сервисы, только `lb` публикует порты, `container_name` 0, `docker port` реплик пуст, hostname ↔ `X-Instance-Id`, лимиты, сети, uid, взгляд LB | `make stack-evidence` | `e049c26` | +| `environment.txt` | host, Docker, образы по digest, версии пакетов, uid процессов | `make stack-evidence` | `e049c26` | +| `lb-check.json` | 40 `GET /users/me` одним токеном — 20 + 20 по двум репликам; 20 раундов × 8 параллельных POST с одним ключом — 160 × `201`, одна копия, `409` на другой body | `make lb-check` | `e049c26` | +| `retry.json` | потерянный ответ: запись ждёт блокировку строки чата дольше таймаута клиента, повтор с тем же ключом через LB — на живой реплике и после `docker kill` реплики, чей запрос ждёт; `201`, одна копия с тем же `id`, кто записал сообщение, ответила ли реплика без клиента | `make retry-check` | `e049c26` | +| `failover-fe75c6c37e5a.txt`, `failover-ff81f93e8b0d.txt` | `make test-failover ACTION_SCRIPT=scripts/stop-one.sh` для каждой реплики: `docker inspect` до/после, остановлен именно target, лог его остановки, `restore` | `make failover-evidence`, затем `make failover-evidence SHIFT=1` | `e049c26` | +| `hooks.txt` | `stop-one.sh`: длительность, код, остановлен только target; неизвестный ID → 3; без переменной → 1; все реплики остановлены → `503` LB в формате контракта | команды внутри файла | `e049c26` | +| `persistence.txt` | `make test-persistence ACTION_SCRIPT=scripts/restart.sh` и `StartedAt` всех контейнеров до и после | `make persistence-evidence` | `e049c26` | +| `faults.txt` | тесты стенда лабы 2 через LB: гонка регистрации, остановка Valkey и PostgreSQL, рестарт API, полный рестарт с выходом, срок сессии после рестарта | `make faults-evidence` | `e049c26` | +| `student-tests.txt` | все собственные тесты по именам (идемпотентность, `X-Instance-Id`, сессии, конвейер) и вывод теста `SIGTERM`-окна и цепочки таймаутов | `PYTEST_ADDOPTS=-vv make student-test`; `pytest -s` двух файлов | `e049c26` | +| `schema.txt` | `\d+` всех таблиц и применённые миграции | `make storage-evidence` | `e049c26` | +| `migrations.txt` | повторный `migrate` → `up to date`, счётчики строк до и после равны | `make storage-evidence` | `e049c26` | +| `kdf.txt` | Argon2id у всех пользователей, в `sessions` только 32-байтовые SHA-256 | `make storage-evidence` | `e049c26` | +| `secrets.txt` | секреты, `.env`, дампы и volumes не в Git и игнорируются | `make storage-evidence` | `e049c26` | ## Уровень «4» | Файл | Что доказывает | Команда | Коммит | | --- | --- | --- | --- | -| `limits.txt` | лимиты CPU/RAM всех сервисов (объявлены и применены), порты только у LB на `127.0.0.1`, секреты, volumes и сети по политике | `make limits` | `b1c80ee` | -| `limits-violations.txt` | та же проверка ловит подмешанные нарушения (5 штук, код 1) | `COMPOSE_FILE=compose.yaml:violations.yaml python3 scripts/limits.py` | `b1c80ee` | -| `detection/run{1,2,3}/{sigterm,kill,pause,postgres}.json` | три прогона: время исключения backend из ротации против заявленного максимума (допуск замера 0,25 с), ответ LB после исключения, время возврата | `make detection` | `b1c80ee` | -| `failover-each/summary.json`, `failover-each//` | поочерёдная остановка каждой реплики под k6 100 rps: RPS, ошибки, p50/p95/p99, обнаружение, возврат, зонд записи, счётчики LB; сырьё — `k6/`, `lb_up.csv`, `probe.csv`, `action.txt` (вывод действия: `docker compose ps -a` реплик сразу после хука, затем `restore`) | `make failover-each` | `b1c80ee` | -| `rolling-from-8d28d45/` | rolling update с образа уровня «3» на текущий под k6: ёмкость, ошибки, замена всех реплик, `migrate` один раз | `make rolling-update FROM_REV=8d28d45` | `b1c80ee` | -| `rolling/` | rolling update текущей сборкой под k6 | `make rolling-update` | `b1c80ee` | +| `limits.txt` | лимиты CPU/RAM всех сервисов (объявлены и применены), порты только у LB на `127.0.0.1`, секреты, volumes и сети по политике | `make limits` | `e049c26` | +| `limits-violations.txt` | та же проверка ловит подмешанные нарушения (5 штук, код 1) | `COMPOSE_FILE=compose.yaml:violations.yaml python3 scripts/limits.py` | `e049c26` | +| `detection/run{1,2,3}/{sigterm,kill,pause,postgres}.json` | три прогона: время исключения backend из ротации против заявленного максимума (допуск замера 0,25 с), ответ LB после исключения, время возврата | `make detection` | `e049c26` | +| `failover-each/summary.json`, `failover-each//` | поочерёдная остановка каждой реплики под k6 100 rps: RPS, ошибки, p50/p95/p99, обнаружение, возврат, зонд записи, счётчики LB; сырьё — `k6/`, `lb_up.csv`, `probe.csv`, `action.txt` (вывод действия: `docker compose ps -a` реплик сразу после хука, размер БД и `docker stats` стенда без остановленной реплики, затем `restore`) | `make failover-each` | `e049c26` | +| `rolling-from-8d28d45/` | rolling update с образа уровня «3» (`mtusi-messenger:8d28d45`) на текущий под k6: ёмкость, ошибки, замена всех реплик, `migrate` один раз; в `action.txt` — тег и ID образа каждой заменяемой и новой реплики, размер БД и `docker stats` | `make rolling-update FROM_REV=8d28d45` | `e049c26` | +| `rolling/` | rolling update текущей сборкой под k6 | `make rolling-update` | `e049c26` | ## Трек 1 «Цена масштабирования» diff --git a/evidence/checks.txt b/evidence/checks.txt index 8f4e95e5..0b202295 100644 --- a/evidence/checks.txt +++ b/evidence/checks.txt @@ -1,4 +1,4 @@ -date: 2026-10-29T23:43:06Z commit: b1c80ee +date: 2026-10-30T02:44:16Z commit: e049c26 $ make check python3 scripts/check_contract.py PASS: offline skeleton structure, local refs and Python syntax; application NOT tested. @@ -11,7 +11,13 @@ $ make lint .venv/bin/ruff check src student-tests scripts/probe.py scripts/limits.py scripts/scaling.py tools All checks passed! .venv/bin/ruff format --check src student-tests scripts/probe.py scripts/limits.py scripts/scaling.py tools -103 files already formatted +104 files already formatted .venv/bin/ty check src student-tests All checks passed! exit=0 +$ git diff --stat upstream/main -- contracts tests README.md COURSE.md lab.json MAINTAINERS.md # контракт, публичные тесты и задание не изменены: вывод пуст +exit=0 +$ git diff --stat upstream/main -- .github # шаблон PR не изменён, добавлен только собственный CI job + .github/workflows/application.yml | 82 +++++++++++++++++++++++++++++++++++++++ + 1 file changed, 82 insertions(+) +exit=0 diff --git a/evidence/clean-clone.txt b/evidence/clean-clone.txt index d6e697b6..d5503977 100644 --- a/evidence/clean-clone.txt +++ b/evidence/clean-clone.txt @@ -1,9 +1,9 @@ -date: 2026-10-29T23:53:18Z commit: f5fea5c dir: mtusi2026lab3-clean (свой compose-проект и volumes) -$ git clone … mtusi2026lab3-clean && cd mtusi2026lab3-clean && git checkout solution/bpi2303-kostylev -HEAD f5fea5c Record levels 3 and 4 again after the lab 2 carry over -$ docker volume ls -q --filter name=mtusi2026lab3-clean | wc -l | tr -d ' ' +date: 2026-10-30T02:55:09Z commit: e049c26 dir: mtusi2026lab3-clean (свой compose-проект и volumes) +# шаги — команды блока «Запуск из чистого clone» REPORT.md дословно; строки с пометкой «наблюдение» — проверки между шагами +$ git clone mtusi2026lab3-clean && cd mtusi2026lab3-clean && git checkout solution/bpi2303-kostylev +HEAD e049c26 Reproduce a lost answer on the stand and enrich the run records +$ docker volume ls -q --filter label=com.docker.compose.project=mtusi2026lab3-clean | wc -l | tr -d ' ' # наблюдение, не шаг инструкции 0 -exit=0 $ make secrets sh scripts/secrets.sh создан secrets/postgres_password @@ -14,13 +14,11 @@ sh scripts/secrets.sh создан secrets/cache_url создан .env из .env.example exit=0 -$ sed LB_HTTP_PORT=18083 LB_STATS_PORT=23083 .env # 8080 на этой машине занят стендами других лаб -$ git status --short --ignored secrets .env +$ sed LB_HTTP_PORT=18083 LB_STATS_PORT=23083 .env # отступление: 8080 на этой машине занят стендами других лаб +$ git status --short --ignored secrets .env # наблюдение, не шаг инструкции !! .env !! secrets/ -exit=0 -$ docker compose --env-file .env config --quiet && echo valid -valid +$ docker compose --env-file .env config --quiet exit=0 $ make up sh scripts/secrets.sh @@ -52,16 +50,16 @@ docker compose up -d --build --wait #7 DONE 0.0s #8 [internal] load build context -#8 transferring context: 281.44kB 0.0s done +#8 transferring context: 282.44kB 0.0s done #8 DONE 0.0s -#9 [builder 4/7] COPY pyproject.toml uv.lock README.md ./ +#9 [builder 3/7] WORKDIR /build #9 CACHED #10 [builder 2/7] COPY --from=ghcr.io/astral-sh/uv:0.9.7@sha256:ba4857bf2a068e9bc0e64eed8563b065908a4cd6bfb66b531a9c424c8e25e142 /uv /usr/local/bin/uv #10 CACHED -#11 [builder 3/7] WORKDIR /build +#11 [builder 4/7] COPY pyproject.toml uv.lock README.md ./ #11 CACHED #12 [builder 5/7] RUN uv sync --locked --no-dev --no-install-project --no-editable @@ -71,62 +69,63 @@ docker compose up -d --build --wait #13 DONE 0.0s #14 [builder 7/7] RUN uv sync --locked --no-dev --no-editable -#14 0.228 Resolved 59 packages in 9ms -#14 0.241 Building mtusi-messenger @ file:///build -#14 2.148 Built mtusi-messenger @ file:///build -#14 2.152 Prepared 1 package in 1.91s -#14 2.157 Installed 1 package in 4ms -#14 2.243 Bytecode compiled 888 files in 86ms -#14 2.243 + mtusi-messenger==1.3.0 (from file:///build) -#14 DONE 2.3s +#14 0.177 Resolved 59 packages in 0.70ms +#14 0.179 Building mtusi-messenger @ file:///build +#14 1.370 Built mtusi-messenger @ file:///build +#14 1.373 Prepared 1 package in 1.19s +#14 1.377 Installed 1 package in 3ms +#14 1.462 Bytecode compiled 889 files in 85ms +#14 1.462 + mtusi-messenger==1.3.0 (from file:///build) +#14 DONE 1.5s #15 [runtime 2/4] RUN groupadd --system --gid 10001 messenger && useradd --system --uid 10001 --gid messenger --no-create-home --shell /usr/sbin/nologin messenger #15 CACHED #16 [runtime 3/4] COPY --from=builder --chown=root:root /opt/venv /opt/venv -#16 DONE 0.2s +#16 DONE 0.1s #17 [runtime 4/4] WORKDIR /app #17 DONE 0.0s #18 exporting to image #18 exporting layers -#18 exporting layers 1.3s done -#18 exporting manifest sha256:70f59989a44aa91279868eda8d3be8e0190c77105c73991af97ce4bacd31671f done -#18 exporting config sha256:f0e6baec9e0953031a2fcce0c3d7e51f43a86bc862d6b906ef83c07ebd24d86a done -#18 exporting attestation manifest sha256:2602ec09576cca80e4818a6e4b3de34c457dc91ad59602388f2e6af8b5565e35 done -#18 exporting manifest list sha256:a8a3477e428fb32254f1294cf857b6e428fe388f44cd3a900b410f1e2a340764 done +#18 exporting layers 1.4s done +#18 exporting manifest sha256:41b1d8e9a345c4df365f8ff02ecbc631fbe4ddba70f99aa9e5eb551238e974d6 +#18 exporting manifest sha256:41b1d8e9a345c4df365f8ff02ecbc631fbe4ddba70f99aa9e5eb551238e974d6 done +#18 exporting config sha256:5d3385c825a95590c9cd0253aa72316de78fd11dc85ab9b61af766943ef9847d done +#18 exporting attestation manifest sha256:7729b5721c86110d489c782e5df22a34b492328eb4b92fa30f2d9dea23c810d3 done +#18 exporting manifest list sha256:0b27d26576cb62d154e45c8e6af3d80e9663cd275eb234a96a6a1ebc0c494c3a done #18 naming to docker.io/library/mtusi-messenger:mtusi2026lab3-clean done #18 unpacking to docker.io/library/mtusi-messenger:mtusi2026lab3-clean #18 unpacking to docker.io/library/mtusi-messenger:mtusi2026lab3-clean 0.2s done -#18 DONE 1.6s +#18 DONE 1.7s #19 resolving provenance for metadata file #19 DONE 0.0s api Built - Network mtusi2026lab3-clean_backend Creating - Network mtusi2026lab3-clean_backend Created Network mtusi2026lab3-clean_edge Creating Network mtusi2026lab3-clean_edge Created - Volume "mtusi2026lab3-clean_valkeydata" Creating - Volume "mtusi2026lab3-clean_valkeydata" Created + Network mtusi2026lab3-clean_backend Creating + Network mtusi2026lab3-clean_backend Created Volume "mtusi2026lab3-clean_pgdata" Creating Volume "mtusi2026lab3-clean_pgdata" Created - Container mtusi2026lab3-clean-postgres-1 Creating - Container mtusi2026lab3-clean-valkey-1 Creating + Volume "mtusi2026lab3-clean_valkeydata" Creating + Volume "mtusi2026lab3-clean_valkeydata" Created Container mtusi2026lab3-clean-lb-1 Creating + Container mtusi2026lab3-clean-valkey-1 Creating + Container mtusi2026lab3-clean-postgres-1 Creating + Container mtusi2026lab3-clean-valkey-1 Created Container mtusi2026lab3-clean-lb-1 Created Container mtusi2026lab3-clean-postgres-1 Created Container mtusi2026lab3-clean-migrate-1 Creating - Container mtusi2026lab3-clean-valkey-1 Created Container mtusi2026lab3-clean-migrate-1 Created - Container mtusi2026lab3-clean-api-2 Creating Container mtusi2026lab3-clean-api-1 Creating + Container mtusi2026lab3-clean-api-2 Creating Container mtusi2026lab3-clean-api-2 Created Container mtusi2026lab3-clean-api-1 Created + Container mtusi2026lab3-clean-lb-1 Starting Container mtusi2026lab3-clean-postgres-1 Starting Container mtusi2026lab3-clean-valkey-1 Starting - Container mtusi2026lab3-clean-lb-1 Starting Container mtusi2026lab3-clean-valkey-1 Started Container mtusi2026lab3-clean-postgres-1 Started Container mtusi2026lab3-clean-postgres-1 Waiting @@ -140,45 +139,51 @@ docker compose up -d --build --wait Container mtusi2026lab3-clean-api-1 Started Container mtusi2026lab3-clean-api-2 Starting Container mtusi2026lab3-clean-api-2 Started + Container mtusi2026lab3-clean-lb-1 Waiting Container mtusi2026lab3-clean-api-1 Waiting Container mtusi2026lab3-clean-api-2 Waiting Container mtusi2026lab3-clean-migrate-1 Waiting Container mtusi2026lab3-clean-postgres-1 Waiting Container mtusi2026lab3-clean-valkey-1 Waiting - Container mtusi2026lab3-clean-lb-1 Waiting - Container mtusi2026lab3-clean-migrate-1 Exited Container mtusi2026lab3-clean-postgres-1 Healthy + Container mtusi2026lab3-clean-migrate-1 Exited Container mtusi2026lab3-clean-valkey-1 Healthy Container mtusi2026lab3-clean-api-1 Healthy Container mtusi2026lab3-clean-api-2 Healthy Container mtusi2026lab3-clean-lb-1 Healthy +scripts/lb-wait.sh exit=0 -make up (build, migrate, wait healthy): 10 s -$ docker compose logs --no-log-prefix migrate -{"version":"0001_init","event":"migration.applied","level":"info","ts":"2026-10-29T23:53:27.339042Z"} -{"version":"0002_idempotency_keys","event":"migration.applied","level":"info","ts":"2026-10-29T23:53:27.339142Z"} -{"reason":"applied","event":"migration.completed","level":"info","ts":"2026-10-29T23:53:27.339185Z"} -exit=0 -$ docker compose ps -a --format '{{.Service}} {{.State}} {{.Status}} {{.Ports}}' +make up (build, migrate, wait healthy, all replicas UP in LB): 10 s +$ docker compose logs --no-log-prefix migrate # наблюдение, не шаг инструкции +{"version":"0001_init","event":"migration.applied","level":"info","ts":"2026-10-30T02:55:17.402396Z"} +{"version":"0002_idempotency_keys","event":"migration.applied","level":"info","ts":"2026-10-30T02:55:17.402481Z"} +{"reason":"applied","event":"migration.completed","level":"info","ts":"2026-10-30T02:55:17.402535Z"} +$ docker compose ps -a --format '{{.Service}} {{.State}} {{.Status}} {{.Ports}}' # наблюдение, не шаг инструкции api running Up 3 seconds (healthy) api running Up 3 seconds (healthy) -lb running Up 5 seconds (healthy) 127.0.0.1:18083->8080/tcp, 127.0.0.1:23083->8404/tcp -migrate exited Exited (0) 3 seconds ago -postgres running Up 5 seconds (healthy) -valkey running Up 5 seconds (healthy) -exit=0 -$ until curl -fsS http://$(docker compose port lb 8080)/health/ready; do sleep 1; done; scripts/lb-wait.sh 2 -{"status":"ok"} -LB: 2 api UP +lb running Up 6 seconds (healthy) 127.0.0.1:18083->8080/tcp, 127.0.0.1:23083->8404/tcp +migrate exited Exited (0) 4 seconds ago +postgres running Up 6 seconds (healthy) +valkey running Up 6 seconds (healthy) +$ curl -s "http://$(docker compose port lb 8404)/stats;csv" | awk -F, '$1 == "api" && $2 != "BACKEND" {print $2, $18}' # наблюдение, не шаг инструкции +api1 UP +api2 UP +api3 MAINT (resolution) +api4 MAINT (resolution) +api5 MAINT (resolution) +api6 MAINT (resolution) +api7 MAINT (resolution) +api8 MAINT (resolution) $ make test python3 tests/smoke.py --base-url "http://127.0.0.1:18083" PASS: lab3 public API scenario; infrastructure and grading evidence remain separate. exit=0 -$ python3 scripts/probe.py check --rounds 20 +$ make lb-check +python3 scripts/probe.py check --rounds 20 --out evidence/lb-check.json { "instances_one_token": { - "7bed64a93042": 20, - "7dcb3b8e69c8": 20 + "8c9722d76b31": 20, + "58d535b73f25": 20 }, "same_key": { "rounds": 20, @@ -187,8 +192,8 @@ $ python3 scripts/probe.py check --rounds 20 "201": 160 }, "instances": { - "7dcb3b8e69c8": 80, - "7bed64a93042": 80 + "8c9722d76b31": 80, + "58d535b73f25": 80 }, "identical_bodies_rounds": 20, "single_copy_rounds": 20, @@ -197,36 +202,65 @@ $ python3 scripts/probe.py check --rounds 20 "pass": true } exit=0 +$ make retry-check +python3 scripts/probe.py retry --out evidence/retry.json +{ + "variants": [ + { + "variant": "timeout", + "lost_attempt": { + "status": 0, + "client_timeout_s": 0.5, + "chat_lock_held_s": 1.5, + "replica": "8c9722d76b31", + "replica_killed": false, + "replica_answered": 201 + }, + "retry": { + "after_s": 1.546, + "status": 201, + "attempts": 1, + "replica": "58d535b73f25" + }, + "copies_in_history": 1, + "same_message": true, + "written_by": "lost attempt", + "pass": true + }, + { + "variant": "kill", + "lost_attempt": { + "status": 0, + "client_timeout_s": 0.5, + "chat_lock_held_s": 1.5, + "replica": "58d535b73f25", + "replica_killed": true, + "replica_answered": null + }, + "retry": { + "after_s": 1.533, + "status": 201, + "attempts": 1, + "replica": "8c9722d76b31" + }, + "copies_in_history": 1, + "same_message": true, + "written_by": "lost attempt", + "pass": true + } + ], + "pass": true +} +exit=0 $ make test-failover ACTION_SCRIPT=scripts/stop-one.sh python3 tests/resilience.py --mode failover --action-script "scripts/stop-one.sh" --base-url "http://127.0.0.1:18083" Executing explicit failover hook; hook output suppressed to avoid leaking secrets. -{"observed_instances_before": 2, "successful_writes": 134, "failed_attempts": 0, "first_recovery_seconds": 2.934} +{"observed_instances_before": 2, "successful_writes": 135, "failed_attempts": 0, "first_recovery_seconds": 2.911} PASS: failover preserved confirmed data and existing session. Hook scope needs operator evidence. exit=0 -$ docker compose ps -a --format '{{.Service}} {{.Name}} {{.State}} {{.Status}}' api -api mtusi2026lab3-clean-api-1 exited Exited (0) 12 seconds ago -api mtusi2026lab3-clean-api-2 running Up 20 seconds (healthy) -exit=0 -$ make restore -scripts/restore.sh - Container mtusi2026lab3-clean-api-2 Running - Container mtusi2026lab3-clean-api-1 Starting - Container mtusi2026lab3-clean-api-1 Started - Container mtusi2026lab3-clean-api-1 Waiting - Container mtusi2026lab3-clean-api-2 Waiting - Container mtusi2026lab3-clean-api-1 Healthy - Container mtusi2026lab3-clean-api-2 Healthy -exit=0 -$ curl -s -o /dev/null http://$(docker compose port lb 8080)/health/live && make test-failover ACTION_SCRIPT=scripts/stop-one.sh -python3 tests/resilience.py --mode failover --action-script "scripts/stop-one.sh" --base-url "http://127.0.0.1:18083" -Executing explicit failover hook; hook output suppressed to avoid leaking secrets. -{"observed_instances_before": 2, "successful_writes": 132, "failed_attempts": 0, "first_recovery_seconds": 2.736} -PASS: failover preserved confirmed data and existing session. Hook scope needs operator evidence. -exit=0 -$ docker compose ps -a --format '{{.Service}} {{.Name}} {{.State}} {{.Status}}' api -api mtusi2026lab3-clean-api-1 running Up 17 seconds (healthy) +$ docker compose ps -a --format '{{.Service}} {{.Name}} {{.State}} {{.Status}}' api # наблюдение, не шаг инструкции +api mtusi2026lab3-clean-api-1 running Up 27 seconds (healthy) api mtusi2026lab3-clean-api-2 exited Exited (0) 12 seconds ago -exit=0 $ make restore scripts/restore.sh Container mtusi2026lab3-clean-api-1 Running @@ -237,37 +271,54 @@ scripts/restore.sh Container mtusi2026lab3-clean-api-1 Healthy Container mtusi2026lab3-clean-api-2 Healthy exit=0 +$ curl -s -o /dev/null "http://$(docker compose port lb 8080)/health/live" +exit=0 +$ make test-failover ACTION_SCRIPT=scripts/stop-one.sh && make restore +python3 tests/resilience.py --mode failover --action-script "scripts/stop-one.sh" --base-url "http://127.0.0.1:18083" +Executing explicit failover hook; hook output suppressed to avoid leaking secrets. +{"observed_instances_before": 2, "successful_writes": 135, "failed_attempts": 0, "first_recovery_seconds": 2.572} +PASS: failover preserved confirmed data and existing session. Hook scope needs operator evidence. +scripts/restore.sh + Container mtusi2026lab3-clean-api-2 Running + Container mtusi2026lab3-clean-api-1 Starting + Container mtusi2026lab3-clean-api-1 Started + Container mtusi2026lab3-clean-api-1 Waiting + Container mtusi2026lab3-clean-api-2 Waiting + Container mtusi2026lab3-clean-api-1 Healthy + Container mtusi2026lab3-clean-api-2 Healthy +exit=0 +$ docker compose ps -a --format '{{.Service}} {{.Name}} {{.State}} {{.Status}}' api # наблюдение, не шаг инструкции +api mtusi2026lab3-clean-api-1 running Up 1 second (healthy) +api mtusi2026lab3-clean-api-2 running Up 19 seconds (healthy) $ make test-persistence ACTION_SCRIPT=scripts/restart.sh python3 tests/resilience.py --mode persistence --action-script "scripts/restart.sh" --base-url "http://127.0.0.1:18083" Executing explicit persistence hook; hook output suppressed to avoid leaking secrets. PASS: persistence preserved confirmed data and existing session. Hook scope needs operator evidence. exit=0 -$ docker compose ps -a --format '{{.Service}} {{.State}} {{.RunningFor}} {{.Status}}' -api running 52 seconds ago Up 3 seconds (healthy) -api running 52 seconds ago Up 3 seconds (healthy) -lb running 52 seconds ago Up 5 seconds (healthy) -migrate exited 52 seconds ago Exited (0) 4 seconds ago -postgres running 52 seconds ago Up 5 seconds (healthy) -valkey running 52 seconds ago Up 5 seconds (healthy) -exit=0 +$ docker compose ps -a --format '{{.Service}} {{.State}} {{.RunningFor}} {{.Status}}' # наблюдение, не шаг инструкции +api running 58 seconds ago Up 3 seconds (healthy) +api running 58 seconds ago Up 3 seconds (healthy) +lb running 58 seconds ago Up 5 seconds (healthy) +migrate exited 58 seconds ago Exited (0) 4 seconds ago +postgres running 58 seconds ago Up 5 seconds (healthy) +valkey running 58 seconds ago Up 5 seconds (healthy) $ make migrate docker compose run --rm migrate Container mtusi2026lab3-clean-postgres-1 Running -{"reason":"up to date","event":"migration.completed","level":"info","ts":"2026-10-29T23:54:18.438982Z"} +{"reason":"up to date","event":"migration.completed","level":"info","ts":"2026-10-30T02:56:15.101805Z"} exit=0 -$ make storage-evidence && tail -4 evidence/secrets.txt +$ make storage-evidence sh scripts/evidence-storage.sh evidence/{schema,migrations,kdf,secrets}.txt обновлены -$ docker volume ls --filter label=com.docker.compose.project=mtusi2026lab3-clean -DRIVER VOLUME NAME -local mtusi2026lab3-clean_pgdata -local mtusi2026lab3-clean_valkeydata exit=0 +$ docker volume ls --format '{{.Name}}' --filter label=com.docker.compose.project=mtusi2026lab3-clean # наблюдение, не шаг инструкции +mtusi2026lab3-clean_pgdata +mtusi2026lab3-clean_valkeydata $ make down docker compose --profile bench down + Container mtusi2026lab3-clean-api-1 Stopping Container mtusi2026lab3-clean-api-2 Stopping Container mtusi2026lab3-clean-lb-1 Stopping - Container mtusi2026lab3-clean-api-1 Stopping Container mtusi2026lab3-clean-lb-1 Stopped Container mtusi2026lab3-clean-lb-1 Removing Container mtusi2026lab3-clean-lb-1 Removed @@ -277,35 +328,33 @@ docker compose --profile bench down Container mtusi2026lab3-clean-api-1 Removing Container mtusi2026lab3-clean-api-2 Removed Container mtusi2026lab3-clean-api-1 Removed - Container mtusi2026lab3-clean-migrate-1 Stopping Container mtusi2026lab3-clean-valkey-1 Stopping + Container mtusi2026lab3-clean-migrate-1 Stopping Container mtusi2026lab3-clean-migrate-1 Stopped Container mtusi2026lab3-clean-migrate-1 Removing Container mtusi2026lab3-clean-migrate-1 Removed Container mtusi2026lab3-clean-postgres-1 Stopping Container mtusi2026lab3-clean-postgres-1 Stopped Container mtusi2026lab3-clean-postgres-1 Removing + Container mtusi2026lab3-clean-postgres-1 Removed Container mtusi2026lab3-clean-valkey-1 Stopped Container mtusi2026lab3-clean-valkey-1 Removing - Container mtusi2026lab3-clean-postgres-1 Removed Container mtusi2026lab3-clean-valkey-1 Removed Network mtusi2026lab3-clean_edge Removing Network mtusi2026lab3-clean_backend Removing - Network mtusi2026lab3-clean_backend Removed Network mtusi2026lab3-clean_edge Removed + Network mtusi2026lab3-clean_backend Removed exit=0 -$ docker volume ls --format '{{.Name}}' --filter name=mtusi2026lab3-clean +$ docker volume ls --format '{{.Name}}' --filter label=com.docker.compose.project=mtusi2026lab3-clean # наблюдение, не шаг инструкции mtusi2026lab3-clean_pgdata mtusi2026lab3-clean_valkeydata -exit=0 $ make reset-data Удаляются volumes с учебными данными стенда docker compose --profile bench down -v --remove-orphans - Volume mtusi2026lab3-clean_valkeydata Removing Volume mtusi2026lab3-clean_pgdata Removing - Volume mtusi2026lab3-clean_valkeydata Removed + Volume mtusi2026lab3-clean_valkeydata Removing Volume mtusi2026lab3-clean_pgdata Removed + Volume mtusi2026lab3-clean_valkeydata Removed exit=0 -$ docker volume ls --format '{{.Name}}' --filter name=mtusi2026lab3-clean | wc -l | tr -d ' ' +$ docker volume ls -q --filter label=com.docker.compose.project=mtusi2026lab3-clean | wc -l | tr -d ' ' # наблюдение, не шаг инструкции 0 -exit=0 diff --git a/evidence/detection/run1/kill.json b/evidence/detection/run1/kill.json index 60e3b759..9277e399 100644 --- a/evidence/detection/run1/kill.json +++ b/evidence/detection/run1/kill.json @@ -2,13 +2,13 @@ "action": [ "docker", "kill", - "286766bf2b32a1e082437ea6f0d2becd16b11e4269ec324573f31e615a2da62e" + "ff81f93e8b0d3eba1c06f5017cbe7e44747a32708857ccf83f613c06eea429f3" ], "action_exit": 0, - "action_seconds": 0.127, + "action_seconds": 0.119, "lb_up_before": 2, "lb_up_counted_as_detected": 1, - "detection_seconds": 0.538, + "detection_seconds": 0.429, "declared_max_seconds": 1.5, "measurement_slack_seconds": 0.25, "lb_answer_after_detection": { @@ -18,7 +18,7 @@ "error_code": null }, "restore": "scripts/restore.sh", - "restore_seconds": 3.047, + "restore_seconds": 3.006, "lb_up_after_restore": 2, "checks": { "action_ok": true, diff --git a/evidence/detection/run1/pause.json b/evidence/detection/run1/pause.json index 3dad31aa..2285b984 100644 --- a/evidence/detection/run1/pause.json +++ b/evidence/detection/run1/pause.json @@ -2,13 +2,13 @@ "action": [ "docker", "pause", - "286766bf2b32a1e082437ea6f0d2becd16b11e4269ec324573f31e615a2da62e" + "ff81f93e8b0d3eba1c06f5017cbe7e44747a32708857ccf83f613c06eea429f3" ], "action_exit": 0, - "action_seconds": 0.054, + "action_seconds": 0.063, "lb_up_before": 2, "lb_up_counted_as_detected": 1, - "detection_seconds": 2.947, + "detection_seconds": 2.926, "declared_max_seconds": 3.5, "measurement_slack_seconds": 0.25, "lb_answer_after_detection": { @@ -17,8 +17,8 @@ "x_instance_id_present": true, "error_code": null }, - "restore": "docker unpause 286766bf2b32a1e082437ea6f0d2becd16b11e4269ec324573f31e615a2da62e && scripts/lb-wait.sh", - "restore_seconds": 2.614, + "restore": "docker unpause ff81f93e8b0d3eba1c06f5017cbe7e44747a32708857ccf83f613c06eea429f3 && scripts/lb-wait.sh", + "restore_seconds": 2.365, "lb_up_after_restore": 2, "checks": { "action_ok": true, diff --git a/evidence/detection/run1/postgres.json b/evidence/detection/run1/postgres.json index 80b842e6..9a58bd60 100644 --- a/evidence/detection/run1/postgres.json +++ b/evidence/detection/run1/postgres.json @@ -2,13 +2,13 @@ "action": [ "docker", "stop", - "308851b9dd07c2bc70028bf7010968d5fad7cd759e7043a5eb16776c7163cc59" + "cd7b0d78bc19e016ceffb81b83e0286012fc8bf779ae2724c52f5477ee04e19f" ], "action_exit": 0, - "action_seconds": 0.17, + "action_seconds": 0.121, "lb_up_before": 2, "lb_up_counted_as_detected": 0, - "detection_seconds": 0.925, + "detection_seconds": 1.266, "declared_max_seconds": 1.5, "measurement_slack_seconds": 0.25, "lb_answer_after_detection": { @@ -17,8 +17,8 @@ "x_instance_id_present": false, "error_code": "unavailable" }, - "restore": "docker start 308851b9dd07c2bc70028bf7010968d5fad7cd759e7043a5eb16776c7163cc59 && scripts/lb-wait.sh", - "restore_seconds": 2.491, + "restore": "docker start cd7b0d78bc19e016ceffb81b83e0286012fc8bf779ae2724c52f5477ee04e19f && scripts/lb-wait.sh", + "restore_seconds": 2.475, "lb_up_after_restore": 2, "checks": { "action_ok": true, diff --git a/evidence/detection/run1/sigterm.json b/evidence/detection/run1/sigterm.json index 939d38a8..31b5abd3 100644 --- a/evidence/detection/run1/sigterm.json +++ b/evidence/detection/run1/sigterm.json @@ -4,13 +4,13 @@ "stop", "-t", "7", - "286766bf2b32a1e082437ea6f0d2becd16b11e4269ec324573f31e615a2da62e" + "ff81f93e8b0d3eba1c06f5017cbe7e44747a32708857ccf83f613c06eea429f3" ], "action_exit": 0, - "action_seconds": 2.608, + "action_seconds": 2.539, "lb_up_before": 2, "lb_up_counted_as_detected": 1, - "detection_seconds": 0.988, + "detection_seconds": 1.259, "declared_max_seconds": 1.5, "measurement_slack_seconds": 0.25, "lb_answer_after_detection": { @@ -20,7 +20,7 @@ "error_code": null }, "restore": "scripts/restore.sh", - "restore_seconds": 1.955, + "restore_seconds": 2.514, "lb_up_after_restore": 2, "checks": { "action_ok": true, diff --git a/evidence/detection/run2/kill.json b/evidence/detection/run2/kill.json index 07135186..086030d4 100644 --- a/evidence/detection/run2/kill.json +++ b/evidence/detection/run2/kill.json @@ -2,13 +2,13 @@ "action": [ "docker", "kill", - "286766bf2b32a1e082437ea6f0d2becd16b11e4269ec324573f31e615a2da62e" + "ff81f93e8b0d3eba1c06f5017cbe7e44747a32708857ccf83f613c06eea429f3" ], "action_exit": 0, - "action_seconds": 0.114, + "action_seconds": 0.173, "lb_up_before": 2, "lb_up_counted_as_detected": 1, - "detection_seconds": 0.47, + "detection_seconds": 0.526, "declared_max_seconds": 1.5, "measurement_slack_seconds": 0.25, "lb_answer_after_detection": { @@ -18,7 +18,7 @@ "error_code": null }, "restore": "scripts/restore.sh", - "restore_seconds": 2.649, + "restore_seconds": 2.985, "lb_up_after_restore": 2, "checks": { "action_ok": true, diff --git a/evidence/detection/run2/pause.json b/evidence/detection/run2/pause.json index 39502834..19a89fbc 100644 --- a/evidence/detection/run2/pause.json +++ b/evidence/detection/run2/pause.json @@ -2,13 +2,13 @@ "action": [ "docker", "pause", - "286766bf2b32a1e082437ea6f0d2becd16b11e4269ec324573f31e615a2da62e" + "ff81f93e8b0d3eba1c06f5017cbe7e44747a32708857ccf83f613c06eea429f3" ], "action_exit": 0, - "action_seconds": 0.061, + "action_seconds": 0.063, "lb_up_before": 2, "lb_up_counted_as_detected": 1, - "detection_seconds": 3.225, + "detection_seconds": 3.063, "declared_max_seconds": 3.5, "measurement_slack_seconds": 0.25, "lb_answer_after_detection": { @@ -17,8 +17,8 @@ "x_instance_id_present": true, "error_code": null }, - "restore": "docker unpause 286766bf2b32a1e082437ea6f0d2becd16b11e4269ec324573f31e615a2da62e && scripts/lb-wait.sh", - "restore_seconds": 2.859, + "restore": "docker unpause ff81f93e8b0d3eba1c06f5017cbe7e44747a32708857ccf83f613c06eea429f3 && scripts/lb-wait.sh", + "restore_seconds": 2.353, "lb_up_after_restore": 2, "checks": { "action_ok": true, diff --git a/evidence/detection/run2/postgres.json b/evidence/detection/run2/postgres.json index e19b857e..618e6452 100644 --- a/evidence/detection/run2/postgres.json +++ b/evidence/detection/run2/postgres.json @@ -2,13 +2,13 @@ "action": [ "docker", "stop", - "308851b9dd07c2bc70028bf7010968d5fad7cd759e7043a5eb16776c7163cc59" + "cd7b0d78bc19e016ceffb81b83e0286012fc8bf779ae2724c52f5477ee04e19f" ], "action_exit": 0, - "action_seconds": 0.166, + "action_seconds": 0.171, "lb_up_before": 2, "lb_up_counted_as_detected": 0, - "detection_seconds": 1.443, + "detection_seconds": 1.263, "declared_max_seconds": 1.5, "measurement_slack_seconds": 0.25, "lb_answer_after_detection": { @@ -17,8 +17,8 @@ "x_instance_id_present": false, "error_code": "unavailable" }, - "restore": "docker start 308851b9dd07c2bc70028bf7010968d5fad7cd759e7043a5eb16776c7163cc59 && scripts/lb-wait.sh", - "restore_seconds": 2.476, + "restore": "docker start cd7b0d78bc19e016ceffb81b83e0286012fc8bf779ae2724c52f5477ee04e19f && scripts/lb-wait.sh", + "restore_seconds": 2.417, "lb_up_after_restore": 2, "checks": { "action_ok": true, diff --git a/evidence/detection/run2/sigterm.json b/evidence/detection/run2/sigterm.json index c28ebcd5..b111e058 100644 --- a/evidence/detection/run2/sigterm.json +++ b/evidence/detection/run2/sigterm.json @@ -4,13 +4,13 @@ "stop", "-t", "7", - "286766bf2b32a1e082437ea6f0d2becd16b11e4269ec324573f31e615a2da62e" + "ff81f93e8b0d3eba1c06f5017cbe7e44747a32708857ccf83f613c06eea429f3" ], "action_exit": 0, - "action_seconds": 2.526, + "action_seconds": 2.471, "lb_up_before": 2, "lb_up_counted_as_detected": 1, - "detection_seconds": 1.199, + "detection_seconds": 1.348, "declared_max_seconds": 1.5, "measurement_slack_seconds": 0.25, "lb_answer_after_detection": { @@ -20,7 +20,7 @@ "error_code": null }, "restore": "scripts/restore.sh", - "restore_seconds": 2.503, + "restore_seconds": 3.555, "lb_up_after_restore": 2, "checks": { "action_ok": true, diff --git a/evidence/detection/run3/kill.json b/evidence/detection/run3/kill.json index 45f77928..ef0ec1f7 100644 --- a/evidence/detection/run3/kill.json +++ b/evidence/detection/run3/kill.json @@ -2,13 +2,13 @@ "action": [ "docker", "kill", - "286766bf2b32a1e082437ea6f0d2becd16b11e4269ec324573f31e615a2da62e" + "ff81f93e8b0d3eba1c06f5017cbe7e44747a32708857ccf83f613c06eea429f3" ], "action_exit": 0, - "action_seconds": 0.116, + "action_seconds": 0.119, "lb_up_before": 2, "lb_up_counted_as_detected": 1, - "detection_seconds": 0.49, + "detection_seconds": 0.42, "declared_max_seconds": 1.5, "measurement_slack_seconds": 0.25, "lb_answer_after_detection": { @@ -18,7 +18,7 @@ "error_code": null }, "restore": "scripts/restore.sh", - "restore_seconds": 3.043, + "restore_seconds": 3.037, "lb_up_after_restore": 2, "checks": { "action_ok": true, diff --git a/evidence/detection/run3/pause.json b/evidence/detection/run3/pause.json index 432df434..45ba98f9 100644 --- a/evidence/detection/run3/pause.json +++ b/evidence/detection/run3/pause.json @@ -2,13 +2,13 @@ "action": [ "docker", "pause", - "286766bf2b32a1e082437ea6f0d2becd16b11e4269ec324573f31e615a2da62e" + "ff81f93e8b0d3eba1c06f5017cbe7e44747a32708857ccf83f613c06eea429f3" ], "action_exit": 0, - "action_seconds": 0.06, + "action_seconds": 0.056, "lb_up_before": 2, "lb_up_counted_as_detected": 1, - "detection_seconds": 2.908, + "detection_seconds": 2.981, "declared_max_seconds": 3.5, "measurement_slack_seconds": 0.25, "lb_answer_after_detection": { @@ -17,8 +17,8 @@ "x_instance_id_present": true, "error_code": null }, - "restore": "docker unpause 286766bf2b32a1e082437ea6f0d2becd16b11e4269ec324573f31e615a2da62e && scripts/lb-wait.sh", - "restore_seconds": 2.366, + "restore": "docker unpause ff81f93e8b0d3eba1c06f5017cbe7e44747a32708857ccf83f613c06eea429f3 && scripts/lb-wait.sh", + "restore_seconds": 2.347, "lb_up_after_restore": 2, "checks": { "action_ok": true, diff --git a/evidence/detection/run3/postgres.json b/evidence/detection/run3/postgres.json index c996dc5a..76467251 100644 --- a/evidence/detection/run3/postgres.json +++ b/evidence/detection/run3/postgres.json @@ -2,13 +2,13 @@ "action": [ "docker", "stop", - "308851b9dd07c2bc70028bf7010968d5fad7cd759e7043a5eb16776c7163cc59" + "cd7b0d78bc19e016ceffb81b83e0286012fc8bf779ae2724c52f5477ee04e19f" ], "action_exit": 0, - "action_seconds": 0.167, + "action_seconds": 0.124, "lb_up_before": 2, "lb_up_counted_as_detected": 0, - "detection_seconds": 1.243, + "detection_seconds": 1.264, "declared_max_seconds": 1.5, "measurement_slack_seconds": 0.25, "lb_answer_after_detection": { @@ -17,8 +17,8 @@ "x_instance_id_present": false, "error_code": "unavailable" }, - "restore": "docker start 308851b9dd07c2bc70028bf7010968d5fad7cd759e7043a5eb16776c7163cc59 && scripts/lb-wait.sh", - "restore_seconds": 2.651, + "restore": "docker start cd7b0d78bc19e016ceffb81b83e0286012fc8bf779ae2724c52f5477ee04e19f && scripts/lb-wait.sh", + "restore_seconds": 2.444, "lb_up_after_restore": 2, "checks": { "action_ok": true, diff --git a/evidence/detection/run3/sigterm.json b/evidence/detection/run3/sigterm.json index 3ab368d1..34dc60e5 100644 --- a/evidence/detection/run3/sigterm.json +++ b/evidence/detection/run3/sigterm.json @@ -4,13 +4,13 @@ "stop", "-t", "7", - "286766bf2b32a1e082437ea6f0d2becd16b11e4269ec324573f31e615a2da62e" + "ff81f93e8b0d3eba1c06f5017cbe7e44747a32708857ccf83f613c06eea429f3" ], "action_exit": 0, - "action_seconds": 2.586, + "action_seconds": 2.555, "lb_up_before": 2, "lb_up_counted_as_detected": 1, - "detection_seconds": 1.43, + "detection_seconds": 1.289, "declared_max_seconds": 1.5, "measurement_slack_seconds": 0.25, "lb_answer_after_detection": { @@ -20,7 +20,7 @@ "error_code": null }, "restore": "scripts/restore.sh", - "restore_seconds": 3.628, + "restore_seconds": 3.552, "lb_up_after_restore": 2, "checks": { "action_ok": true, diff --git a/evidence/environment.txt b/evidence/environment.txt index 734fe9c9..d7cdff7d 100644 --- a/evidence/environment.txt +++ b/evidence/environment.txt @@ -1,4 +1,4 @@ -date: 2026-10-29T23:43:44Z commit: b1c80ee +date: 2026-10-30T02:45:02Z commit: e049c26 host: Apple M4 Max, 16 CPU, 48 GiB RAM, macOS 15.1 docker: 28.3.2, VM: 16 CPU, 8217190400 bytes compose: 2.38.2-desktop.1 diff --git a/evidence/failover-286766bf2b32.txt b/evidence/failover-286766bf2b32.txt deleted file mode 100644 index 9cd9ae0d..00000000 --- a/evidence/failover-286766bf2b32.txt +++ /dev/null @@ -1,39 +0,0 @@ -date: 2026-10-29T23:43:49Z commit: b1c80ee -== before: api replicas (hostname = X-Instance-Id), state, StartedAt, FinishedAt -286766bf2b32 running started=2026-10-29T23:43:39.158178679Z finished=0001-01-01T00:00:00Z -fa81adafcb69 running started=2026-10-29T23:43:39.090674429Z finished=0001-01-01T00:00:00Z -$ make test-failover ACTION_SCRIPT=scripts/stop-one.sh -python3 tests/resilience.py --mode failover --action-script "scripts/stop-one.sh" --base-url "http://127.0.0.1:18083" -Executing explicit failover hook; hook output suppressed to avoid leaking secrets. -{"observed_instances_before": 2, "successful_writes": 139, "failed_attempts": 0, "first_recovery_seconds": 2.639} -PASS: failover preserved confirmed data and existing session. Hook scope needs operator evidence. -== after: api replicas -286766bf2b32 exited started=2026-10-29T23:43:39.158178679Z finished=2026-10-29T23:43:52.024916004Z -fa81adafcb69 running started=2026-10-29T23:43:39.090674429Z finished=0001-01-01T00:00:00Z -== stopped replica: 286766bf2b32; shutdown: signal, drain window with readiness 503, close, exit -{"event":"Handling signal: term","level":"info","ts":"2026-10-29T23:43:49.617159Z"} -{"event":"Draining for 2.0 s","level":"info","ts":"2026-10-29T23:43:49.672659Z"} -{"event":"Draining for 2.0 s","level":"info","ts":"2026-10-29T23:43:49.716939Z"} -{"method":"GET","route":"/health/ready","status":503,"request_id":"544aa3fd6a1842c9bb7b309f3f9e1022","duration_ms":0.346,"event":"request.handled","level":"info","ts":"2026-10-29T23:43:50.343893Z"} -{"method":"GET","route":"/health/ready","status":503,"request_id":"c3ffdaf835ee43f99e15261c6daa2509","duration_ms":0.241,"event":"request.handled","level":"info","ts":"2026-10-29T23:43:50.466790Z"} -{"method":"GET","route":"/health/ready","status":503,"request_id":"bae40f2979f741cc89c1c8b50bde43bd","duration_ms":0.295,"event":"request.handled","level":"info","ts":"2026-10-29T23:43:50.845919Z"} -{"event":"Shutting down","level":"info","ts":"2026-10-29T23:43:51.673360Z"} -{"event":"Shutting down","level":"info","ts":"2026-10-29T23:43:51.717342Z"} -{"event":"service.stopped","level":"info","ts":"2026-10-29T23:43:51.776477Z"} -{"event":"Finished server process [20]","level":"info","ts":"2026-10-29T23:43:51.776615Z"} -{"event":"service.stopped","level":"info","ts":"2026-10-29T23:43:51.820679Z"} -{"event":"Finished server process [13]","level":"info","ts":"2026-10-29T23:43:51.820809Z"} -{"event":"Worker (pid:13) was sent SIGTERM!","level":"info","ts":"2026-10-29T23:43:51.852336Z"} -{"event":"Worker (pid:20) was sent SIGTERM!","level":"info","ts":"2026-10-29T23:43:51.852411Z"} -{"event":"Shutting down: Master","level":"info","ts":"2026-10-29T23:43:51.953368Z"} -$ scripts/restore.sh - Container mtusi2026lab3-api-2 Running - Container mtusi2026lab3-api-1 Starting - Container mtusi2026lab3-api-1 Started - Container mtusi2026lab3-api-2 Waiting - Container mtusi2026lab3-api-1 Waiting - Container mtusi2026lab3-api-2 Healthy - Container mtusi2026lab3-api-1 Healthy -== after restore -286766bf2b32 running started=2026-10-29T23:44:05.033337427Z finished=2026-10-29T23:43:52.024916004Z -fa81adafcb69 running started=2026-10-29T23:43:39.090674429Z finished=0001-01-01T00:00:00Z diff --git a/evidence/failover-each/286766bf2b32/action.txt b/evidence/failover-each/286766bf2b32/action.txt deleted file mode 100644 index 351f4273..00000000 --- a/evidence/failover-each/286766bf2b32/action.txt +++ /dev/null @@ -1,9 +0,0 @@ -286766bf2b32 api Exited (0) Less than a second ago -fa81adafcb69 api Up About a minute (healthy) - Container mtusi2026lab3-api-2 Running - Container mtusi2026lab3-api-1 Starting - Container mtusi2026lab3-api-1 Started - Container mtusi2026lab3-api-2 Waiting - Container mtusi2026lab3-api-1 Waiting - Container mtusi2026lab3-api-2 Healthy - Container mtusi2026lab3-api-1 Healthy diff --git a/evidence/failover-each/286766bf2b32/k6/k6.txt b/evidence/failover-each/286766bf2b32/k6/k6.txt deleted file mode 100644 index 15df9df3..00000000 --- a/evidence/failover-each/286766bf2b32/k6/k6.txt +++ /dev/null @@ -1,2 +0,0 @@ -time="2026-10-29T23:46:45Z" level=info msg=LOAD-START source=console -measure: 6000 requests, failed ratio 0 diff --git a/evidence/failover-each/286766bf2b32/lb_up.csv b/evidence/failover-each/286766bf2b32/lb_up.csv deleted file mode 100644 index 866a1ad9..00000000 --- a/evidence/failover-each/286766bf2b32/lb_up.csv +++ /dev/null @@ -1,668 +0,0 @@ -t_rel_s,up --26.015,2 --25.912,2 --25.808,2 --25.704,2 --25.596,2 --25.487,2 --25.384,2 --25.277,2 --25.169,2 --25.062,2 --24.953,2 --24.845,2 --24.736,2 --24.63,2 --24.521,2 --24.41,2 --24.304,2 --24.199,2 --24.093,2 --23.986,2 --23.879,2 --23.771,2 --23.662,2 --23.554,2 --23.45,2 --23.341,2 --23.232,2 --23.12,2 --23.012,2 --22.905,2 --22.793,2 --22.687,2 --22.566,2 --22.462,2 --22.355,2 --22.251,2 --22.137,2 --22.024,2 --21.91,2 --21.803,2 --21.695,2 --21.582,2 --21.475,2 --21.365,2 --21.261,2 --21.153,2 --21.043,2 --20.938,2 --20.83,2 --20.726,2 --20.623,2 --20.513,2 --20.386,2 --20.279,2 --20.169,2 --20.048,2 --19.942,2 --19.838,2 --19.732,2 --19.628,2 --19.517,2 --19.411,2 --19.303,2 --19.195,2 --19.092,2 --18.984,2 --18.875,2 --18.767,2 --18.659,2 --18.549,2 --18.442,2 --18.334,2 --18.229,2 --18.125,2 --18.019,2 --17.911,2 --17.799,2 --17.691,2 --17.584,2 --17.476,2 --17.37,2 --17.264,2 --17.16,2 --17.052,2 --16.948,2 --16.843,2 --16.737,2 --16.632,2 --16.525,2 --16.418,2 --16.316,2 --16.207,2 --16.101,2 --15.993,2 --15.883,2 --15.776,2 --15.67,2 --15.567,2 --15.457,2 --15.348,2 --15.245,2 --15.137,2 --15.028,2 --14.922,2 --14.814,2 --14.708,2 --14.604,2 --14.499,2 --14.392,2 --14.282,2 --14.174,2 --14.065,2 --13.958,2 --13.855,2 --13.747,2 --13.64,2 --13.536,2 --13.428,2 --13.321,2 --13.218,2 --13.113,2 --13.008,2 --12.9,2 --12.794,2 --12.687,2 --12.58,2 --12.471,2 --12.367,2 --12.25,2 --12.143,2 --12.035,2 --11.928,2 --11.816,2 --11.709,2 --11.599,2 --11.496,2 --11.387,2 --11.267,2 --11.162,2 --11.057,2 --10.951,2 --10.842,2 --10.73,2 --10.628,2 --10.514,2 --10.405,2 --10.302,2 --10.194,2 --10.086,2 --9.979,2 --9.871,2 --9.767,2 --9.662,2 --9.554,2 --9.443,2 --9.333,2 --9.229,2 --9.117,2 --9.006,2 --8.899,2 --8.795,2 --8.687,2 --8.583,2 --8.475,2 --8.368,2 --8.261,2 --8.156,2 --8.052,2 --7.944,2 --7.835,2 --7.729,2 --7.621,2 --7.512,2 --7.403,2 --7.294,2 --7.186,2 --7.079,2 --6.969,2 --6.861,2 --6.752,2 --6.644,2 --6.535,2 --6.428,2 --6.317,2 --6.211,2 --6.099,2 --5.991,2 --5.882,2 --5.78,2 --5.665,2 --5.559,2 --5.45,2 --5.342,2 --5.231,2 --5.127,2 --5.023,2 --4.916,2 --4.808,2 --4.7,2 --4.595,2 --4.486,2 --4.381,2 --4.272,2 --4.162,2 --4.055,2 --3.95,2 --3.84,2 --3.734,2 --3.63,2 --3.519,2 --3.404,2 --3.297,2 --3.191,2 --3.085,2 --2.979,2 --2.87,2 --2.762,2 --2.654,2 --2.547,2 --2.441,2 --2.332,2 --2.23,2 --2.117,2 --2.011,2 --1.9,2 --1.793,2 --1.686,2 --1.58,2 --1.469,2 --1.365,2 --1.258,2 --1.149,2 --1.042,2 --0.937,2 --0.832,2 --0.724,2 --0.619,2 --0.512,2 --0.405,2 --0.295,2 --0.186,2 --0.079,2 -0.032,2 -0.148,2 -0.269,2 -0.377,2 -0.488,2 -0.598,2 -0.704,2 -0.816,2 -0.926,1 -1.032,1 -1.139,1 -1.254,1 -1.363,1 -1.467,1 -1.578,1 -1.69,1 -1.801,1 -1.906,1 -2.014,1 -2.12,1 -2.231,1 -2.346,1 -2.459,1 -2.569,1 -2.672,1 -2.782,1 -2.889,1 -2.993,1 -3.1,1 -3.206,1 -3.313,1 -3.416,1 -3.523,1 -3.629,1 -3.736,1 -3.844,1 -3.947,1 -4.053,1 -4.165,1 -4.272,1 -4.38,1 -4.487,1 -4.592,1 -4.698,1 -4.805,1 -4.914,1 -5.023,1 -5.132,1 -5.24,1 -5.345,1 -5.45,1 -5.558,1 -5.661,1 -5.768,1 -5.876,1 -5.983,1 -6.089,1 -6.197,1 -6.306,1 -6.411,1 -6.514,1 -6.619,1 -6.722,1 -6.828,1 -6.933,1 -7.039,1 -7.145,1 -7.25,1 -7.356,1 -7.461,1 -7.57,1 -7.675,1 -7.783,1 -7.889,1 -7.998,1 -8.109,1 -8.216,1 -8.34,1 -8.448,1 -8.556,1 -8.662,1 -8.764,1 -8.868,1 -8.973,1 -9.077,1 -9.183,1 -9.292,1 -9.401,1 -9.509,1 -9.618,1 -9.725,1 -9.83,1 -9.937,1 -10.043,1 -10.15,1 -10.259,1 -10.368,1 -10.483,1 -10.591,1 -10.697,1 -10.804,1 -10.912,1 -11.015,1 -11.117,1 -11.221,1 -11.325,1 -11.432,1 -11.539,1 -11.646,1 -11.752,1 -11.858,1 -11.963,1 -12.065,1 -12.169,1 -12.272,1 -12.378,1 -12.487,1 -12.592,1 -12.7,1 -12.808,1 -12.911,1 -13.013,1 -13.12,1 -13.227,1 -13.332,1 -13.439,1 -13.543,1 -13.653,1 -13.761,1 -13.868,1 -13.976,1 -14.082,1 -14.185,1 -14.288,1 -14.396,1 -14.501,1 -14.609,1 -14.716,1 -14.824,1 -14.932,2 -15.038,2 -15.143,2 -15.25,2 -15.353,2 -15.459,2 -15.568,2 -15.676,2 -15.785,2 -15.894,2 -16.004,2 -16.111,2 -16.214,2 -16.321,2 -16.429,2 -16.538,2 -16.645,2 -16.75,2 -16.857,2 -16.965,2 -17.069,2 -17.179,2 -17.287,2 -17.394,2 -17.502,2 -17.606,2 -17.71,2 -17.818,2 -17.926,2 -18.034,2 -18.138,2 -18.244,2 -18.351,2 -18.457,2 -18.57,2 -18.673,2 -18.784,2 -18.89,2 -19.001,2 -19.105,2 -19.213,2 -19.321,2 -19.426,2 -19.534,2 -19.64,2 -19.745,2 -19.854,2 -19.96,2 -20.065,2 -20.173,2 -20.28,2 -20.39,2 -20.498,2 -20.607,2 -20.716,2 -20.825,2 -20.934,2 -21.043,2 -21.15,2 -21.259,2 -21.364,2 -21.47,2 -21.575,2 -21.681,2 -21.787,2 -21.895,2 -21.999,2 -22.105,2 -22.213,2 -22.32,2 -22.427,2 -22.535,2 -22.642,2 -22.749,2 -22.857,2 -22.961,2 -23.071,2 -23.178,2 -23.286,2 -23.393,2 -23.5,2 -23.608,2 -23.712,2 -23.82,2 -23.925,2 -24.032,2 -24.142,2 -24.247,2 -24.354,2 -24.46,2 -24.564,2 -24.671,2 -24.778,2 -24.891,2 -25.0,2 -25.105,2 -25.21,2 -25.312,2 -25.42,2 -25.526,2 -25.635,2 -25.74,2 -25.848,2 -25.963,2 -26.07,2 -26.176,2 -26.283,2 -26.386,2 -26.495,2 -26.601,2 -26.709,2 -26.813,2 -26.924,2 -27.03,2 -27.136,2 -27.247,2 -27.355,2 -27.465,2 -27.574,2 -27.68,2 -27.789,2 -27.895,2 -28.001,2 -28.107,2 -28.212,2 -28.317,2 -28.42,2 -28.528,2 -28.635,2 -28.738,2 -28.845,2 -28.954,2 -29.06,2 -29.166,2 -29.271,2 -29.38,2 -29.484,2 -29.591,2 -29.698,2 -29.803,2 -29.91,2 -30.017,2 -30.122,2 -30.229,2 -30.337,2 -30.443,2 -30.55,2 -30.655,2 -30.762,2 -30.87,2 -30.976,2 -31.083,2 -31.191,2 -31.299,2 -31.403,2 -31.507,2 -31.612,2 -31.719,2 -31.826,2 -31.934,2 -32.039,2 -32.149,2 -32.257,2 -32.365,2 -32.469,2 -32.571,2 -32.68,2 -32.788,2 -32.899,2 -33.005,2 -33.11,2 -33.214,2 -33.321,2 -33.43,2 -33.538,2 -33.646,2 -33.752,2 -33.856,2 -33.964,2 -34.069,2 -34.173,2 -34.279,2 -34.387,2 -34.496,2 -34.603,2 -34.713,2 -34.822,2 -34.931,2 -35.039,2 -35.148,2 -35.257,2 -35.363,2 -35.472,2 -35.581,2 -35.686,2 -35.792,2 -35.9,2 -36.006,2 -36.114,2 -36.22,2 -36.326,2 -36.43,2 -36.534,2 -36.638,2 -36.742,2 -36.847,2 -36.95,2 -37.057,2 -37.163,2 -37.293,2 -37.401,2 -37.51,2 -37.639,2 -37.759,2 -37.863,2 -37.97,2 -38.075,2 -38.18,2 -38.287,2 -38.392,2 -38.498,2 -38.606,2 -38.714,2 -38.822,2 -38.929,2 -39.033,2 -39.138,2 -39.247,2 -39.352,2 -39.456,2 -39.565,2 -39.67,2 -39.774,2 -39.883,2 -39.992,2 -40.106,2 -40.221,2 -40.328,2 -40.442,2 -40.547,2 -40.655,2 -40.77,2 -40.88,2 -40.987,2 -41.09,2 -41.194,2 -41.3,2 -41.404,2 -41.511,2 -41.618,2 -41.726,2 -41.833,2 -41.94,2 -42.046,2 -42.154,2 -42.264,2 -42.371,2 -42.482,2 -42.59,2 -42.695,2 -42.802,2 -42.906,2 -43.016,2 -43.12,2 -43.229,2 -43.333,2 -43.442,2 -43.55,2 -43.657,2 -43.761,2 -43.868,2 -43.976,2 -44.084,2 -44.188,2 -44.292,2 -44.4,2 -44.506,2 -44.616,2 -44.738,2 -44.852,2 -44.958,2 -45.065,2 -45.173,2 -45.281,2 -45.389,2 -45.496,2 diff --git a/evidence/failover-each/286766bf2b32/probe.csv b/evidence/failover-each/286766bf2b32/probe.csv deleted file mode 100644 index cd7f09ca..00000000 --- a/evidence/failover-each/286766bf2b32/probe.csv +++ /dev/null @@ -1,656 +0,0 @@ -t_rel_s,status,latency_ms,instance --26.015,201,17.4,286766bf2b32 --25.898,201,9.6,fa81adafcb69 --25.787,201,4.4,286766bf2b32 --25.68,201,9.6,fa81adafcb69 --25.567,201,4.5,fa81adafcb69 --25.462,201,4.4,286766bf2b32 --25.353,201,3.5,fa81adafcb69 --25.245,201,4.9,286766bf2b32 --25.138,201,4.9,fa81adafcb69 --25.03,201,5.0,286766bf2b32 --24.92,201,3.5,fa81adafcb69 --24.813,201,4.6,fa81adafcb69 --24.705,201,5.1,fa81adafcb69 --24.6,201,6.7,286766bf2b32 --24.491,201,6.4,286766bf2b32 --24.38,201,4.4,286766bf2b32 --24.275,201,5.1,286766bf2b32 --24.168,201,4.4,fa81adafcb69 --24.059,201,4.0,fa81adafcb69 --23.953,201,4.2,fa81adafcb69 --23.844,201,4.2,286766bf2b32 --23.739,201,7.4,286766bf2b32 --23.63,201,10.5,286766bf2b32 --23.515,201,6.1,fa81adafcb69 --23.408,201,9.8,286766bf2b32 --23.297,201,8.3,286766bf2b32 --23.188,201,5.7,286766bf2b32 --23.079,201,5.5,286766bf2b32 --22.969,201,40.6,fa81adafcb69 --22.824,201,5.3,286766bf2b32 --22.716,201,5.0,fa81adafcb69 --22.609,201,10.7,286766bf2b32 --22.497,201,5.4,fa81adafcb69 --22.392,201,7.1,fa81adafcb69 --22.28,201,48.0,286766bf2b32 --22.129,201,10.8,fa81adafcb69 --22.015,201,10.9,fa81adafcb69 --21.904,201,4.6,fa81adafcb69 --21.795,201,13.1,286766bf2b32 --21.678,201,9.4,286766bf2b32 --21.566,201,4.9,286766bf2b32 --21.46,201,7.8,286766bf2b32 --21.349,201,3.9,286766bf2b32 --21.242,201,5.8,286766bf2b32 --21.135,201,4.5,fa81adafcb69 --21.028,201,6.0,fa81adafcb69 --20.922,201,3.6,fa81adafcb69 --20.818,201,3.4,286766bf2b32 --20.712,201,9.2,286766bf2b32 --20.6,201,5.2,286766bf2b32 --20.489,201,10.9,286766bf2b32 --20.377,201,4.4,286766bf2b32 --20.267,201,12.0,fa81adafcb69 --20.149,201,24.3,fa81adafcb69 --20.022,201,4.0,fa81adafcb69 --19.913,201,6.1,fa81adafcb69 --19.801,201,5.9,fa81adafcb69 --19.69,201,4.8,fa81adafcb69 --19.58,201,10.7,fa81adafcb69 --19.464,201,4.6,286766bf2b32 --19.359,201,7.8,fa81adafcb69 --19.25,201,4.0,fa81adafcb69 --19.145,201,9.7,fa81adafcb69 --19.035,201,4.2,fa81adafcb69 --18.925,201,6.4,fa81adafcb69 --18.814,201,8.1,fa81adafcb69 --18.704,201,4.3,fa81adafcb69 --18.595,201,9.5,fa81adafcb69 --18.481,201,10.5,fa81adafcb69 --18.367,201,4.9,fa81adafcb69 --18.259,201,4.1,fa81adafcb69 --18.152,201,4.2,fa81adafcb69 --18.044,201,8.0,fa81adafcb69 --17.934,201,7.7,fa81adafcb69 --17.824,201,4.6,286766bf2b32 --17.715,201,5.5,fa81adafcb69 --17.609,201,9.7,fa81adafcb69 --17.494,201,5.3,286766bf2b32 --17.385,201,4.5,286766bf2b32 --17.277,201,7.5,286766bf2b32 --17.166,201,3.6,286766bf2b32 --17.058,201,4.9,286766bf2b32 --16.95,201,5.7,286766bf2b32 --16.84,201,4.4,286766bf2b32 --16.736,201,3.9,fa81adafcb69 --16.632,201,8.5,fa81adafcb69 --16.523,201,4.6,fa81adafcb69 --16.416,201,3.4,286766bf2b32 --16.312,201,12.3,286766bf2b32 --16.195,201,5.9,286766bf2b32 --16.084,201,3.7,fa81adafcb69 --15.978,201,9.1,fa81adafcb69 --15.866,201,4.3,286766bf2b32 --15.761,201,4.9,286766bf2b32 --15.654,201,4.2,fa81adafcb69 --15.548,201,3.9,fa81adafcb69 --15.442,201,9.3,fa81adafcb69 --15.331,201,7.0,fa81adafcb69 --15.22,201,4.7,fa81adafcb69 --15.115,201,4.8,286766bf2b32 --15.007,201,5.4,286766bf2b32 --14.899,201,4.0,fa81adafcb69 --14.79,201,3.9,fa81adafcb69 --14.681,201,5.8,fa81adafcb69 --14.571,201,4.4,fa81adafcb69 --14.463,201,5.7,fa81adafcb69 --14.352,201,4.5,fa81adafcb69 --14.243,201,4.5,fa81adafcb69 --14.134,201,5.2,286766bf2b32 --14.024,201,3.9,286766bf2b32 --13.917,201,3.9,286766bf2b32 --13.81,201,5.7,286766bf2b32 --13.701,201,3.9,286766bf2b32 --13.592,201,4.1,286766bf2b32 --13.485,201,4.8,fa81adafcb69 --13.375,201,4.7,fa81adafcb69 --13.269,201,3.7,fa81adafcb69 --13.162,201,7.1,fa81adafcb69 --13.053,201,5.0,fa81adafcb69 --12.945,201,5.2,286766bf2b32 --12.839,201,3.1,286766bf2b32 --12.731,201,8.6,286766bf2b32 --12.619,201,5.4,286766bf2b32 --12.509,201,4.0,286766bf2b32 --12.4,201,3.7,286766bf2b32 --12.292,201,4.6,286766bf2b32 --12.186,201,6.0,fa81adafcb69 --12.079,201,14.4,286766bf2b32 --11.963,201,7.1,286766bf2b32 --11.853,201,6.3,286766bf2b32 --11.743,201,9.0,286766bf2b32 --11.632,201,5.8,286766bf2b32 --11.521,201,10.2,286766bf2b32 --11.406,201,37.3,286766bf2b32 --11.268,201,5.2,fa81adafcb69 --11.162,201,5.0,fa81adafcb69 --11.056,201,4.3,286766bf2b32 --10.951,201,5.3,286766bf2b32 --10.845,201,11.4,fa81adafcb69 --10.732,201,4.9,286766bf2b32 --10.626,201,8.5,286766bf2b32 --10.515,201,10.7,286766bf2b32 --10.403,201,4.3,fa81adafcb69 --10.294,201,8.8,286766bf2b32 --10.18,201,10.1,286766bf2b32 --10.065,201,4.8,286766bf2b32 --9.957,201,5.5,286766bf2b32 --9.85,201,5.8,286766bf2b32 --9.744,201,5.5,fa81adafcb69 --9.635,201,5.1,fa81adafcb69 --9.527,201,9.3,286766bf2b32 --9.413,201,11.7,286766bf2b32 --9.296,201,10.8,fa81adafcb69 --9.183,201,4.4,fa81adafcb69 --9.075,201,7.8,fa81adafcb69 --8.965,201,7.2,286766bf2b32 --8.855,201,5.6,286766bf2b32 --8.746,201,8.4,286766bf2b32 --8.634,201,4.5,fa81adafcb69 --8.525,201,7.1,fa81adafcb69 --8.417,201,4.8,286766bf2b32 --8.311,201,7.8,286766bf2b32 --8.201,201,4.4,286766bf2b32 --8.093,201,9.4,286766bf2b32 --7.979,201,7.5,286766bf2b32 --7.869,201,5.5,286766bf2b32 --7.763,201,9.0,286766bf2b32 --7.653,201,5.3,fa81adafcb69 --7.545,201,9.3,286766bf2b32 --7.434,201,4.8,fa81adafcb69 --7.325,201,6.4,286766bf2b32 --7.217,201,5.7,fa81adafcb69 --7.108,201,7.4,fa81adafcb69 --6.996,201,7.6,fa81adafcb69 --6.885,201,4.1,fa81adafcb69 --6.781,201,7.5,fa81adafcb69 --6.673,201,4.9,fa81adafcb69 --6.563,201,9.0,fa81adafcb69 --6.449,201,4.9,fa81adafcb69 --6.342,201,7.5,fa81adafcb69 --6.23,201,10.3,fa81adafcb69 --6.119,201,4.1,fa81adafcb69 --6.012,201,12.9,fa81adafcb69 --5.894,201,11.0,286766bf2b32 --5.78,201,10.9,286766bf2b32 --5.664,201,8.8,286766bf2b32 --5.551,201,3.4,fa81adafcb69 --5.444,201,12.4,fa81adafcb69 --5.331,201,4.9,fa81adafcb69 --5.222,201,3.8,fa81adafcb69 --5.117,201,4.4,286766bf2b32 --5.007,201,5.7,286766bf2b32 --4.896,201,13.1,286766bf2b32 --4.782,201,4.1,fa81adafcb69 --4.674,201,9.5,fa81adafcb69 --4.562,201,9.0,fa81adafcb69 --4.447,201,10.4,fa81adafcb69 --4.337,201,4.6,fa81adafcb69 --4.227,201,9.7,fa81adafcb69 --4.115,201,4.3,fa81adafcb69 --4.008,201,8.3,fa81adafcb69 --3.895,201,8.7,286766bf2b32 --3.781,201,13.2,286766bf2b32 --3.668,201,3.9,286766bf2b32 --3.56,201,5.8,286766bf2b32 --3.45,201,4.2,286766bf2b32 --3.341,201,5.2,286766bf2b32 --3.231,201,4.9,286766bf2b32 --3.124,201,5.5,286766bf2b32 --3.016,201,4.3,fa81adafcb69 --2.907,201,5.3,fa81adafcb69 --2.796,201,5.9,fa81adafcb69 --2.689,201,4.4,fa81adafcb69 --2.582,201,4.5,fa81adafcb69 --2.473,201,6.2,fa81adafcb69 --2.365,201,9.0,286766bf2b32 --2.254,201,4.0,286766bf2b32 --2.148,201,3.6,286766bf2b32 --2.042,201,8.8,286766bf2b32 --1.931,201,3.4,286766bf2b32 --1.828,201,8.0,fa81adafcb69 --1.719,201,4.3,fa81adafcb69 --1.61,201,12.9,286766bf2b32 --1.493,201,8.4,286766bf2b32 --1.38,201,5.1,286766bf2b32 --1.269,201,3.9,286766bf2b32 --1.162,201,8.6,286766bf2b32 --1.051,201,4.2,286766bf2b32 --0.945,201,7.5,286766bf2b32 --0.833,201,9.2,fa81adafcb69 --0.72,201,7.1,286766bf2b32 --0.611,201,6.8,286766bf2b32 --0.501,201,6.2,286766bf2b32 --0.393,201,5.7,286766bf2b32 --0.282,201,5.0,286766bf2b32 --0.174,201,6.4,fa81adafcb69 --0.063,201,10.6,286766bf2b32 -0.053,201,10.1,fa81adafcb69 -0.164,201,9.5,fa81adafcb69 -0.274,201,5.9,286766bf2b32 -0.381,201,4.1,286766bf2b32 -0.488,201,9.9,286766bf2b32 -0.602,201,5.0,286766bf2b32 -0.712,201,4.1,286766bf2b32 -0.818,201,8.2,286766bf2b32 -0.931,201,8.6,fa81adafcb69 -1.045,201,45.6,fa81adafcb69 -1.191,201,7.1,fa81adafcb69 -1.301,201,12.3,fa81adafcb69 -1.415,201,4.0,fa81adafcb69 -1.524,201,12.5,fa81adafcb69 -1.638,201,19.4,fa81adafcb69 -1.76,201,5.4,fa81adafcb69 -1.869,201,10.0,fa81adafcb69 -1.984,201,3.6,fa81adafcb69 -2.088,201,7.9,fa81adafcb69 -2.198,201,4.1,fa81adafcb69 -2.305,201,6.4,fa81adafcb69 -2.414,201,25.9,fa81adafcb69 -2.542,201,4.5,fa81adafcb69 -2.647,201,4.4,fa81adafcb69 -2.756,201,5.7,fa81adafcb69 -2.867,201,4.6,fa81adafcb69 -2.977,201,4.8,fa81adafcb69 -3.084,201,5.2,fa81adafcb69 -3.191,201,9.1,fa81adafcb69 -3.305,201,5.8,fa81adafcb69 -3.414,201,8.1,fa81adafcb69 -3.524,201,9.3,fa81adafcb69 -3.637,201,14.5,fa81adafcb69 -3.756,201,5.6,fa81adafcb69 -3.867,201,5.4,fa81adafcb69 -3.976,201,6.7,fa81adafcb69 -4.084,201,3.4,fa81adafcb69 -4.192,201,4.1,fa81adafcb69 -4.302,201,9.3,fa81adafcb69 -4.412,201,3.9,fa81adafcb69 -4.521,201,4.7,fa81adafcb69 -4.63,201,4.0,fa81adafcb69 -4.735,201,4.7,fa81adafcb69 -4.842,201,4.5,fa81adafcb69 -4.952,201,5.5,fa81adafcb69 -5.058,201,5.2,fa81adafcb69 -5.164,201,8.5,fa81adafcb69 -5.273,201,4.8,fa81adafcb69 -5.38,201,10.4,fa81adafcb69 -5.495,201,3.5,fa81adafcb69 -5.604,201,4.6,fa81adafcb69 -5.712,201,3.7,fa81adafcb69 -5.818,201,4.1,fa81adafcb69 -5.926,201,5.0,fa81adafcb69 -6.032,201,6.1,fa81adafcb69 -6.138,201,5.0,fa81adafcb69 -6.249,201,4.2,fa81adafcb69 -6.353,201,3.9,fa81adafcb69 -6.46,201,4.3,fa81adafcb69 -6.569,201,3.6,fa81adafcb69 -6.676,201,4.8,fa81adafcb69 -6.784,201,3.7,fa81adafcb69 -6.889,201,3.9,fa81adafcb69 -6.998,201,3.8,fa81adafcb69 -7.101,201,3.5,fa81adafcb69 -7.21,201,4.1,fa81adafcb69 -7.315,201,4.7,fa81adafcb69 -7.421,201,4.5,fa81adafcb69 -7.526,201,3.8,fa81adafcb69 -7.63,201,3.2,fa81adafcb69 -7.739,201,3.9,fa81adafcb69 -7.847,201,4.0,fa81adafcb69 -7.951,201,5.1,fa81adafcb69 -8.062,201,6.4,fa81adafcb69 -8.17,201,4.0,fa81adafcb69 -8.276,201,6.9,fa81adafcb69 -8.387,201,3.9,fa81adafcb69 -8.494,201,4.9,fa81adafcb69 -8.604,201,5.0,fa81adafcb69 -8.713,201,3.4,fa81adafcb69 -8.82,201,4.5,fa81adafcb69 -8.926,201,2.9,fa81adafcb69 -9.032,201,3.5,fa81adafcb69 -9.139,201,4.3,fa81adafcb69 -9.245,201,5.8,fa81adafcb69 -9.356,201,5.7,fa81adafcb69 -9.466,201,4.7,fa81adafcb69 -9.575,201,4.7,fa81adafcb69 -9.681,201,4.3,fa81adafcb69 -9.788,201,6.0,fa81adafcb69 -9.897,201,4.3,fa81adafcb69 -10.004,201,5.0,fa81adafcb69 -10.11,201,4.6,fa81adafcb69 -10.218,201,3.8,fa81adafcb69 -10.324,201,4.5,fa81adafcb69 -10.433,201,8.9,fa81adafcb69 -10.547,201,6.3,fa81adafcb69 -10.659,201,5.5,fa81adafcb69 -10.769,201,6.7,fa81adafcb69 -10.876,201,4.0,fa81adafcb69 -10.983,201,4.0,fa81adafcb69 -11.088,201,6.9,fa81adafcb69 -11.196,201,3.3,fa81adafcb69 -11.305,201,5.5,fa81adafcb69 -11.413,201,3.7,fa81adafcb69 -11.522,201,5.6,fa81adafcb69 -11.632,201,5.0,fa81adafcb69 -11.737,201,5.9,fa81adafcb69 -11.846,201,4.4,fa81adafcb69 -11.955,201,5.1,fa81adafcb69 -12.06,201,4.6,fa81adafcb69 -12.166,201,4.5,fa81adafcb69 -12.275,201,3.6,fa81adafcb69 -12.38,201,3.7,fa81adafcb69 -12.488,201,4.7,fa81adafcb69 -12.596,201,3.6,fa81adafcb69 -12.702,201,4.1,fa81adafcb69 -12.807,201,4.4,fa81adafcb69 -12.912,201,2.5,fa81adafcb69 -13.014,201,3.3,fa81adafcb69 -13.121,201,5.6,fa81adafcb69 -13.229,201,3.9,fa81adafcb69 -13.338,201,5.6,fa81adafcb69 -13.446,201,3.5,fa81adafcb69 -13.555,201,3.6,fa81adafcb69 -13.663,201,8.9,fa81adafcb69 -13.774,201,3.1,fa81adafcb69 -13.878,201,3.6,fa81adafcb69 -13.987,201,8.0,fa81adafcb69 -14.095,201,3.9,fa81adafcb69 -14.199,201,3.7,fa81adafcb69 -14.304,201,5.3,fa81adafcb69 -14.411,201,4.3,fa81adafcb69 -14.517,201,4.1,fa81adafcb69 -14.622,201,6.3,fa81adafcb69 -14.733,201,3.2,fa81adafcb69 -14.839,201,5.6,fa81adafcb69 -14.948,201,6.0,fa81adafcb69 -15.055,201,6.5,286766bf2b32 -15.163,201,3.5,286766bf2b32 -15.268,201,3.2,286766bf2b32 -15.377,201,4.8,286766bf2b32 -15.486,201,6.0,286766bf2b32 -15.595,201,4.9,fa81adafcb69 -15.704,201,6.8,286766bf2b32 -15.812,201,7.1,fa81adafcb69 -15.92,201,6.3,fa81adafcb69 -16.03,201,3.9,fa81adafcb69 -16.135,201,3.7,286766bf2b32 -16.243,201,3.1,286766bf2b32 -16.351,201,4.8,286766bf2b32 -16.46,201,3.3,286766bf2b32 -16.569,201,3.7,286766bf2b32 -16.675,201,3.3,fa81adafcb69 -16.779,201,3.7,fa81adafcb69 -16.887,201,5.5,fa81adafcb69 -16.994,201,7.3,286766bf2b32 -17.102,201,4.9,286766bf2b32 -17.212,201,5.1,286766bf2b32 -17.322,201,5.1,286766bf2b32 -17.431,201,3.6,286766bf2b32 -17.54,201,3.7,286766bf2b32 -17.649,201,4.0,286766bf2b32 -17.758,201,4.0,286766bf2b32 -17.863,201,6.6,fa81adafcb69 -17.974,201,5.3,fa81adafcb69 -18.083,201,4.9,fa81adafcb69 -18.191,201,4.3,fa81adafcb69 -18.3,201,4.2,fa81adafcb69 -18.408,201,4.5,fa81adafcb69 -18.514,201,4.3,286766bf2b32 -18.621,201,7.4,286766bf2b32 -18.729,201,3.7,286766bf2b32 -18.837,201,5.3,286766bf2b32 -18.945,201,8.7,fa81adafcb69 -19.058,201,5.2,286766bf2b32 -19.166,201,4.5,286766bf2b32 -19.271,201,5.4,fa81adafcb69 -19.38,201,5.3,fa81adafcb69 -19.489,201,4.3,fa81adafcb69 -19.595,201,4.3,286766bf2b32 -19.7,201,4.6,286766bf2b32 -19.808,201,4.5,286766bf2b32 -19.915,201,4.1,fa81adafcb69 -20.019,201,5.7,fa81adafcb69 -20.127,201,6.2,286766bf2b32 -20.238,201,11.4,fa81adafcb69 -20.354,201,5.6,fa81adafcb69 -20.46,201,8.3,fa81adafcb69 -20.571,201,7.2,fa81adafcb69 -20.679,201,10.5,fa81adafcb69 -20.792,201,5.8,fa81adafcb69 -20.902,201,4.8,fa81adafcb69 -21.011,201,4.6,fa81adafcb69 -21.12,201,6.7,fa81adafcb69 -21.229,201,4.1,fa81adafcb69 -21.338,201,4.7,fa81adafcb69 -21.447,201,3.9,fa81adafcb69 -21.555,201,3.3,286766bf2b32 -21.663,201,4.3,286766bf2b32 -21.769,201,4.3,286766bf2b32 -21.878,201,7.1,286766bf2b32 -21.99,201,4.3,286766bf2b32 -22.097,201,4.4,286766bf2b32 -22.201,201,6.9,fa81adafcb69 -22.31,201,4.4,fa81adafcb69 -22.416,201,4.2,286766bf2b32 -22.525,201,4.5,286766bf2b32 -22.633,201,4.4,286766bf2b32 -22.742,201,6.4,286766bf2b32 -22.853,201,4.6,286766bf2b32 -22.961,201,5.7,286766bf2b32 -23.072,201,4.3,286766bf2b32 -23.18,201,4.7,286766bf2b32 -23.29,201,3.1,286766bf2b32 -23.394,201,2.9,fa81adafcb69 -23.497,201,4.6,fa81adafcb69 -23.604,201,3.6,286766bf2b32 -23.709,201,4.2,286766bf2b32 -23.818,201,7.5,286766bf2b32 -23.929,201,3.6,286766bf2b32 -24.033,201,13.9,286766bf2b32 -24.149,201,3.0,286766bf2b32 -24.252,201,3.5,fa81adafcb69 -24.358,201,3.5,fa81adafcb69 -24.461,201,2.6,286766bf2b32 -24.569,201,4.1,286766bf2b32 -24.674,201,3.5,fa81adafcb69 -24.778,201,15.9,fa81adafcb69 -24.897,201,16.7,286766bf2b32 -25.017,201,3.8,fa81adafcb69 -25.125,201,13.8,fa81adafcb69 -25.24,201,4.3,fa81adafcb69 -25.35,201,4.6,fa81adafcb69 -25.458,201,3.4,286766bf2b32 -25.564,201,4.6,286766bf2b32 -25.671,201,6.4,286766bf2b32 -25.782,201,4.5,286766bf2b32 -25.897,201,8.4,fa81adafcb69 -26.007,201,5.7,fa81adafcb69 -26.118,201,4.0,fa81adafcb69 -26.225,201,3.5,286766bf2b32 -26.333,201,5.5,286766bf2b32 -26.439,201,5.2,286766bf2b32 -26.55,201,4.8,286766bf2b32 -26.659,201,5.7,286766bf2b32 -26.764,201,6.2,286766bf2b32 -26.875,201,5.2,fa81adafcb69 -26.981,201,5.6,fa81adafcb69 -27.088,201,5.7,fa81adafcb69 -27.199,201,4.9,fa81adafcb69 -27.307,201,5.1,fa81adafcb69 -27.415,201,4.7,286766bf2b32 -27.524,201,3.6,286766bf2b32 -27.629,201,4.6,286766bf2b32 -27.734,201,3.7,fa81adafcb69 -27.838,201,5.5,fa81adafcb69 -27.944,201,5.4,286766bf2b32 -28.051,201,3.5,286766bf2b32 -28.155,201,6.4,286766bf2b32 -28.262,201,4.8,fa81adafcb69 -28.371,201,5.0,fa81adafcb69 -28.478,201,4.0,fa81adafcb69 -28.588,201,5.7,fa81adafcb69 -28.695,201,3.6,286766bf2b32 -28.8,201,4.1,286766bf2b32 -28.906,201,4.5,fa81adafcb69 -29.015,201,6.4,fa81adafcb69 -29.124,201,5.3,fa81adafcb69 -29.23,201,4.4,fa81adafcb69 -29.335,201,5.4,286766bf2b32 -29.446,201,5.9,fa81adafcb69 -29.554,201,5.6,286766bf2b32 -29.664,201,5.1,286766bf2b32 -29.773,201,4.2,286766bf2b32 -29.882,201,4.5,286766bf2b32 -29.987,201,6.1,286766bf2b32 -30.098,201,3.6,286766bf2b32 -30.203,201,7.4,fa81adafcb69 -30.312,201,4.5,fa81adafcb69 -30.42,201,6.1,fa81adafcb69 -30.53,201,3.7,fa81adafcb69 -30.638,201,7.7,fa81adafcb69 -30.751,201,3.8,fa81adafcb69 -30.855,201,5.7,286766bf2b32 -30.966,201,8.9,fa81adafcb69 -31.078,201,4.9,fa81adafcb69 -31.184,201,4.5,286766bf2b32 -31.293,201,3.5,286766bf2b32 -31.401,201,4.3,286766bf2b32 -31.508,201,4.7,286766bf2b32 -31.617,201,8.0,286766bf2b32 -31.728,201,3.7,286766bf2b32 -31.832,201,4.2,fa81adafcb69 -31.938,201,7.0,fa81adafcb69 -32.047,201,6.2,fa81adafcb69 -32.156,201,4.6,286766bf2b32 -32.263,201,3.8,286766bf2b32 -32.369,201,5.7,286766bf2b32 -32.476,201,4.3,fa81adafcb69 -32.582,201,4.2,fa81adafcb69 -32.689,201,4.7,fa81adafcb69 -32.798,201,4.3,fa81adafcb69 -32.905,201,5.3,286766bf2b32 -33.013,201,3.4,286766bf2b32 -33.121,201,6.1,286766bf2b32 -33.229,201,5.3,286766bf2b32 -33.338,201,7.3,286766bf2b32 -33.447,201,5.1,286766bf2b32 -33.555,201,7.4,fa81adafcb69 -33.666,201,4.7,fa81adafcb69 -33.775,201,4.0,fa81adafcb69 -33.882,201,4.8,fa81adafcb69 -33.991,201,4.3,fa81adafcb69 -34.097,201,4.2,286766bf2b32 -34.205,201,7.1,286766bf2b32 -34.318,201,10.9,fa81adafcb69 -34.43,201,4.4,fa81adafcb69 -34.538,201,6.1,fa81adafcb69 -34.646,201,4.2,286766bf2b32 -34.756,201,4.7,286766bf2b32 -34.865,201,3.7,286766bf2b32 -34.972,201,6.6,286766bf2b32 -35.083,201,5.3,286766bf2b32 -35.192,201,4.0,286766bf2b32 -35.298,201,4.8,286766bf2b32 -35.403,201,8.3,fa81adafcb69 -35.514,201,4.7,fa81adafcb69 -35.62,201,7.2,fa81adafcb69 -35.729,201,4.0,fa81adafcb69 -35.837,201,5.9,fa81adafcb69 -35.948,201,4.5,286766bf2b32 -36.057,201,5.6,286766bf2b32 -36.166,201,7.6,fa81adafcb69 -36.278,201,4.8,fa81adafcb69 -36.388,201,4.6,fa81adafcb69 -36.498,201,4.4,286766bf2b32 -36.604,201,5.7,286766bf2b32 -36.713,201,4.1,286766bf2b32 -36.822,201,4.0,286766bf2b32 -36.931,201,4.4,286766bf2b32 -37.038,201,4.5,286766bf2b32 -37.146,201,25.6,fa81adafcb69 -37.274,201,6.9,fa81adafcb69 -37.384,201,4.5,fa81adafcb69 -37.493,201,43.3,fa81adafcb69 -37.639,201,36.1,286766bf2b32 -37.78,201,9.7,286766bf2b32 -37.892,201,8.2,286766bf2b32 -38.005,201,6.1,286766bf2b32 -38.113,201,4.6,286766bf2b32 -38.222,201,10.0,286766bf2b32 -38.334,201,6.0,286766bf2b32 -38.44,201,5.2,286766bf2b32 -38.551,201,4.7,286766bf2b32 -38.659,201,5.1,286766bf2b32 -38.766,201,13.3,286766bf2b32 -38.884,201,3.9,286766bf2b32 -38.988,201,7.1,286766bf2b32 -39.098,201,4.0,286766bf2b32 -39.207,201,5.0,286766bf2b32 -39.315,201,5.5,fa81adafcb69 -39.421,201,5.8,fa81adafcb69 -39.528,201,4.5,fa81adafcb69 -39.637,201,5.9,286766bf2b32 -39.747,201,5.0,fa81adafcb69 -39.855,201,4.3,286766bf2b32 -39.961,201,4.2,286766bf2b32 -40.07,201,4.4,286766bf2b32 -40.176,201,14.9,286766bf2b32 -40.295,201,5.1,286766bf2b32 -40.405,201,6.8,286766bf2b32 -40.513,201,6.3,286766bf2b32 -40.621,201,31.0,fa81adafcb69 -40.754,201,8.3,286766bf2b32 -40.868,201,8.5,fa81adafcb69 -40.979,201,5.9,fa81adafcb69 -41.089,201,4.9,fa81adafcb69 -41.195,201,5.7,286766bf2b32 -41.301,201,4.2,286766bf2b32 -41.41,201,3.4,286766bf2b32 -41.517,201,3.2,fa81adafcb69 -41.622,201,8.3,fa81adafcb69 -41.734,201,7.5,fa81adafcb69 -41.845,201,3.8,fa81adafcb69 -41.953,201,7.8,fa81adafcb69 -42.066,201,3.9,fa81adafcb69 -42.175,201,3.9,fa81adafcb69 -42.28,201,3.1,fa81adafcb69 -42.384,201,4.5,286766bf2b32 -42.491,201,7.3,286766bf2b32 -42.603,201,8.1,286766bf2b32 -42.714,201,4.3,286766bf2b32 -42.821,201,7.6,286766bf2b32 -42.934,201,9.3,286766bf2b32 -43.044,201,4.5,286766bf2b32 -43.154,201,8.3,fa81adafcb69 -43.262,201,3.9,286766bf2b32 -43.371,201,7.8,286766bf2b32 -43.48,201,4.8,286766bf2b32 -43.59,201,5.6,286766bf2b32 -43.699,201,6.4,286766bf2b32 -43.807,201,6.2,286766bf2b32 -43.914,201,4.7,fa81adafcb69 -44.021,201,7.2,fa81adafcb69 -44.13,201,5.1,fa81adafcb69 -44.24,201,5.4,fa81adafcb69 -44.348,201,5.2,fa81adafcb69 -44.454,201,8.1,286766bf2b32 -44.563,201,4.9,286766bf2b32 -44.671,201,6.8,286766bf2b32 -44.783,201,9.5,286766bf2b32 -44.895,201,7.1,fa81adafcb69 -45.004,201,4.3,fa81adafcb69 -45.113,201,7.4,286766bf2b32 -45.221,201,6.1,fa81adafcb69 -45.33,201,7.1,286766bf2b32 -45.438,201,11.2,fa81adafcb69 diff --git a/evidence/failover-each/fa81adafcb69/action.txt b/evidence/failover-each/fa81adafcb69/action.txt deleted file mode 100644 index 228e0dfc..00000000 --- a/evidence/failover-each/fa81adafcb69/action.txt +++ /dev/null @@ -1,9 +0,0 @@ -286766bf2b32 api Up About a minute (healthy) -fa81adafcb69 api Exited (0) Less than a second ago - Container mtusi2026lab3-api-1 Running - Container mtusi2026lab3-api-2 Starting - Container mtusi2026lab3-api-2 Started - Container mtusi2026lab3-api-2 Waiting - Container mtusi2026lab3-api-1 Waiting - Container mtusi2026lab3-api-2 Healthy - Container mtusi2026lab3-api-1 Healthy diff --git a/evidence/failover-each/fa81adafcb69/k6/k6.txt b/evidence/failover-each/fa81adafcb69/k6/k6.txt deleted file mode 100644 index 2dc27af5..00000000 --- a/evidence/failover-each/fa81adafcb69/k6/k6.txt +++ /dev/null @@ -1,2 +0,0 @@ -time="2026-10-29T23:47:57Z" level=info msg=LOAD-START source=console -measure: 6001 requests, failed ratio 0 diff --git a/evidence/failover-each/fa81adafcb69/lb_up.csv b/evidence/failover-each/fa81adafcb69/lb_up.csv deleted file mode 100644 index 6678b181..00000000 --- a/evidence/failover-each/fa81adafcb69/lb_up.csv +++ /dev/null @@ -1,668 +0,0 @@ -t_rel_s,up --25.932,2 --25.826,2 --25.723,2 --25.62,2 --25.515,2 --25.411,2 --25.303,2 --25.198,2 --25.092,2 --24.988,2 --24.88,2 --24.773,2 --24.664,2 --24.557,2 --24.452,2 --24.349,2 --24.237,2 --24.131,2 --24.022,2 --23.918,2 --23.81,2 --23.703,2 --23.598,2 --23.491,2 --23.385,2 --23.272,2 --23.164,2 --23.049,2 --22.944,2 --22.838,2 --22.732,2 --22.619,2 --22.51,2 --22.405,2 --22.297,2 --22.19,2 --22.083,2 --21.974,2 --21.869,2 --21.765,2 --21.653,2 --21.547,2 --21.44,2 --21.336,2 --21.232,2 --21.122,2 --21.019,2 --20.912,2 --20.803,2 --20.694,2 --20.586,2 --20.478,2 --20.372,2 --20.265,2 --20.155,2 --20.046,2 --19.94,2 --19.836,2 --19.727,2 --19.619,2 --19.513,2 --19.405,2 --19.298,2 --19.189,2 --19.079,2 --18.974,2 --18.868,2 --18.761,2 --18.656,2 --18.551,2 --18.442,2 --18.335,2 --18.231,2 --18.122,2 --18.017,2 --17.908,2 --17.799,2 --17.692,2 --17.584,2 --17.477,2 --17.369,2 --17.258,2 --17.149,2 --17.044,2 --16.935,2 --16.82,2 --16.714,2 --16.608,2 --16.501,2 --16.393,2 --16.285,2 --16.181,2 --16.071,2 --15.967,2 --15.859,2 --15.755,2 --15.65,2 --15.541,2 --15.435,2 --15.327,2 --15.222,2 --15.116,2 --15.006,2 --14.898,2 --14.791,2 --14.681,2 --14.571,2 --14.466,2 --14.357,2 --14.251,2 --14.148,2 --14.04,2 --13.937,2 --13.835,2 --13.732,2 --13.62,2 --13.514,2 --13.402,2 --13.299,2 --13.188,2 --13.083,2 --12.978,2 --12.872,2 --12.754,2 --12.651,2 --12.542,2 --12.439,2 --12.331,2 --12.224,2 --12.118,2 --12.011,2 --11.907,2 --11.802,2 --11.693,2 --11.587,2 --11.481,2 --11.374,2 --11.269,2 --11.161,2 --11.056,2 --10.948,2 --10.839,2 --10.732,2 --10.623,2 --10.515,2 --10.406,2 --10.298,2 --10.19,2 --10.08,2 --9.969,2 --9.86,2 --9.743,2 --9.637,2 --9.532,2 --9.424,2 --9.318,2 --9.214,2 --9.106,2 --9.0,2 --8.889,2 --8.778,2 --8.67,2 --8.562,2 --8.457,2 --8.348,2 --8.24,2 --8.133,2 --8.026,2 --7.919,2 --7.812,2 --7.708,2 --7.6,2 --7.495,2 --7.387,2 --7.281,2 --7.176,2 --7.068,2 --6.961,2 --6.856,2 --6.748,2 --6.639,2 --6.532,2 --6.424,2 --6.318,2 --6.212,2 --6.108,2 --6.0,2 --5.894,2 --5.784,2 --5.673,2 --5.564,2 --5.455,2 --5.348,2 --5.239,2 --5.132,2 --5.026,2 --4.921,2 --4.814,2 --4.707,2 --4.6,2 --4.491,2 --4.383,2 --4.279,2 --4.17,2 --4.062,2 --3.955,2 --3.846,2 --3.736,2 --3.628,2 --3.524,2 --3.419,2 --3.315,2 --3.207,2 --3.099,2 --2.993,2 --2.887,2 --2.78,2 --2.673,2 --2.568,2 --2.46,2 --2.352,2 --2.244,2 --2.136,2 --2.032,2 --1.925,2 --1.819,2 --1.71,2 --1.6,2 --1.492,2 --1.388,2 --1.283,2 --1.175,2 --1.068,2 --0.96,2 --0.852,2 --0.743,2 --0.632,2 --0.527,2 --0.423,2 --0.315,2 --0.21,2 --0.105,2 --0.003,2 -0.111,2 -0.217,2 -0.322,2 -0.427,2 -0.531,2 -0.635,2 -0.743,2 -0.851,2 -0.959,2 -1.065,1 -1.175,1 -1.285,1 -1.393,1 -1.497,1 -1.601,1 -1.706,1 -1.813,1 -1.918,1 -2.026,1 -2.135,1 -2.245,1 -2.352,1 -2.461,1 -2.568,1 -2.677,1 -2.781,1 -2.887,1 -2.996,1 -3.101,1 -3.211,1 -3.319,1 -3.427,1 -3.534,1 -3.641,1 -3.747,1 -3.855,1 -3.962,1 -4.069,1 -4.174,1 -4.283,1 -4.39,1 -4.494,1 -4.601,1 -4.71,1 -4.816,1 -4.926,1 -5.034,1 -5.137,1 -5.241,1 -5.347,1 -5.459,1 -5.581,1 -5.692,1 -5.797,1 -5.905,1 -6.017,1 -6.127,1 -6.235,1 -6.343,1 -6.448,1 -6.551,1 -6.658,1 -6.773,1 -6.877,1 -6.987,1 -7.094,1 -7.202,1 -7.31,1 -7.418,1 -7.523,1 -7.627,1 -7.73,1 -7.835,1 -7.943,1 -8.051,1 -8.154,1 -8.262,1 -8.369,1 -8.476,1 -8.583,1 -8.694,1 -8.802,1 -8.908,1 -9.011,1 -9.113,1 -9.216,1 -9.322,1 -9.427,1 -9.535,1 -9.641,1 -9.749,1 -9.858,1 -9.963,1 -10.07,1 -10.179,1 -10.284,1 -10.387,1 -10.495,1 -10.599,1 -10.708,1 -10.815,1 -10.921,1 -11.024,1 -11.133,1 -11.239,1 -11.349,1 -11.473,1 -11.581,1 -11.69,1 -11.8,1 -11.905,1 -12.013,1 -12.12,1 -12.228,1 -12.332,1 -12.438,1 -12.543,1 -12.652,1 -12.756,1 -12.859,1 -12.966,1 -13.074,1 -13.177,1 -13.285,1 -13.392,1 -13.5,1 -13.608,1 -13.729,1 -13.835,1 -13.952,1 -14.056,1 -14.16,1 -14.268,1 -14.376,1 -14.481,1 -14.587,2 -14.704,2 -14.811,2 -14.915,2 -15.021,2 -15.129,2 -15.233,2 -15.338,2 -15.446,2 -15.548,2 -15.656,2 -15.764,2 -15.871,2 -15.977,2 -16.081,2 -16.184,2 -16.291,2 -16.395,2 -16.502,2 -16.611,2 -16.718,2 -16.821,2 -16.929,2 -17.033,2 -17.141,2 -17.251,2 -17.361,2 -17.465,2 -17.57,2 -17.677,2 -17.786,2 -17.893,2 -18.0,2 -18.107,2 -18.212,2 -18.319,2 -18.423,2 -18.532,2 -18.643,2 -18.752,2 -18.86,2 -18.966,2 -19.073,2 -19.183,2 -19.294,2 -19.4,2 -19.51,2 -19.617,2 -19.728,2 -19.836,2 -19.942,2 -20.048,2 -20.156,2 -20.264,2 -20.369,2 -20.474,2 -20.578,2 -20.688,2 -20.792,2 -20.9,2 -21.009,2 -21.114,2 -21.221,2 -21.326,2 -21.432,2 -21.542,2 -21.651,2 -21.755,2 -21.861,2 -21.969,2 -22.073,2 -22.181,2 -22.286,2 -22.393,2 -22.501,2 -22.606,2 -22.712,2 -22.817,2 -22.923,2 -23.03,2 -23.135,2 -23.243,2 -23.347,2 -23.458,2 -23.565,2 -23.673,2 -23.775,2 -23.884,2 -23.99,2 -24.095,2 -24.201,2 -24.309,2 -24.413,2 -24.519,2 -24.628,2 -24.736,2 -24.845,2 -24.951,2 -25.058,2 -25.181,2 -25.289,2 -25.392,2 -25.497,2 -25.604,2 -25.71,2 -25.817,2 -25.927,2 -26.03,2 -26.138,2 -26.246,2 -26.355,2 -26.463,2 -26.568,2 -26.674,2 -26.778,2 -26.885,2 -26.994,2 -27.098,2 -27.205,2 -27.313,2 -27.423,2 -27.531,2 -27.641,2 -27.746,2 -27.852,2 -27.959,2 -28.065,2 -28.171,2 -28.278,2 -28.383,2 -28.49,2 -28.593,2 -28.7,2 -28.811,2 -28.92,2 -29.023,2 -29.129,2 -29.24,2 -29.344,2 -29.45,2 -29.563,2 -29.668,2 -29.774,2 -29.883,2 -29.989,2 -30.094,2 -30.201,2 -30.309,2 -30.415,2 -30.523,2 -30.631,2 -30.737,2 -30.843,2 -30.949,2 -31.059,2 -31.168,2 -31.274,2 -31.381,2 -31.489,2 -31.6,2 -31.71,2 -31.813,2 -31.916,2 -32.023,2 -32.127,2 -32.241,2 -32.349,2 -32.456,2 -32.56,2 -32.666,2 -32.79,2 -32.897,2 -33.002,2 -33.109,2 -33.217,2 -33.323,2 -33.429,2 -33.536,2 -33.645,2 -33.754,2 -33.872,2 -33.976,2 -34.084,2 -34.193,2 -34.296,2 -34.4,2 -34.506,2 -34.613,2 -34.716,2 -34.822,2 -34.93,2 -35.033,2 -35.14,2 -35.25,2 -35.359,2 -35.465,2 -35.569,2 -35.673,2 -35.779,2 -35.885,2 -35.988,2 -36.092,2 -36.2,2 -36.307,2 -36.41,2 -36.517,2 -36.621,2 -36.729,2 -36.836,2 -36.942,2 -37.048,2 -37.16,2 -37.265,2 -37.372,2 -37.48,2 -37.584,2 -37.694,2 -37.797,2 -37.904,2 -38.011,2 -38.118,2 -38.224,2 -38.331,2 -38.44,2 -38.545,2 -38.65,2 -38.758,2 -38.862,2 -38.964,2 -39.072,2 -39.18,2 -39.29,2 -39.393,2 -39.499,2 -39.607,2 -39.713,2 -39.816,2 -39.923,2 -40.027,2 -40.134,2 -40.241,2 -40.346,2 -40.453,2 -40.56,2 -40.667,2 -40.777,2 -40.883,2 -40.992,2 -41.099,2 -41.206,2 -41.31,2 -41.414,2 -41.519,2 -41.625,2 -41.732,2 -41.837,2 -41.942,2 -42.046,2 -42.153,2 -42.261,2 -42.368,2 -42.476,2 -42.58,2 -42.684,2 -42.79,2 -42.894,2 -42.999,2 -43.104,2 -43.211,2 -43.316,2 -43.43,2 -43.534,2 -43.645,2 -43.761,2 -43.871,2 -43.986,2 -44.097,2 -44.206,2 -44.311,2 -44.417,2 -44.524,2 -44.632,2 -44.75,2 -44.865,2 -44.969,2 -45.08,2 -45.188,2 -45.294,2 -45.402,2 diff --git a/evidence/failover-each/fa81adafcb69/probe.csv b/evidence/failover-each/fa81adafcb69/probe.csv deleted file mode 100644 index f8141db7..00000000 --- a/evidence/failover-each/fa81adafcb69/probe.csv +++ /dev/null @@ -1,656 +0,0 @@ -t_rel_s,status,latency_ms,instance --25.932,201,5.1,fa81adafcb69 --25.827,201,5.6,286766bf2b32 --25.72,201,4.9,fa81adafcb69 --25.614,201,5.2,fa81adafcb69 --25.506,201,4.0,fa81adafcb69 --25.401,201,6.1,fa81adafcb69 --25.29,201,4.5,fa81adafcb69 --25.18,201,4.4,fa81adafcb69 --25.074,201,4.4,286766bf2b32 --24.97,201,7.8,286766bf2b32 --24.86,201,3.9,286766bf2b32 --24.751,201,5.9,286766bf2b32 --24.64,201,3.6,286766bf2b32 --24.532,201,5.5,286766bf2b32 --24.421,201,4.4,286766bf2b32 --24.314,201,5.1,fa81adafcb69 --24.204,201,4.8,286766bf2b32 --24.095,201,4.4,fa81adafcb69 --23.987,201,3.7,fa81adafcb69 --23.883,201,8.2,fa81adafcb69 --23.774,201,6.2,fa81adafcb69 --23.665,201,8.0,fa81adafcb69 --23.552,201,19.2,fa81adafcb69 --23.431,201,20.0,fa81adafcb69 --23.307,201,5.3,fa81adafcb69 --23.2,201,43.6,fa81adafcb69 --23.056,201,3.8,286766bf2b32 --22.95,201,5.8,286766bf2b32 --22.84,201,4.2,286766bf2b32 --22.731,201,8.7,286766bf2b32 --22.619,201,12.5,286766bf2b32 --22.501,201,7.2,fa81adafcb69 --22.393,201,4.3,286766bf2b32 --22.288,201,3.8,286766bf2b32 --22.181,201,7.9,286766bf2b32 --22.07,201,4.0,286766bf2b32 --21.961,201,5.0,286766bf2b32 --21.856,201,6.2,fa81adafcb69 --21.749,201,9.1,fa81adafcb69 --21.639,201,3.3,fa81adafcb69 --21.531,201,8.1,fa81adafcb69 --21.418,201,9.8,fa81adafcb69 --21.308,201,4.8,fa81adafcb69 --21.2,201,10.9,fa81adafcb69 --21.085,201,7.5,fa81adafcb69 --20.977,201,5.3,fa81adafcb69 --20.869,201,4.7,fa81adafcb69 --20.763,201,15.0,fa81adafcb69 --20.648,201,8.1,fa81adafcb69 --20.536,201,4.1,fa81adafcb69 --20.428,201,4.3,fa81adafcb69 --20.319,201,12.0,fa81adafcb69 --20.202,201,10.4,286766bf2b32 --20.09,201,6.8,286766bf2b32 --19.98,201,6.7,286766bf2b32 --19.872,201,4.3,286766bf2b32 --19.765,201,8.0,286766bf2b32 --19.652,201,6.3,286766bf2b32 --19.542,201,6.1,286766bf2b32 --19.432,201,5.6,286766bf2b32 --19.323,201,5.2,286766bf2b32 --19.217,201,8.2,fa81adafcb69 --19.106,201,4.9,fa81adafcb69 --19.001,201,8.0,fa81adafcb69 --18.892,201,5.2,286766bf2b32 --18.786,201,4.3,286766bf2b32 --18.679,201,4.5,286766bf2b32 --18.573,201,5.3,286766bf2b32 --18.463,201,6.0,fa81adafcb69 --18.356,201,5.1,fa81adafcb69 --18.25,201,9.2,fa81adafcb69 --18.136,201,6.1,fa81adafcb69 --18.028,201,4.3,fa81adafcb69 --17.92,201,4.5,fa81adafcb69 --17.814,201,5.9,fa81adafcb69 --17.705,201,4.9,286766bf2b32 --17.598,201,5.6,286766bf2b32 --17.487,201,9.7,286766bf2b32 --17.373,201,14.2,fa81adafcb69 --17.254,201,4.0,fa81adafcb69 --17.147,201,5.7,fa81adafcb69 --17.037,201,4.6,fa81adafcb69 --16.928,201,4.8,fa81adafcb69 --16.823,201,5.5,fa81adafcb69 --16.714,201,7.2,fa81adafcb69 --16.605,201,3.2,286766bf2b32 --16.5,201,8.5,286766bf2b32 --16.391,201,3.8,286766bf2b32 --16.283,201,9.1,286766bf2b32 --16.17,201,3.5,286766bf2b32 --16.065,201,8.6,286766bf2b32 --15.953,201,4.5,286766bf2b32 --15.843,201,7.4,fa81adafcb69 --15.733,201,8.0,286766bf2b32 --15.62,201,6.9,286766bf2b32 --15.508,201,5.8,286766bf2b32 --15.398,201,10.9,286766bf2b32 --15.282,201,8.7,fa81adafcb69 --15.173,201,4.8,286766bf2b32 --15.063,201,24.1,286766bf2b32 --14.936,201,8.2,fa81adafcb69 --14.823,201,5.3,fa81adafcb69 --14.714,201,9.0,fa81adafcb69 --14.603,201,4.6,fa81adafcb69 --14.495,201,8.2,fa81adafcb69 --14.383,201,10.2,286766bf2b32 --14.269,201,12.9,286766bf2b32 --14.153,201,3.4,286766bf2b32 --14.047,201,7.7,286766bf2b32 --13.939,201,4.1,286766bf2b32 --13.833,201,5.5,fa81adafcb69 --13.726,201,4.9,fa81adafcb69 --13.621,201,4.7,286766bf2b32 --13.514,201,9.7,286766bf2b32 --13.403,201,11.5,286766bf2b32 --13.29,201,4.4,286766bf2b32 --13.186,201,3.4,286766bf2b32 --13.077,201,4.0,286766bf2b32 --12.968,201,6.3,286766bf2b32 --12.86,201,35.5,286766bf2b32 --12.724,201,5.9,286766bf2b32 --12.616,201,5.1,286766bf2b32 --12.508,201,3.4,286766bf2b32 --12.404,201,4.1,fa81adafcb69 --12.298,201,7.0,fa81adafcb69 --12.187,201,4.4,fa81adafcb69 --12.081,201,5.5,fa81adafcb69 --11.97,201,4.8,fa81adafcb69 --11.861,201,7.6,286766bf2b32 --11.752,201,7.1,286766bf2b32 --11.641,201,5.7,286766bf2b32 --11.534,201,6.6,286766bf2b32 --11.424,201,5.1,286766bf2b32 --11.318,201,6.8,286766bf2b32 --11.21,201,9.2,286766bf2b32 --11.096,201,6.8,286766bf2b32 --10.986,201,7.6,286766bf2b32 --10.874,201,4.0,286766bf2b32 --10.766,201,8.5,286766bf2b32 --10.656,201,4.2,286766bf2b32 --10.548,201,4.7,286766bf2b32 --10.44,201,4.5,fa81adafcb69 --10.331,201,4.4,286766bf2b32 --10.223,201,3.8,fa81adafcb69 --10.114,201,4.8,fa81adafcb69 --10.009,201,4.9,fa81adafcb69 --9.901,201,8.6,286766bf2b32 --9.789,201,4.6,fa81adafcb69 --9.683,201,8.4,286766bf2b32 --9.57,201,6.7,fa81adafcb69 --9.458,201,4.7,fa81adafcb69 --9.35,201,7.7,fa81adafcb69 --9.241,201,4.1,286766bf2b32 --9.133,201,6.4,286766bf2b32 --9.023,201,4.4,286766bf2b32 --8.916,201,5.6,286766bf2b32 --8.806,201,7.7,286766bf2b32 --8.698,201,4.7,286766bf2b32 --8.59,201,5.3,286766bf2b32 --8.482,201,4.5,fa81adafcb69 --8.372,201,5.4,fa81adafcb69 --8.264,201,4.9,fa81adafcb69 --8.157,201,5.2,fa81adafcb69 --8.048,201,4.1,fa81adafcb69 --7.939,201,9.7,fa81adafcb69 --7.827,201,5.0,fa81adafcb69 --7.721,201,5.3,286766bf2b32 --7.61,201,4.3,fa81adafcb69 --7.501,201,6.0,286766bf2b32 --7.39,201,5.2,fa81adafcb69 --7.282,201,6.5,fa81adafcb69 --7.17,201,3.6,286766bf2b32 --7.065,201,8.5,286766bf2b32 --6.952,201,4.1,286766bf2b32 --6.844,201,4.0,286766bf2b32 --6.739,201,8.1,286766bf2b32 --6.631,201,6.4,fa81adafcb69 --6.519,201,4.7,286766bf2b32 --6.409,201,3.9,286766bf2b32 --6.301,201,4.4,286766bf2b32 --6.197,201,4.9,fa81adafcb69 --6.087,201,4.6,fa81adafcb69 --5.978,201,4.3,fa81adafcb69 --5.873,201,7.2,fa81adafcb69 --5.761,201,7.8,fa81adafcb69 --5.648,201,3.9,fa81adafcb69 --5.539,201,5.9,fa81adafcb69 --5.432,201,4.5,286766bf2b32 --5.326,201,5.5,286766bf2b32 --5.22,201,4.2,286766bf2b32 --5.116,201,4.1,fa81adafcb69 --5.009,201,4.9,fa81adafcb69 --4.899,201,5.0,fa81adafcb69 --4.792,201,4.2,286766bf2b32 --4.684,201,6.5,286766bf2b32 --4.573,201,5.2,286766bf2b32 --4.465,201,4.2,286766bf2b32 --4.358,201,4.2,286766bf2b32 --4.253,201,4.3,fa81adafcb69 --4.143,201,5.1,fa81adafcb69 --4.034,201,5.2,fa81adafcb69 --3.924,201,6.3,fa81adafcb69 --3.813,201,4.6,fa81adafcb69 --3.707,201,5.0,fa81adafcb69 --3.599,201,5.4,fa81adafcb69 --3.489,201,4.5,fa81adafcb69 --3.381,201,5.0,fa81adafcb69 --3.272,201,5.2,fa81adafcb69 --3.164,201,3.9,286766bf2b32 --3.056,201,6.3,286766bf2b32 --2.946,201,4.0,286766bf2b32 --2.839,201,5.7,286766bf2b32 --2.729,201,4.8,286766bf2b32 --2.621,201,6.0,286766bf2b32 --2.513,201,3.2,fa81adafcb69 --2.407,201,4.0,fa81adafcb69 --2.303,201,3.9,286766bf2b32 --2.194,201,3.4,286766bf2b32 --2.085,201,5.0,286766bf2b32 --1.979,201,3.8,286766bf2b32 --1.874,201,4.5,fa81adafcb69 --1.765,201,4.9,fa81adafcb69 --1.656,201,3.7,fa81adafcb69 --1.551,201,6.5,286766bf2b32 --1.445,201,4.0,286766bf2b32 --1.339,201,5.0,286766bf2b32 --1.229,201,4.1,286766bf2b32 --1.124,201,4.5,fa81adafcb69 --1.015,201,4.8,fa81adafcb69 --0.905,201,3.5,fa81adafcb69 --0.799,201,4.9,fa81adafcb69 --0.69,201,5.6,fa81adafcb69 --0.581,201,3.5,286766bf2b32 --0.473,201,4.1,286766bf2b32 --0.365,201,11.3,286766bf2b32 --0.251,201,6.1,286766bf2b32 --0.142,201,4.3,286766bf2b32 --0.036,201,3.6,286766bf2b32 -0.071,201,3.9,fa81adafcb69 -0.175,201,5.4,fa81adafcb69 -0.283,201,4.7,fa81adafcb69 -0.393,201,3.2,fa81adafcb69 -0.498,201,3.6,286766bf2b32 -0.606,201,3.5,286766bf2b32 -0.712,201,3.5,286766bf2b32 -0.821,201,7.2,286766bf2b32 -0.934,201,6.9,286766bf2b32 -1.044,201,4.6,286766bf2b32 -1.15,201,6.3,286766bf2b32 -1.26,201,5.7,286766bf2b32 -1.369,201,5.1,286766bf2b32 -1.478,201,6.4,286766bf2b32 -1.589,201,4.5,286766bf2b32 -1.698,201,7.3,286766bf2b32 -1.81,201,4.2,286766bf2b32 -1.918,201,6.6,286766bf2b32 -2.026,201,4.7,286766bf2b32 -2.134,201,8.2,286766bf2b32 -2.245,201,4.7,286766bf2b32 -2.352,201,5.2,286766bf2b32 -2.461,201,5.1,286766bf2b32 -2.569,201,4.9,286766bf2b32 -2.675,201,6.5,286766bf2b32 -2.783,201,6.1,286766bf2b32 -2.894,201,4.1,286766bf2b32 -3.003,201,5.4,286766bf2b32 -3.111,201,4.0,286766bf2b32 -3.219,201,4.2,286766bf2b32 -3.326,201,4.2,286766bf2b32 -3.431,201,3.8,286766bf2b32 -3.538,201,3.8,286766bf2b32 -3.644,201,4.2,286766bf2b32 -3.752,201,4.8,286766bf2b32 -3.861,201,5.5,286766bf2b32 -3.967,201,4.8,286766bf2b32 -4.077,201,7.5,286766bf2b32 -4.185,201,4.1,286766bf2b32 -4.291,201,4.5,286766bf2b32 -4.398,201,4.0,286766bf2b32 -4.502,201,4.9,286766bf2b32 -4.61,201,6.0,286766bf2b32 -4.719,201,5.7,286766bf2b32 -4.826,201,4.1,286766bf2b32 -4.935,201,6.1,286766bf2b32 -5.044,201,4.2,286766bf2b32 -5.15,201,6.0,286766bf2b32 -5.26,201,4.5,286766bf2b32 -5.369,201,5.5,286766bf2b32 -5.476,201,4.7,286766bf2b32 -5.584,201,12.5,286766bf2b32 -5.7,201,4.9,286766bf2b32 -5.808,201,7.1,286766bf2b32 -5.92,201,6.2,286766bf2b32 -6.031,201,7.8,286766bf2b32 -6.139,201,5.2,286766bf2b32 -6.249,201,8.0,286766bf2b32 -6.362,201,3.9,286766bf2b32 -6.471,201,4.0,286766bf2b32 -6.581,201,3.7,286766bf2b32 -6.689,201,7.8,286766bf2b32 -6.797,201,6.8,286766bf2b32 -6.909,201,5.3,286766bf2b32 -7.018,201,5.4,286766bf2b32 -7.127,201,5.3,286766bf2b32 -7.236,201,6.6,286766bf2b32 -7.346,201,6.1,286766bf2b32 -7.455,201,11.5,286766bf2b32 -7.568,201,9.7,286766bf2b32 -7.683,201,6.0,286766bf2b32 -7.793,201,4.3,286766bf2b32 -7.902,201,4.4,286766bf2b32 -8.01,201,4.9,286766bf2b32 -8.119,201,7.0,286766bf2b32 -8.228,201,4.1,286766bf2b32 -8.337,201,5.3,286766bf2b32 -8.444,201,3.8,286766bf2b32 -8.552,201,9.5,286766bf2b32 -8.667,201,5.1,286766bf2b32 -8.776,201,11.7,286766bf2b32 -8.893,201,7.4,286766bf2b32 -9.006,201,4.0,286766bf2b32 -9.11,201,5.0,286766bf2b32 -9.218,201,4.6,286766bf2b32 -9.328,201,3.9,286766bf2b32 -9.437,201,3.3,286766bf2b32 -9.541,201,3.9,286766bf2b32 -9.649,201,11.8,286766bf2b32 -9.763,201,7.8,286766bf2b32 -9.873,201,3.8,286766bf2b32 -9.982,201,8.9,286766bf2b32 -10.093,201,4.5,286766bf2b32 -10.201,201,5.3,286766bf2b32 -10.311,201,3.8,286766bf2b32 -10.419,201,4.0,286766bf2b32 -10.528,201,5.3,286766bf2b32 -10.633,201,6.5,286766bf2b32 -10.741,201,3.6,286766bf2b32 -10.85,201,6.9,286766bf2b32 -10.962,201,4.8,286766bf2b32 -11.072,201,3.8,286766bf2b32 -11.18,201,8.8,286766bf2b32 -11.29,201,4.7,286766bf2b32 -11.401,201,15.0,286766bf2b32 -11.521,201,4.0,286766bf2b32 -11.63,201,5.1,286766bf2b32 -11.739,201,4.6,286766bf2b32 -11.845,201,6.5,286766bf2b32 -11.955,201,5.4,286766bf2b32 -12.062,201,4.0,286766bf2b32 -12.169,201,4.2,286766bf2b32 -12.278,201,4.9,286766bf2b32 -12.388,201,5.9,286766bf2b32 -12.499,201,17.0,286766bf2b32 -12.622,201,11.2,286766bf2b32 -12.735,201,4.6,286766bf2b32 -12.841,201,3.9,286766bf2b32 -12.95,201,4.4,286766bf2b32 -13.056,201,4.9,286766bf2b32 -13.165,201,6.4,286766bf2b32 -13.272,201,4.4,286766bf2b32 -13.378,201,6.7,286766bf2b32 -13.489,201,4.7,286766bf2b32 -13.599,201,6.7,286766bf2b32 -13.708,201,3.8,286766bf2b32 -13.814,201,3.0,286766bf2b32 -13.922,201,5.6,286766bf2b32 -14.031,201,4.3,286766bf2b32 -14.137,201,6.3,286766bf2b32 -14.244,201,3.3,286766bf2b32 -14.35,201,5.6,286766bf2b32 -14.457,201,5.9,286766bf2b32 -14.567,201,15.4,fa81adafcb69 -14.687,201,3.9,286766bf2b32 -14.794,201,4.4,286766bf2b32 -14.902,201,4.4,286766bf2b32 -15.009,201,3.7,fa81adafcb69 -15.117,201,6.7,fa81adafcb69 -15.224,201,3.8,fa81adafcb69 -15.332,201,6.2,fa81adafcb69 -15.443,201,4.5,fa81adafcb69 -15.548,201,7.7,fa81adafcb69 -15.66,201,3.9,286766bf2b32 -15.765,201,3.5,286766bf2b32 -15.872,201,3.3,286766bf2b32 -15.979,201,3.5,fa81adafcb69 -16.083,201,6.3,fa81adafcb69 -16.193,201,3.3,fa81adafcb69 -16.3,201,5.8,fa81adafcb69 -16.407,201,5.6,286766bf2b32 -16.515,201,6.5,286766bf2b32 -16.626,201,4.0,286766bf2b32 -16.731,201,5.8,286766bf2b32 -16.839,201,5.3,286766bf2b32 -16.949,201,7.3,286766bf2b32 -17.057,201,3.8,fa81adafcb69 -17.165,201,13.1,fa81adafcb69 -17.281,201,6.6,286766bf2b32 -17.387,201,4.8,fa81adafcb69 -17.497,201,5.5,fa81adafcb69 -17.608,201,3.7,fa81adafcb69 -17.717,201,7.4,fa81adafcb69 -17.827,201,4.1,fa81adafcb69 -17.932,201,7.1,fa81adafcb69 -18.041,201,4.8,fa81adafcb69 -18.149,201,9.1,fa81adafcb69 -18.26,201,5.5,fa81adafcb69 -18.368,201,5.8,286766bf2b32 -18.478,201,5.6,286766bf2b32 -18.585,201,5.2,286766bf2b32 -18.692,201,6.1,286766bf2b32 -18.803,201,5.8,286766bf2b32 -18.914,201,7.2,286766bf2b32 -19.022,201,5.1,286766bf2b32 -19.132,201,8.0,286766bf2b32 -19.246,201,8.3,286766bf2b32 -19.356,201,4.8,286766bf2b32 -19.463,201,7.2,286766bf2b32 -19.572,201,5.0,286766bf2b32 -19.681,201,7.9,286766bf2b32 -19.79,201,4.4,fa81adafcb69 -19.897,201,7.8,fa81adafcb69 -20.006,201,5.4,fa81adafcb69 -20.117,201,8.3,286766bf2b32 -20.227,201,5.2,fa81adafcb69 -20.334,201,7.3,fa81adafcb69 -20.445,201,3.7,fa81adafcb69 -20.55,201,7.0,fa81adafcb69 -20.662,201,4.5,fa81adafcb69 -20.771,201,4.6,fa81adafcb69 -20.876,201,4.3,286766bf2b32 -20.982,201,7.8,286766bf2b32 -21.09,201,5.0,286766bf2b32 -21.199,201,7.4,286766bf2b32 -21.31,201,6.6,286766bf2b32 -21.421,201,4.7,286766bf2b32 -21.528,201,4.7,fa81adafcb69 -21.636,201,5.2,fa81adafcb69 -21.742,201,5.6,fa81adafcb69 -21.848,201,8.1,fa81adafcb69 -21.961,201,3.9,286766bf2b32 -22.065,201,8.4,286766bf2b32 -22.175,201,10.3,286766bf2b32 -22.288,201,3.8,286766bf2b32 -22.394,201,3.9,286766bf2b32 -22.499,201,7.6,286766bf2b32 -22.61,201,3.1,286766bf2b32 -22.714,201,7.5,fa81adafcb69 -22.823,201,4.2,fa81adafcb69 -22.932,201,4.7,fa81adafcb69 -23.041,201,4.6,fa81adafcb69 -23.149,201,6.7,fa81adafcb69 -23.257,201,5.0,286766bf2b32 -23.366,201,6.1,286766bf2b32 -23.473,201,4.7,286766bf2b32 -23.582,201,7.1,286766bf2b32 -23.692,201,3.7,286766bf2b32 -23.795,201,4.9,fa81adafcb69 -23.9,201,6.6,fa81adafcb69 -24.009,201,4.9,286766bf2b32 -24.117,201,7.0,286766bf2b32 -24.229,201,5.6,286766bf2b32 -24.336,201,5.4,286766bf2b32 -24.443,201,4.5,286766bf2b32 -24.549,201,6.9,286766bf2b32 -24.66,201,4.0,fa81adafcb69 -24.769,201,5.6,286766bf2b32 -24.876,201,5.8,fa81adafcb69 -24.984,201,7.7,fa81adafcb69 -25.091,201,6.6,fa81adafcb69 -25.201,201,11.0,fa81adafcb69 -25.317,201,5.0,fa81adafcb69 -25.424,201,4.7,fa81adafcb69 -25.531,201,5.6,fa81adafcb69 -25.637,201,4.7,286766bf2b32 -25.744,201,4.4,286766bf2b32 -25.85,201,7.4,286766bf2b32 -25.957,201,4.4,fa81adafcb69 -26.066,201,7.0,fa81adafcb69 -26.174,201,5.2,fa81adafcb69 -26.284,201,5.6,fa81adafcb69 -26.39,201,4.3,fa81adafcb69 -26.499,201,6.2,286766bf2b32 -26.61,201,6.9,fa81adafcb69 -26.722,201,3.6,fa81adafcb69 -26.829,201,4.6,286766bf2b32 -26.939,201,4.7,286766bf2b32 -27.047,201,6.3,286766bf2b32 -27.155,201,4.1,286766bf2b32 -27.264,201,7.6,286766bf2b32 -27.376,201,4.7,286766bf2b32 -27.485,201,7.3,286766bf2b32 -27.597,201,7.2,286766bf2b32 -27.705,201,6.4,286766bf2b32 -27.817,201,5.9,286766bf2b32 -27.925,201,4.5,286766bf2b32 -28.034,201,5.8,286766bf2b32 -28.144,201,5.8,286766bf2b32 -28.255,201,9.8,fa81adafcb69 -28.367,201,5.3,286766bf2b32 -28.477,201,12.3,fa81adafcb69 -28.594,201,4.6,fa81adafcb69 -28.702,201,10.4,fa81adafcb69 -28.814,201,3.8,fa81adafcb69 -28.919,201,4.4,fa81adafcb69 -29.029,201,3.6,286766bf2b32 -29.134,201,4.7,286766bf2b32 -29.241,201,3.9,286766bf2b32 -29.35,201,5.2,fa81adafcb69 -29.459,201,5.1,fa81adafcb69 -29.569,201,3.8,fa81adafcb69 -29.675,201,3.6,fa81adafcb69 -29.78,201,3.7,fa81adafcb69 -29.885,201,5.7,286766bf2b32 -29.992,201,2.8,286766bf2b32 -30.098,201,8.2,286766bf2b32 -30.211,201,4.1,286766bf2b32 -30.32,201,4.3,286766bf2b32 -30.425,201,4.9,fa81adafcb69 -30.532,201,5.8,fa81adafcb69 -30.642,201,4.1,fa81adafcb69 -30.751,201,5.3,fa81adafcb69 -30.857,201,4.7,286766bf2b32 -30.967,201,6.3,286766bf2b32 -31.074,201,4.5,286766bf2b32 -31.182,201,7.0,286766bf2b32 -31.294,201,10.9,286766bf2b32 -31.406,201,8.1,286766bf2b32 -31.514,201,5.2,286766bf2b32 -31.623,201,4.6,286766bf2b32 -31.73,201,6.9,286766bf2b32 -31.84,201,4.3,fa81adafcb69 -31.944,201,7.0,fa81adafcb69 -32.052,201,4.3,fa81adafcb69 -32.161,201,4.4,fa81adafcb69 -32.267,201,10.5,fa81adafcb69 -32.38,201,5.2,286766bf2b32 -32.488,201,5.0,286766bf2b32 -32.598,201,80.0,fa81adafcb69 -32.783,201,10.6,286766bf2b32 -32.898,201,8.5,fa81adafcb69 -33.008,201,5.6,286766bf2b32 -33.116,201,6.7,286766bf2b32 -33.225,201,4.1,286766bf2b32 -33.33,201,5.1,fa81adafcb69 -33.44,201,4.0,fa81adafcb69 -33.549,201,11.1,286766bf2b32 -33.662,201,3.5,286766bf2b32 -33.772,201,7.7,286766bf2b32 -33.882,201,6.0,286766bf2b32 -33.988,201,3.6,fa81adafcb69 -34.097,201,5.5,fa81adafcb69 -34.207,201,3.8,fa81adafcb69 -34.315,201,6.4,fa81adafcb69 -34.424,201,3.8,fa81adafcb69 -34.533,201,4.0,fa81adafcb69 -34.642,201,3.9,fa81adafcb69 -34.751,201,3.1,fa81adafcb69 -34.859,201,5.0,fa81adafcb69 -34.966,201,4.8,286766bf2b32 -35.071,201,4.9,286766bf2b32 -35.179,201,6.2,286766bf2b32 -35.288,201,3.7,fa81adafcb69 -35.392,201,4.0,fa81adafcb69 -35.501,201,5.1,fa81adafcb69 -35.609,201,3.8,286766bf2b32 -35.717,201,4.3,286766bf2b32 -35.823,201,5.1,286766bf2b32 -35.933,201,5.0,286766bf2b32 -36.043,201,3.5,286766bf2b32 -36.149,201,4.7,fa81adafcb69 -36.255,201,5.2,fa81adafcb69 -36.363,201,5.8,fa81adafcb69 -36.472,201,4.5,fa81adafcb69 -36.582,201,3.7,fa81adafcb69 -36.688,201,3.4,286766bf2b32 -36.795,201,3.0,286766bf2b32 -36.899,201,4.4,fa81adafcb69 -37.007,201,4.2,fa81adafcb69 -37.116,201,5.3,fa81adafcb69 -37.222,201,3.8,fa81adafcb69 -37.331,201,5.1,fa81adafcb69 -37.439,201,5.4,fa81adafcb69 -37.55,201,6.2,fa81adafcb69 -37.661,201,4.7,fa81adafcb69 -37.769,201,3.4,286766bf2b32 -37.873,201,3.6,286766bf2b32 -37.98,201,5.7,286766bf2b32 -38.09,201,4.0,fa81adafcb69 -38.197,201,7.3,fa81adafcb69 -38.306,201,3.9,fa81adafcb69 -38.413,201,3.6,fa81adafcb69 -38.519,201,3.9,286766bf2b32 -38.624,201,3.8,286766bf2b32 -38.733,201,6.9,286766bf2b32 -38.842,201,4.1,286766bf2b32 -38.949,201,9.5,286766bf2b32 -39.06,201,4.4,fa81adafcb69 -39.165,201,10.7,fa81adafcb69 -39.276,201,3.9,fa81adafcb69 -39.383,201,6.8,fa81adafcb69 -39.492,201,4.4,fa81adafcb69 -39.601,201,6.4,286766bf2b32 -39.71,201,4.1,fa81adafcb69 -39.815,201,7.1,286766bf2b32 -39.924,201,4.2,286766bf2b32 -40.031,201,6.0,286766bf2b32 -40.142,201,3.3,286766bf2b32 -40.249,201,8.1,286766bf2b32 -40.362,201,4.1,286766bf2b32 -40.471,201,4.8,286766bf2b32 -40.577,201,5.4,fa81adafcb69 -40.685,201,5.2,fa81adafcb69 -40.793,201,6.8,fa81adafcb69 -40.9,201,5.7,fa81adafcb69 -41.006,201,3.2,286766bf2b32 -41.112,201,3.4,286766bf2b32 -41.216,201,5.5,fa81adafcb69 -41.323,201,3.2,fa81adafcb69 -41.428,201,3.0,286766bf2b32 -41.536,201,5.3,286766bf2b32 -41.646,201,7.6,286766bf2b32 -41.756,201,4.6,286766bf2b32 -41.865,201,7.1,286766bf2b32 -41.973,201,3.4,286766bf2b32 -42.078,201,6.0,fa81adafcb69 -42.184,201,3.6,fa81adafcb69 -42.292,201,5.5,fa81adafcb69 -42.401,201,4.5,fa81adafcb69 -42.508,201,4.7,286766bf2b32 -42.614,201,3.4,286766bf2b32 -42.722,201,7.9,286766bf2b32 -42.832,201,4.1,286766bf2b32 -42.938,201,4.5,fa81adafcb69 -43.044,201,4.7,fa81adafcb69 -43.152,201,4.3,fa81adafcb69 -43.261,201,5.3,fa81adafcb69 -43.371,201,5.6,fa81adafcb69 -43.477,201,5.1,286766bf2b32 -43.587,201,5.0,286766bf2b32 -43.694,201,4.4,286766bf2b32 -43.802,201,4.2,286766bf2b32 -43.912,201,21.0,286766bf2b32 -44.037,201,4.5,fa81adafcb69 -44.144,201,11.8,fa81adafcb69 -44.259,201,5.8,286766bf2b32 -44.368,201,24.4,286766bf2b32 -44.497,201,12.7,286766bf2b32 -44.612,201,13.6,286766bf2b32 -44.726,201,24.4,286766bf2b32 -44.856,201,6.6,286766bf2b32 -44.965,201,11.9,286766bf2b32 -45.079,201,10.9,fa81adafcb69 -45.194,201,4.2,286766bf2b32 -45.299,201,8.0,fa81adafcb69 -45.411,201,5.2,286766bf2b32 diff --git a/evidence/failover-each/fe75c6c37e5a/action.txt b/evidence/failover-each/fe75c6c37e5a/action.txt new file mode 100644 index 00000000..229a8c5c --- /dev/null +++ b/evidence/failover-each/fe75c6c37e5a/action.txt @@ -0,0 +1,14 @@ +ff81f93e8b0d api Up About a minute (healthy) +fe75c6c37e5a api Exited (0) Less than a second ago +02:49:51 database bytes,messages: 12867251,9053 +mtusi2026lab3-api-1 cpu=22.79% mem=142.2MiB / 512MiB +mtusi2026lab3-lb-1 cpu=2.61% mem=20.39MiB / 128MiB +mtusi2026lab3-postgres-1 cpu=4.10% mem=49.27MiB / 1GiB +mtusi2026lab3-valkey-1 cpu=1.32% mem=13.1MiB / 128MiB + Container mtusi2026lab3-api-1 Running + Container mtusi2026lab3-api-2 Starting + Container mtusi2026lab3-api-2 Started + Container mtusi2026lab3-api-1 Waiting + Container mtusi2026lab3-api-2 Waiting + Container mtusi2026lab3-api-1 Healthy + Container mtusi2026lab3-api-2 Healthy diff --git a/evidence/failover-each/fe75c6c37e5a/k6/k6.txt b/evidence/failover-each/fe75c6c37e5a/k6/k6.txt new file mode 100644 index 00000000..c0e3e690 --- /dev/null +++ b/evidence/failover-each/fe75c6c37e5a/k6/k6.txt @@ -0,0 +1,2 @@ +time="2026-10-30T02:49:24Z" level=info msg=LOAD-START source=console +measure: 6001 requests, failed ratio 0 diff --git a/evidence/failover-each/fa81adafcb69/k6/summary.json b/evidence/failover-each/fe75c6c37e5a/k6/summary.json similarity index 58% rename from evidence/failover-each/fa81adafcb69/k6/summary.json rename to evidence/failover-each/fe75c6c37e5a/k6/summary.json index cc807d19..2c07b91d 100644 --- a/evidence/failover-each/fa81adafcb69/k6/summary.json +++ b/evidence/failover-each/fe75c6c37e5a/k6/summary.json @@ -1,223 +1,82 @@ { - "root_group": { - "id": "d41d8cd98f00b204e9800998ecf8427e", - "groups": [], - "checks": [ - { - "fails": 0, - "name": "message 201", - "path": "::message 201", - "id": "6445aff337e1ade0bc10402fbac79882", - "passes": 5593 - }, - { - "path": "::history 200", - "id": "fe27b3b8edd292c7f2170a6357b087d0", - "passes": 1409, - "fails": 0, - "name": "history 200" - } - ], - "name": "", - "path": "" - }, - "options": { - "summaryTrendStats": [ - "avg", - "min", - "med", - "p(90)", - "p(95)", - "p(99)", - "max" - ], - "summaryTimeUnit": "", - "noColor": false - }, "state": { "isStdOutTTY": false, "isStdErrTTY": false, - "testRunDurationMs": 70637.557922 + "testRunDurationMs": 70503.117005 }, "metrics": { - "vus_max": { - "values": { - "value": 20, - "min": 20, - "max": 20 - }, - "type": "gauge", - "contains": "default" - }, - "dropped_iterations{scenario:measure}": { - "type": "counter", - "contains": "default", - "values": { - "count": 0, - "rate": 0 - } - }, - "http_req_receiving": { - "values": { - "p(95)": 0.07791234999999998, - "p(99)": 0.14777057999999998, - "max": 3.62675, - "avg": 0.042345881452070244, - "min": 0.007625, - "med": 0.035375, - "p(90)": 0.060791899999999996 - }, - "type": "trend", - "contains": "time" - }, - "http_reqs": { - "type": "counter", - "contains": "default", - "values": { - "rate": 99.8335758972163, - "count": 7052 - } - }, - "http_req_sending": { - "type": "trend", - "contains": "time", - "values": { - "p(99)": 0.08479033999999999, - "max": 3.73, - "avg": 0.01997656891661939, - "min": 0.002583, - "med": 0.01625, - "p(90)": 0.024708, - "p(95)": 0.032292 - } - }, - "iteration_duration": { - "type": "trend", - "contains": "time", - "values": { - "p(99)": 14.284109169999999, - "max": 65.410166, - "avg": 3.0752664154527243, - "min": 1.061667, - "med": 2.253438, - "p(90)": 5.0295756, - "p(95)": 6.6843868499999965 - } - }, - "http_req_blocked": { - "type": "trend", - "contains": "time", - "values": { - "p(95)": 0.00595845, - "p(99)": 0.009894759999999992, - "max": 4.097, - "avg": 0.004901935621100305, - "min": 0.000708, - "med": 0.002917, - "p(90)": 0.004958 - } - }, - "http_req_failed{scenario:measure}": { - "contains": "default", - "values": { - "rate": 0, - "passes": 0, - "fails": 6001 - }, - "type": "rate" - }, - "http_req_duration{scenario:measure,name:get_history}": { - "type": "trend", - "contains": "time", - "values": { - "p(95)": 6.0541024, - "p(99)": 13.423791519999984, - "max": 35.860501, - "avg": 2.8058692688524616, - "min": 1.283542, - "med": 2.0988545, - "p(90)": 4.418058900000002 - } - }, - "http_req_waiting": { - "type": "trend", - "contains": "time", - "values": { - "avg": 2.9341615224049864, - "min": 0.96025, - "med": 2.06075, - "p(90)": 4.871217000000001, - "p(95)": 6.689169049999993, - "p(99)": 14.831595089999988, - "max": 64.992584 - } - }, "vus": { - "type": "gauge", - "contains": "default", "values": { - "value": 1, + "value": 0, "min": 0, - "max": 2 - } - }, - "http_req_failed": { - "type": "rate", - "contains": "default", - "values": { - "rate": 0, - "passes": 0, - "fails": 7052 - } - }, - "iterations{scenario:measure}": { - "values": { - "count": 6001, - "rate": 84.9548055812812 + "max": 3 }, - "type": "counter", + "type": "gauge", "contains": "default" }, - "http_req_duration": { - "type": "trend", - "contains": "time", - "values": { - "max": 65.1965, - "avg": 2.9964839727736843, - "min": 0.991542, - "med": 2.1172709999999997, - "p(90)": 4.9499794, - "p(95)": 6.7592859, - "p(99)": 14.878686489999989 - } - }, - "http_reqs{scenario:measure}": { - "type": "counter", - "contains": "default", - "values": { - "count": 6001, - "rate": 84.9548055812812 - } - }, - "iterations": { - "contains": "default", - "values": { - "count": 7002, - "rate": 99.1257371571623 - }, - "type": "counter" - }, "http_req_duration{scenario:measure,name:post_message}": { "type": "trend", "contains": "time", "values": { - "med": 2.105125, - "p(90)": 4.903875, - "p(95)": 6.559167, - "p(99)": 14.423616999999972, - "max": 65.1965, - "avg": 2.954144761137837, - "min": 0.991542 + "min": 0.862875, + "med": 1.548979, + "p(90)": 2.9327250000000005, + "p(95)": 3.5690767499999994, + "p(99)": 6.153909249999998, + "max": 28.063083, + "avg": 1.874677454863969 + } + }, + "http_req_duration{scenario:measure}": { + "type": "trend", + "contains": "time", + "values": { + "p(95)": 3.618333, + "p(99)": 6.23825, + "max": 36.577708, + "avg": 1.9048608050324902, + "min": 0.862875, + "med": 1.566209, + "p(90)": 2.972667 + } + }, + "dropped_iterations{scenario:measure}": { + "contains": "default", + "values": { + "count": 0, + "rate": 0 + }, + "type": "counter" + }, + "http_req_failed": { + "values": { + "rate": 0, + "passes": 0, + "fails": 7052 + }, + "type": "rate", + "contains": "default" + }, + "iteration_duration": { + "type": "trend", + "contains": "time", + "values": { + "p(90)": 3.0199375, + "p(95)": 3.6165499999999997, + "p(99)": 6.239641759999998, + "max": 36.820709, + "avg": 1.9613262119394446, + "min": 0.921, + "med": 1.6351040000000001 + } + }, + "vus_max": { + "type": "gauge", + "contains": "default", + "values": { + "min": 20, + "max": 20, + "value": 20 } }, "http_req_tls_handshaking": { @@ -233,6 +92,69 @@ "max": 0 } }, + "http_reqs": { + "type": "counter", + "contains": "default", + "values": { + "count": 7052, + "rate": 100.02394645189774 + } + }, + "dropped_iterations": { + "type": "counter", + "contains": "default", + "values": { + "count": 0, + "rate": 0 + } + }, + "http_req_sending": { + "type": "trend", + "contains": "time", + "values": { + "avg": 0.013893221922858738, + "min": 0.00275, + "med": 0.011458, + "p(90)": 0.017583, + "p(95)": 0.021435449999999988, + "p(99)": 0.054310919999999985, + "max": 1.451542 + } + }, + "http_req_receiving": { + "contains": "time", + "values": { + "p(95)": 0.05310244999999999, + "p(99)": 0.08932850999999996, + "max": 3.4675, + "avg": 0.027733872376630664, + "min": 0.006167, + "med": 0.023041, + "p(90)": 0.0425839 + }, + "type": "trend" + }, + "data_received": { + "type": "counter", + "contains": "data", + "values": { + "count": 16604156, + "rate": 235509.53071794618 + } + }, + "http_req_duration{scenario:measure,name:get_history}": { + "type": "trend", + "contains": "time", + "values": { + "p(95)": 3.822308, + "p(99)": 6.884161999999998, + "max": 36.577708, + "avg": 2.0323191296779815, + "min": 0.998708, + "med": 1.624583, + "p(90)": 3.0656336 + } + }, "checks": { "type": "rate", "contains": "default", @@ -246,64 +168,142 @@ "type": "trend", "contains": "time", "values": { - "p(99)": 0, - "max": 4.031458, - "avg": 0.001293900311968236, + "max": 0.188833, + "avg": 0.00041799602949517856, "min": 0, "med": 0, "p(90)": 0, - "p(95)": 0 + "p(95)": 0, + "p(99)": 0 } }, - "data_received": { - "contains": "data", + "http_req_failed{scenario:measure}": { + "type": "rate", + "contains": "default", "values": { - "count": 17465939, - "rate": 247261.3651124008 - }, - "type": "counter" + "rate": 0, + "passes": 0, + "fails": 6001 + } + }, + "iterations{scenario:measure}": { + "type": "counter", + "contains": "default", + "values": { + "count": 6001, + "rate": 85.11680412051025 + } + }, + "iterations": { + "type": "counter", + "contains": "default", + "values": { + "count": 7002, + "rate": 99.3147579489773 + } + }, + "http_req_blocked": { + "type": "trend", + "contains": "time", + "values": { + "p(90)": 0.003291, + "p(95)": 0.004041, + "p(99)": 0.006208, + "max": 0.494459, + "avg": 0.0027004892229154963, + "min": 0.000666, + "med": 0.001875 + } + }, + "http_req_duration": { + "type": "trend", + "contains": "time", + "values": { + "p(95)": 3.60760595, + "p(99)": 8.653849589999998, + "max": 36.577708, + "avg": 1.926197078417462, + "min": 0.862875, + "med": 1.5504995, + "p(90)": 2.94885 + } + }, + "http_reqs{scenario:measure}": { + "type": "counter", + "contains": "default", + "values": { + "count": 6001, + "rate": 85.11680412051025 + } }, "http_req_duration{expected_response:true}": { "type": "trend", "contains": "time", "values": { - "p(95)": 6.7592859, - "p(99)": 14.878686489999989, - "max": 65.1965, - "avg": 2.9964839727736843, - "min": 0.991542, - "med": 2.1172709999999997, - "p(90)": 4.9499794 + "avg": 1.926197078417462, + "min": 0.862875, + "med": 1.5504995, + "p(90)": 2.94885, + "p(95)": 3.60760595, + "p(99)": 8.653849589999998, + "max": 36.577708 } }, - "dropped_iterations": { - "type": "counter", - "contains": "default", - "values": { - "count": 0, - "rate": 0 - } - }, - "http_req_duration{scenario:measure}": { + "http_req_waiting": { + "type": "trend", "contains": "time", "values": { - "avg": 2.9240004350941544, - "min": 0.991542, - "med": 2.103375, - "p(90)": 4.827916, - "p(95)": 6.459333, - "p(99)": 14.158125, - "max": 65.1965 - }, - "type": "trend" + "min": 0.842875, + "med": 1.514396, + "p(90)": 2.8950378, + "p(95)": 3.5574022999999992, + "p(99)": 8.57573916, + "max": 36.512667, + "avg": 1.8845699841179808 + } }, "data_sent": { - "type": "counter", - "contains": "data", "values": { - "count": 2050800, - "rate": 29032.713762054907 - } + "count": 2058898, + "rate": 29202.935805717436 + }, + "type": "counter", + "contains": "data" } + }, + "root_group": { + "name": "", + "path": "", + "id": "d41d8cd98f00b204e9800998ecf8427e", + "groups": [], + "checks": [ + { + "name": "message 201", + "path": "::message 201", + "id": "6445aff337e1ade0bc10402fbac79882", + "passes": 5661, + "fails": 0 + }, + { + "id": "fe27b3b8edd292c7f2170a6357b087d0", + "passes": 1341, + "fails": 0, + "name": "history 200", + "path": "::history 200" + } + ] + }, + "options": { + "summaryTrendStats": [ + "avg", + "min", + "med", + "p(90)", + "p(95)", + "p(99)", + "max" + ], + "summaryTimeUnit": "", + "noColor": false } } \ No newline at end of file diff --git a/evidence/failover-each/fe75c6c37e5a/lb_up.csv b/evidence/failover-each/fe75c6c37e5a/lb_up.csv new file mode 100644 index 00000000..1a11f82f --- /dev/null +++ b/evidence/failover-each/fe75c6c37e5a/lb_up.csv @@ -0,0 +1,653 @@ +t_rel_s,up +-25.746,2 +-25.634,2 +-25.532,2 +-25.424,2 +-25.309,2 +-25.199,2 +-25.092,2 +-24.978,2 +-24.866,2 +-24.753,2 +-24.647,2 +-24.54,2 +-24.43,2 +-24.322,2 +-24.216,2 +-24.106,2 +-23.997,2 +-23.89,2 +-23.784,2 +-23.672,2 +-23.56,2 +-23.454,2 +-23.34,2 +-23.231,2 +-23.118,2 +-23.006,2 +-22.899,2 +-22.793,2 +-22.687,2 +-22.58,2 +-22.476,2 +-22.364,2 +-22.254,2 +-22.141,2 +-22.029,2 +-21.922,2 +-21.817,2 +-21.705,2 +-21.601,2 +-21.489,2 +-21.378,2 +-21.271,2 +-21.161,2 +-21.057,2 +-20.952,2 +-20.836,2 +-20.728,2 +-20.621,2 +-20.507,2 +-20.397,2 +-20.287,2 +-20.174,2 +-20.061,2 +-19.951,2 +-19.841,2 +-19.732,2 +-19.619,2 +-19.508,2 +-19.397,2 +-19.289,2 +-19.182,2 +-19.073,2 +-18.964,2 +-18.856,2 +-18.749,2 +-18.646,2 +-18.538,2 +-18.431,2 +-18.326,2 +-18.215,2 +-18.111,2 +-18.004,2 +-17.892,2 +-17.787,2 +-17.675,2 +-17.564,2 +-17.449,2 +-17.339,2 +-17.226,2 +-17.118,2 +-17.008,2 +-16.898,2 +-16.795,2 +-16.687,2 +-16.58,2 +-16.469,2 +-16.36,2 +-16.254,2 +-16.149,2 +-16.039,2 +-15.934,2 +-15.822,2 +-15.719,2 +-15.61,2 +-15.502,2 +-15.393,2 +-15.285,2 +-15.179,2 +-15.068,2 +-14.956,2 +-14.852,2 +-14.743,2 +-14.634,2 +-14.521,2 +-14.408,2 +-14.301,2 +-14.19,2 +-14.084,2 +-13.979,2 +-13.868,2 +-13.761,2 +-13.654,2 +-13.551,2 +-13.439,2 +-13.327,2 +-13.222,2 +-13.113,2 +-13.006,2 +-12.899,2 +-12.786,2 +-12.675,2 +-12.57,2 +-12.462,2 +-12.351,2 +-12.24,2 +-12.135,2 +-12.023,2 +-11.913,2 +-11.802,2 +-11.69,2 +-11.582,2 +-11.472,2 +-11.36,2 +-11.247,2 +-11.141,2 +-11.035,2 +-10.925,2 +-10.813,2 +-10.707,2 +-10.595,2 +-10.49,2 +-10.381,2 +-10.274,2 +-10.166,2 +-10.057,2 +-9.95,2 +-9.841,2 +-9.735,2 +-9.627,2 +-9.516,2 +-9.412,2 +-9.309,2 +-9.196,2 +-9.082,2 +-8.968,2 +-8.864,2 +-8.757,2 +-8.649,2 +-8.541,2 +-8.434,2 +-8.329,2 +-8.224,2 +-8.114,2 +-8.003,2 +-7.896,2 +-7.783,2 +-7.67,2 +-7.559,2 +-7.452,2 +-7.341,2 +-7.233,2 +-7.125,2 +-7.014,2 +-6.904,2 +-6.794,2 +-6.682,2 +-6.571,2 +-6.459,2 +-6.354,2 +-6.244,2 +-6.131,2 +-6.019,2 +-5.911,2 +-5.799,2 +-5.695,2 +-5.584,2 +-5.477,2 +-5.368,2 +-5.261,2 +-5.148,2 +-5.035,2 +-4.929,2 +-4.826,2 +-4.713,2 +-4.606,2 +-4.491,2 +-4.38,2 +-4.27,2 +-4.163,2 +-4.046,2 +-3.935,2 +-3.826,2 +-3.717,2 +-3.61,2 +-3.504,2 +-3.397,2 +-3.289,2 +-3.177,2 +-3.066,2 +-2.953,2 +-2.843,2 +-2.736,2 +-2.631,2 +-2.525,2 +-2.412,2 +-2.304,2 +-2.19,2 +-2.079,2 +-1.971,2 +-1.86,2 +-1.749,2 +-1.638,2 +-1.533,2 +-1.424,2 +-1.319,2 +-1.21,2 +-1.098,2 +-0.988,2 +-0.879,2 +-0.775,2 +-0.666,2 +-0.555,2 +-0.45,2 +-0.345,2 +-0.241,2 +-0.127,2 +-0.014,2 +0.096,2 +0.207,2 +0.32,2 +0.423,2 +0.531,2 +0.641,2 +0.752,2 +0.859,1 +0.97,1 +1.08,1 +1.193,1 +1.301,1 +1.413,1 +1.524,1 +1.636,1 +1.744,1 +1.855,1 +1.96,1 +2.072,1 +2.184,1 +2.297,1 +2.403,1 +2.516,1 +2.621,1 +2.73,1 +2.836,1 +2.945,1 +3.057,1 +3.164,1 +3.275,1 +3.386,1 +3.496,1 +3.611,1 +3.719,1 +3.83,1 +3.936,1 +4.05,1 +4.159,1 +4.267,1 +4.379,1 +4.484,1 +4.59,1 +4.703,1 +4.811,1 +4.918,1 +5.027,1 +5.136,1 +5.241,1 +5.355,1 +5.469,1 +5.581,1 +5.689,1 +5.799,1 +5.908,1 +6.015,1 +6.129,1 +6.233,1 +6.346,1 +6.454,1 +6.565,1 +6.677,1 +6.79,1 +6.901,1 +7.008,1 +7.121,1 +7.234,1 +7.346,1 +7.449,1 +7.559,1 +7.668,1 +7.775,1 +7.886,1 +7.994,1 +8.105,1 +8.21,1 +8.324,1 +8.432,1 +8.545,1 +8.651,1 +8.761,1 +8.868,1 +8.978,1 +9.091,1 +9.199,1 +9.306,1 +9.414,1 +9.527,1 +9.636,1 +9.747,1 +9.853,1 +9.965,1 +10.068,1 +10.176,1 +10.285,1 +10.401,1 +10.508,1 +10.619,1 +10.728,1 +10.837,1 +10.949,1 +11.061,1 +11.171,1 +11.283,1 +11.393,1 +11.501,1 +11.617,1 +11.725,1 +11.835,1 +11.942,1 +12.054,1 +12.159,1 +12.27,1 +12.378,1 +12.481,1 +12.591,1 +12.703,1 +12.807,1 +12.911,1 +13.021,1 +13.131,1 +13.241,1 +13.356,1 +13.463,1 +13.574,1 +13.686,1 +13.795,1 +13.906,1 +14.014,1 +14.123,1 +14.232,1 +14.343,2 +14.452,2 +14.565,2 +14.671,2 +14.782,2 +14.886,2 +14.994,2 +15.108,2 +15.223,2 +15.336,2 +15.446,2 +15.56,2 +15.674,2 +15.781,2 +15.895,2 +16.01,2 +16.12,2 +16.227,2 +16.341,2 +16.455,2 +16.566,2 +16.68,2 +16.789,2 +16.9,2 +17.011,2 +17.122,2 +17.23,2 +17.34,2 +17.445,2 +17.556,2 +17.668,2 +17.774,2 +17.877,2 +17.981,2 +18.085,2 +18.191,2 +18.3,2 +18.412,2 +18.527,2 +18.634,2 +18.74,2 +18.846,2 +18.962,2 +19.077,2 +19.188,2 +19.293,2 +19.402,2 +19.51,2 +19.62,2 +19.725,2 +19.83,2 +19.934,2 +20.04,2 +20.156,2 +20.269,2 +20.381,2 +20.493,2 +20.612,2 +20.723,2 +20.827,2 +20.938,2 +21.043,2 +21.151,2 +21.26,2 +21.374,2 +21.489,2 +21.599,2 +21.71,2 +21.818,2 +21.931,2 +22.037,2 +22.142,2 +22.254,2 +22.366,2 +22.48,2 +22.586,2 +22.695,2 +22.808,2 +22.921,2 +23.037,2 +23.148,2 +23.256,2 +23.365,2 +23.47,2 +23.58,2 +23.69,2 +23.798,2 +23.904,2 +24.008,2 +24.114,2 +24.227,2 +24.34,2 +24.447,2 +24.553,2 +24.662,2 +24.775,2 +24.886,2 +24.995,2 +25.108,2 +25.219,2 +25.329,2 +25.441,2 +25.555,2 +25.665,2 +25.78,2 +25.893,2 +25.998,2 +26.103,2 +26.206,2 +26.317,2 +26.423,2 +26.535,2 +26.641,2 +26.747,2 +26.86,2 +26.964,2 +27.075,2 +27.184,2 +27.288,2 +27.399,2 +27.511,2 +27.615,2 +27.721,2 +27.831,2 +27.938,2 +28.043,2 +28.149,2 +28.259,2 +28.364,2 +28.468,2 +28.58,2 +28.689,2 +28.8,2 +28.91,2 +29.017,2 +29.129,2 +29.238,2 +29.345,2 +29.452,2 +29.565,2 +29.676,2 +29.783,2 +29.887,2 +29.994,2 +30.101,2 +30.208,2 +30.315,2 +30.427,2 +30.538,2 +30.651,2 +30.759,2 +30.87,2 +30.977,2 +31.082,2 +31.191,2 +31.299,2 +31.408,2 +31.521,2 +31.632,2 +31.736,2 +31.845,2 +31.957,2 +32.071,2 +32.182,2 +32.295,2 +32.404,2 +32.51,2 +32.622,2 +32.737,2 +32.846,2 +32.961,2 +33.069,2 +33.181,2 +33.292,2 +33.401,2 +33.514,2 +33.621,2 +33.728,2 +33.837,2 +33.942,2 +34.049,2 +34.152,2 +34.261,2 +34.366,2 +34.479,2 +34.588,2 +34.692,2 +34.797,2 +34.901,2 +35.011,2 +35.118,2 +35.227,2 +35.337,2 +35.443,2 +35.556,2 +35.665,2 +35.774,2 +35.886,2 +35.999,2 +36.108,2 +36.22,2 +36.333,2 +36.446,2 +36.554,2 +36.661,2 +36.774,2 +36.886,2 +36.994,2 +37.108,2 +37.217,2 +37.33,2 +37.437,2 +37.54,2 +37.653,2 +37.761,2 +37.872,2 +37.983,2 +38.094,2 +38.201,2 +38.313,2 +38.421,2 +38.532,2 +38.636,2 +38.749,2 +38.856,2 +38.97,2 +39.08,2 +39.194,2 +39.302,2 +39.411,2 +39.524,2 +39.636,2 +39.749,2 +39.856,2 +39.963,2 +40.07,2 +40.182,2 +40.294,2 +40.407,2 +40.521,2 +40.631,2 +40.735,2 +40.844,2 +40.956,2 +41.071,2 +41.181,2 +41.289,2 +41.398,2 +41.508,2 +41.619,2 +41.732,2 +41.842,2 +41.956,2 +42.07,2 +42.178,2 +42.292,2 +42.406,2 +42.516,2 +42.626,2 +42.736,2 +42.846,2 +42.957,2 +43.067,2 +43.178,2 +43.293,2 +43.407,2 +43.512,2 +43.625,2 +43.739,2 +43.844,2 +43.951,2 +44.059,2 +44.171,2 +44.285,2 +44.397,2 +44.507,2 +44.619,2 +44.729,2 +44.843,2 +44.951,2 +45.058,2 +45.169,2 +45.278,2 +45.387,2 +45.499,2 diff --git a/evidence/failover-each/fe75c6c37e5a/probe.csv b/evidence/failover-each/fe75c6c37e5a/probe.csv new file mode 100644 index 00000000..531ebbe6 --- /dev/null +++ b/evidence/failover-each/fe75c6c37e5a/probe.csv @@ -0,0 +1,647 @@ +t_rel_s,status,latency_ms,instance +-25.746,201,3.9,fe75c6c37e5a +-25.642,201,3.7,ff81f93e8b0d +-25.536,201,4.0,fe75c6c37e5a +-25.424,201,5.4,fe75c6c37e5a +-25.315,201,4.1,fe75c6c37e5a +-25.203,201,3.3,ff81f93e8b0d +-25.091,201,4.0,ff81f93e8b0d +-24.978,201,4.8,fe75c6c37e5a +-24.864,201,3.1,fe75c6c37e5a +-24.759,201,4.8,fe75c6c37e5a +-24.653,201,3.6,fe75c6c37e5a +-24.54,201,5.0,fe75c6c37e5a +-24.428,201,3.1,fe75c6c37e5a +-24.316,201,3.0,fe75c6c37e5a +-24.204,201,2.6,fe75c6c37e5a +-24.097,201,3.9,fe75c6c37e5a +-23.984,201,3.1,fe75c6c37e5a +-23.879,201,2.8,fe75c6c37e5a +-23.77,201,3.1,fe75c6c37e5a +-23.657,201,2.7,fe75c6c37e5a +-23.545,201,3.8,fe75c6c37e5a +-23.44,201,4.4,fe75c6c37e5a +-23.326,201,5.9,fe75c6c37e5a +-23.21,201,3.6,ff81f93e8b0d +-23.099,201,3.8,ff81f93e8b0d +-22.988,201,3.5,ff81f93e8b0d +-22.881,201,3.3,ff81f93e8b0d +-22.773,201,2.9,fe75c6c37e5a +-22.668,201,3.1,fe75c6c37e5a +-22.557,201,3.5,fe75c6c37e5a +-22.447,201,3.5,fe75c6c37e5a +-22.339,201,3.2,fe75c6c37e5a +-22.235,201,2.8,ff81f93e8b0d +-22.13,201,2.8,ff81f93e8b0d +-22.021,201,2.9,ff81f93e8b0d +-21.918,201,2.7,fe75c6c37e5a +-21.808,201,2.6,fe75c6c37e5a +-21.697,201,3.7,fe75c6c37e5a +-21.588,201,4.6,fe75c6c37e5a +-21.474,201,3.8,fe75c6c37e5a +-21.365,201,3.2,fe75c6c37e5a +-21.258,201,3.0,fe75c6c37e5a +-21.153,201,7.8,fe75c6c37e5a +-21.038,201,3.3,fe75c6c37e5a +-20.929,201,4.0,fe75c6c37e5a +-20.817,201,4.3,fe75c6c37e5a +-20.704,201,3.3,fe75c6c37e5a +-20.592,201,3.3,fe75c6c37e5a +-20.481,201,3.1,ff81f93e8b0d +-20.375,201,5.8,fe75c6c37e5a +-20.265,201,3.3,fe75c6c37e5a +-20.156,201,3.3,fe75c6c37e5a +-20.047,201,2.8,fe75c6c37e5a +-19.938,201,3.5,fe75c6c37e5a +-19.827,201,5.8,fe75c6c37e5a +-19.712,201,3.9,fe75c6c37e5a +-19.608,201,5.0,fe75c6c37e5a +-19.502,201,3.0,ff81f93e8b0d +-19.391,201,4.4,fe75c6c37e5a +-19.278,201,3.1,fe75c6c37e5a +-19.172,201,2.9,fe75c6c37e5a +-19.066,201,2.9,ff81f93e8b0d +-18.953,201,3.3,ff81f93e8b0d +-18.842,201,5.1,fe75c6c37e5a +-18.73,201,4.1,fe75c6c37e5a +-18.618,201,5.5,fe75c6c37e5a +-18.505,201,3.9,fe75c6c37e5a +-18.391,201,5.0,ff81f93e8b0d +-18.278,201,4.5,ff81f93e8b0d +-18.172,201,4.2,ff81f93e8b0d +-18.064,201,3.2,fe75c6c37e5a +-17.956,201,3.7,fe75c6c37e5a +-17.844,201,3.6,fe75c6c37e5a +-17.735,201,3.7,fe75c6c37e5a +-17.63,201,3.3,fe75c6c37e5a +-17.518,201,4.1,fe75c6c37e5a +-17.411,201,4.2,fe75c6c37e5a +-17.3,201,3.4,fe75c6c37e5a +-17.195,201,3.4,ff81f93e8b0d +-17.089,201,4.0,ff81f93e8b0d +-16.975,201,4.4,ff81f93e8b0d +-16.864,201,3.5,ff81f93e8b0d +-16.759,201,4.8,ff81f93e8b0d +-16.646,201,4.1,ff81f93e8b0d +-16.534,201,3.6,ff81f93e8b0d +-16.424,201,4.4,ff81f93e8b0d +-16.31,201,5.0,fe75c6c37e5a +-16.195,201,6.2,fe75c6c37e5a +-16.085,201,4.2,fe75c6c37e5a +-15.972,201,4.0,ff81f93e8b0d +-15.861,201,3.0,ff81f93e8b0d +-15.756,201,3.6,fe75c6c37e5a +-15.644,201,6.6,ff81f93e8b0d +-15.529,201,4.7,ff81f93e8b0d +-15.42,201,3.6,ff81f93e8b0d +-15.313,201,4.7,fe75c6c37e5a +-15.202,201,3.6,ff81f93e8b0d +-15.092,201,5.8,ff81f93e8b0d +-14.985,201,4.6,ff81f93e8b0d +-14.877,201,3.4,ff81f93e8b0d +-14.765,201,3.4,ff81f93e8b0d +-14.656,201,4.5,ff81f93e8b0d +-14.545,201,7.4,ff81f93e8b0d +-14.434,201,3.3,ff81f93e8b0d +-14.322,201,3.7,fe75c6c37e5a +-14.212,201,4.5,fe75c6c37e5a +-14.105,201,4.5,ff81f93e8b0d +-13.992,201,4.9,fe75c6c37e5a +-13.882,201,3.5,fe75c6c37e5a +-13.77,201,3.4,fe75c6c37e5a +-13.664,201,3.2,ff81f93e8b0d +-13.559,201,5.3,ff81f93e8b0d +-13.446,201,3.4,ff81f93e8b0d +-13.333,201,3.9,fe75c6c37e5a +-13.224,201,5.2,fe75c6c37e5a +-13.115,201,3.6,ff81f93e8b0d +-13.003,201,3.6,ff81f93e8b0d +-12.892,201,4.8,fe75c6c37e5a +-12.778,201,3.0,fe75c6c37e5a +-12.674,201,2.9,ff81f93e8b0d +-12.57,201,3.9,ff81f93e8b0d +-12.463,201,3.5,fe75c6c37e5a +-12.351,201,5.9,ff81f93e8b0d +-12.238,201,2.9,ff81f93e8b0d +-12.133,201,3.6,fe75c6c37e5a +-12.023,201,5.1,ff81f93e8b0d +-11.91,201,4.8,ff81f93e8b0d +-11.801,201,4.4,ff81f93e8b0d +-11.687,201,3.9,ff81f93e8b0d +-11.578,201,3.0,ff81f93e8b0d +-11.467,201,2.8,ff81f93e8b0d +-11.358,201,4.5,ff81f93e8b0d +-11.247,201,3.5,ff81f93e8b0d +-11.139,201,4.9,ff81f93e8b0d +-11.033,201,2.8,fe75c6c37e5a +-10.925,201,3.9,fe75c6c37e5a +-10.812,201,4.6,ff81f93e8b0d +-10.705,201,2.8,fe75c6c37e5a +-10.598,201,4.4,fe75c6c37e5a +-10.488,201,3.1,fe75c6c37e5a +-10.383,201,5.0,fe75c6c37e5a +-10.273,201,4.1,fe75c6c37e5a +-10.166,201,3.7,ff81f93e8b0d +-10.057,201,4.6,ff81f93e8b0d +-9.945,201,3.5,ff81f93e8b0d +-9.841,201,4.4,ff81f93e8b0d +-9.735,201,4.7,fe75c6c37e5a +-9.621,201,2.6,ff81f93e8b0d +-9.51,201,2.6,ff81f93e8b0d +-9.401,201,3.6,ff81f93e8b0d +-9.287,201,4.5,ff81f93e8b0d +-9.172,201,3.9,fe75c6c37e5a +-9.065,201,4.7,ff81f93e8b0d +-8.951,201,3.5,fe75c6c37e5a +-8.84,201,3.3,fe75c6c37e5a +-8.727,201,3.0,fe75c6c37e5a +-8.618,201,3.1,fe75c6c37e5a +-8.506,201,3.7,fe75c6c37e5a +-8.394,201,3.6,fe75c6c37e5a +-8.287,201,3.3,fe75c6c37e5a +-8.182,201,3.9,fe75c6c37e5a +-8.07,201,4.0,fe75c6c37e5a +-7.961,201,3.1,fe75c6c37e5a +-7.857,201,4.2,ff81f93e8b0d +-7.745,201,3.6,ff81f93e8b0d +-7.633,201,3.1,fe75c6c37e5a +-7.52,201,4.0,fe75c6c37e5a +-7.413,201,4.0,ff81f93e8b0d +-7.304,201,3.0,ff81f93e8b0d +-7.2,201,4.4,ff81f93e8b0d +-7.095,201,4.2,fe75c6c37e5a +-6.983,201,3.4,fe75c6c37e5a +-6.876,201,2.9,fe75c6c37e5a +-6.763,201,2.8,fe75c6c37e5a +-6.652,201,3.6,ff81f93e8b0d +-6.542,201,3.4,ff81f93e8b0d +-6.432,201,4.6,ff81f93e8b0d +-6.32,201,3.2,ff81f93e8b0d +-6.211,201,2.9,ff81f93e8b0d +-6.104,201,4.6,fe75c6c37e5a +-5.993,201,3.8,ff81f93e8b0d +-5.889,201,3.0,fe75c6c37e5a +-5.778,201,3.6,fe75c6c37e5a +-5.673,201,4.2,ff81f93e8b0d +-5.565,201,4.5,ff81f93e8b0d +-5.459,201,4.5,ff81f93e8b0d +-5.345,201,3.5,ff81f93e8b0d +-5.239,201,3.1,ff81f93e8b0d +-5.128,201,3.3,ff81f93e8b0d +-5.018,201,3.0,ff81f93e8b0d +-4.913,201,4.3,ff81f93e8b0d +-4.805,201,3.5,fe75c6c37e5a +-4.692,201,3.4,ff81f93e8b0d +-4.578,201,2.8,ff81f93e8b0d +-4.465,201,3.9,ff81f93e8b0d +-4.352,201,4.0,fe75c6c37e5a +-4.242,201,4.4,fe75c6c37e5a +-4.132,201,8.4,fe75c6c37e5a +-4.016,201,4.6,fe75c6c37e5a +-3.903,201,4.2,fe75c6c37e5a +-3.789,201,3.2,ff81f93e8b0d +-3.684,201,4.0,fe75c6c37e5a +-3.579,201,5.5,fe75c6c37e5a +-3.47,201,4.8,fe75c6c37e5a +-3.363,201,4.6,fe75c6c37e5a +-3.252,201,3.9,fe75c6c37e5a +-3.14,201,3.2,fe75c6c37e5a +-3.031,201,4.0,fe75c6c37e5a +-2.922,201,3.6,fe75c6c37e5a +-2.817,201,3.1,ff81f93e8b0d +-2.708,201,3.3,ff81f93e8b0d +-2.598,201,3.1,ff81f93e8b0d +-2.486,201,4.4,ff81f93e8b0d +-2.377,201,4.9,ff81f93e8b0d +-2.271,201,3.6,ff81f93e8b0d +-2.162,201,6.7,ff81f93e8b0d +-2.054,201,3.8,fe75c6c37e5a +-1.942,201,6.2,ff81f93e8b0d +-1.829,201,3.7,ff81f93e8b0d +-1.723,201,4.2,ff81f93e8b0d +-1.614,201,3.5,fe75c6c37e5a +-1.505,201,5.7,fe75c6c37e5a +-1.398,201,2.8,fe75c6c37e5a +-1.293,201,5.8,fe75c6c37e5a +-1.177,201,5.6,fe75c6c37e5a +-1.068,201,3.5,fe75c6c37e5a +-0.956,201,3.5,fe75c6c37e5a +-0.843,201,5.6,fe75c6c37e5a +-0.729,201,4.6,ff81f93e8b0d +-0.618,201,4.8,ff81f93e8b0d +-0.504,201,4.4,ff81f93e8b0d +-0.39,201,5.0,fe75c6c37e5a +-0.284,201,3.6,ff81f93e8b0d +-0.17,201,3.3,fe75c6c37e5a +-0.066,201,4.6,ff81f93e8b0d +0.048,201,4.6,ff81f93e8b0d +0.155,201,3.4,ff81f93e8b0d +0.26,201,2.9,ff81f93e8b0d +0.37,201,3.5,ff81f93e8b0d +0.481,201,3.7,ff81f93e8b0d +0.589,201,5.1,ff81f93e8b0d +0.702,201,4.7,ff81f93e8b0d +0.807,201,5.9,ff81f93e8b0d +0.923,201,9.2,ff81f93e8b0d +1.039,201,5.3,ff81f93e8b0d +1.154,201,3.0,ff81f93e8b0d +1.262,201,4.2,ff81f93e8b0d +1.377,201,4.8,ff81f93e8b0d +1.491,201,6.2,ff81f93e8b0d +1.6,201,3.2,ff81f93e8b0d +1.709,201,5.1,ff81f93e8b0d +1.816,201,3.3,ff81f93e8b0d +1.928,201,3.5,ff81f93e8b0d +2.036,201,3.4,ff81f93e8b0d +2.145,201,4.1,ff81f93e8b0d +2.259,201,3.9,ff81f93e8b0d +2.372,201,5.5,ff81f93e8b0d +2.486,201,4.0,ff81f93e8b0d +2.592,201,5.0,ff81f93e8b0d +2.699,201,3.2,ff81f93e8b0d +2.812,201,3.1,ff81f93e8b0d +2.922,201,5.1,ff81f93e8b0d +3.034,201,4.3,ff81f93e8b0d +3.142,201,4.1,ff81f93e8b0d +3.254,201,3.2,ff81f93e8b0d +3.361,201,3.8,ff81f93e8b0d +3.471,201,4.2,ff81f93e8b0d +3.584,201,3.3,ff81f93e8b0d +3.692,201,3.6,ff81f93e8b0d +3.798,201,4.2,ff81f93e8b0d +3.911,201,3.5,ff81f93e8b0d +4.022,201,6.0,ff81f93e8b0d +4.129,201,3.7,ff81f93e8b0d +4.241,201,4.9,ff81f93e8b0d +4.356,201,5.4,ff81f93e8b0d +4.471,201,3.6,ff81f93e8b0d +4.581,201,3.9,ff81f93e8b0d +4.687,201,5.7,ff81f93e8b0d +4.797,201,5.9,ff81f93e8b0d +4.913,201,7.6,ff81f93e8b0d +5.027,201,4.0,ff81f93e8b0d +5.141,201,4.4,ff81f93e8b0d +5.254,201,3.8,ff81f93e8b0d +5.366,201,4.1,ff81f93e8b0d +5.475,201,4.1,ff81f93e8b0d +5.587,201,3.0,ff81f93e8b0d +5.695,201,2.6,ff81f93e8b0d +5.799,201,4.1,ff81f93e8b0d +5.911,201,4.3,ff81f93e8b0d +6.018,201,4.5,ff81f93e8b0d +6.123,201,3.9,ff81f93e8b0d +6.237,201,5.0,ff81f93e8b0d +6.35,201,2.4,ff81f93e8b0d +6.462,201,2.4,ff81f93e8b0d +6.568,201,4.3,ff81f93e8b0d +6.68,201,5.2,ff81f93e8b0d +6.793,201,4.5,ff81f93e8b0d +6.899,201,4.1,ff81f93e8b0d +7.008,201,5.6,ff81f93e8b0d +7.123,201,3.1,ff81f93e8b0d +7.229,201,4.4,ff81f93e8b0d +7.336,201,4.9,ff81f93e8b0d +7.446,201,4.0,ff81f93e8b0d +7.559,201,4.2,ff81f93e8b0d +7.666,201,5.1,ff81f93e8b0d +7.782,201,3.6,ff81f93e8b0d +7.893,201,4.0,ff81f93e8b0d +8.004,201,3.2,ff81f93e8b0d +8.11,201,3.9,ff81f93e8b0d +8.219,201,2.5,ff81f93e8b0d +8.327,201,3.3,ff81f93e8b0d +8.43,201,5.6,ff81f93e8b0d +8.543,201,6.1,ff81f93e8b0d +8.658,201,3.6,ff81f93e8b0d +8.762,201,3.9,ff81f93e8b0d +8.876,201,4.5,ff81f93e8b0d +8.99,201,6.7,ff81f93e8b0d +9.107,201,2.7,ff81f93e8b0d +9.219,201,5.0,ff81f93e8b0d +9.334,201,4.0,ff81f93e8b0d +9.445,201,5.6,ff81f93e8b0d +9.553,201,3.5,ff81f93e8b0d +9.66,201,4.1,ff81f93e8b0d +9.768,201,3.9,ff81f93e8b0d +9.873,201,3.5,ff81f93e8b0d +9.982,201,2.7,ff81f93e8b0d +10.093,201,4.2,ff81f93e8b0d +10.202,201,4.4,ff81f93e8b0d +10.315,201,4.8,ff81f93e8b0d +10.423,201,3.4,ff81f93e8b0d +10.532,201,3.7,ff81f93e8b0d +10.639,201,3.8,ff81f93e8b0d +10.75,201,2.9,ff81f93e8b0d +10.855,201,3.9,ff81f93e8b0d +10.966,201,4.3,ff81f93e8b0d +11.081,201,3.2,ff81f93e8b0d +11.192,201,5.1,ff81f93e8b0d +11.303,201,3.2,ff81f93e8b0d +11.409,201,5.2,ff81f93e8b0d +11.514,201,4.8,ff81f93e8b0d +11.624,201,3.6,ff81f93e8b0d +11.734,201,4.6,ff81f93e8b0d +11.848,201,3.0,ff81f93e8b0d +11.954,201,3.4,ff81f93e8b0d +12.065,201,5.1,ff81f93e8b0d +12.175,201,4.6,ff81f93e8b0d +12.287,201,5.6,ff81f93e8b0d +12.403,201,2.8,ff81f93e8b0d +12.513,201,4.6,ff81f93e8b0d +12.628,201,2.9,ff81f93e8b0d +12.734,201,3.1,ff81f93e8b0d +12.839,201,6.0,ff81f93e8b0d +12.949,201,4.5,ff81f93e8b0d +13.057,201,4.5,ff81f93e8b0d +13.169,201,4.6,ff81f93e8b0d +13.281,201,4.2,ff81f93e8b0d +13.389,201,3.8,ff81f93e8b0d +13.498,201,3.8,ff81f93e8b0d +13.604,201,3.3,ff81f93e8b0d +13.71,201,6.1,ff81f93e8b0d +13.823,201,3.4,ff81f93e8b0d +13.929,201,3.0,ff81f93e8b0d +14.042,201,6.6,ff81f93e8b0d +14.159,201,3.7,ff81f93e8b0d +14.264,201,3.6,ff81f93e8b0d +14.37,201,3.5,ff81f93e8b0d +14.481,201,2.8,ff81f93e8b0d +14.593,201,4.2,ff81f93e8b0d +14.701,201,4.6,ff81f93e8b0d +14.814,201,5.1,ff81f93e8b0d +14.92,201,5.1,ff81f93e8b0d +15.027,201,5.8,ff81f93e8b0d +15.136,201,3.8,fe75c6c37e5a +15.245,201,7.4,ff81f93e8b0d +15.358,201,3.7,ff81f93e8b0d +15.467,201,5.1,ff81f93e8b0d +15.574,201,5.2,fe75c6c37e5a +15.683,201,3.3,fe75c6c37e5a +15.795,201,4.5,fe75c6c37e5a +15.905,201,4.0,fe75c6c37e5a +16.015,201,3.5,fe75c6c37e5a +16.12,201,4.2,fe75c6c37e5a +16.227,201,5.7,fe75c6c37e5a +16.342,201,5.6,fe75c6c37e5a +16.456,201,3.6,fe75c6c37e5a +16.567,201,5.1,ff81f93e8b0d +16.682,201,4.2,ff81f93e8b0d +16.794,201,3.9,ff81f93e8b0d +16.898,201,4.9,ff81f93e8b0d +17.011,201,5.5,ff81f93e8b0d +17.123,201,2.8,ff81f93e8b0d +17.236,201,3.8,ff81f93e8b0d +17.349,201,4.2,fe75c6c37e5a +17.459,201,4.0,fe75c6c37e5a +17.571,201,4.5,fe75c6c37e5a +17.68,201,5.2,fe75c6c37e5a +17.795,201,5.0,fe75c6c37e5a +17.902,201,3.5,fe75c6c37e5a +18.011,201,3.5,fe75c6c37e5a +18.124,201,5.0,fe75c6c37e5a +18.235,201,4.8,fe75c6c37e5a +18.343,201,4.7,fe75c6c37e5a +18.456,201,6.4,ff81f93e8b0d +18.57,201,8.4,ff81f93e8b0d +18.686,201,5.4,fe75c6c37e5a +18.798,201,14.1,fe75c6c37e5a +18.918,201,12.1,ff81f93e8b0d +19.038,201,6.1,fe75c6c37e5a +19.148,201,5.5,fe75c6c37e5a +19.258,201,6.2,fe75c6c37e5a +19.364,201,7.6,ff81f93e8b0d +19.477,201,5.7,ff81f93e8b0d +19.586,201,4.6,ff81f93e8b0d +19.695,201,4.3,ff81f93e8b0d +19.808,201,6.6,fe75c6c37e5a +19.916,201,7.9,fe75c6c37e5a +20.025,201,6.3,ff81f93e8b0d +20.132,201,7.5,ff81f93e8b0d +20.243,201,5.6,ff81f93e8b0d +20.355,201,6.9,ff81f93e8b0d +20.471,201,33.0,ff81f93e8b0d +20.608,201,11.1,ff81f93e8b0d +20.729,201,5.7,fe75c6c37e5a +20.837,201,5.5,fe75c6c37e5a +20.949,201,4.3,fe75c6c37e5a +21.06,201,7.0,fe75c6c37e5a +21.168,201,7.4,fe75c6c37e5a +21.286,201,6.2,fe75c6c37e5a +21.392,201,5.2,fe75c6c37e5a +21.502,201,3.8,fe75c6c37e5a +21.606,201,5.5,ff81f93e8b0d +21.72,201,3.6,fe75c6c37e5a +21.832,201,4.6,fe75c6c37e5a +21.938,201,8.5,fe75c6c37e5a +22.047,201,3.5,fe75c6c37e5a +22.155,201,5.7,ff81f93e8b0d +22.269,201,4.8,fe75c6c37e5a +22.377,201,4.3,ff81f93e8b0d +22.491,201,3.2,fe75c6c37e5a +22.597,201,4.0,ff81f93e8b0d +22.71,201,4.2,fe75c6c37e5a +22.821,201,5.7,fe75c6c37e5a +22.934,201,10.9,fe75c6c37e5a +23.046,201,10.4,ff81f93e8b0d +23.166,201,6.9,ff81f93e8b0d +23.278,201,3.6,fe75c6c37e5a +23.389,201,6.7,fe75c6c37e5a +23.505,201,5.5,fe75c6c37e5a +23.613,201,4.9,fe75c6c37e5a +23.72,201,10.4,fe75c6c37e5a +23.832,201,3.7,fe75c6c37e5a +23.946,201,5.6,ff81f93e8b0d +24.06,201,3.5,ff81f93e8b0d +24.172,201,5.9,ff81f93e8b0d +24.282,201,3.8,ff81f93e8b0d +24.391,201,4.4,ff81f93e8b0d +24.497,201,4.2,ff81f93e8b0d +24.61,201,5.1,ff81f93e8b0d +24.722,201,6.9,ff81f93e8b0d +24.838,201,7.2,fe75c6c37e5a +24.947,201,5.4,fe75c6c37e5a +25.06,201,4.3,fe75c6c37e5a +25.172,201,6.2,fe75c6c37e5a +25.285,201,3.8,fe75c6c37e5a +25.39,201,6.5,fe75c6c37e5a +25.502,201,5.1,fe75c6c37e5a +25.614,201,3.7,fe75c6c37e5a +25.728,201,4.7,ff81f93e8b0d +25.833,201,5.0,fe75c6c37e5a +25.943,201,4.8,fe75c6c37e5a +26.049,201,5.0,fe75c6c37e5a +26.162,201,3.7,fe75c6c37e5a +26.269,201,3.7,fe75c6c37e5a +26.377,201,3.9,fe75c6c37e5a +26.488,201,6.4,fe75c6c37e5a +26.595,201,4.6,ff81f93e8b0d +26.71,201,7.1,fe75c6c37e5a +26.825,201,6.5,ff81f93e8b0d +26.934,201,4.0,fe75c6c37e5a +27.041,201,4.7,fe75c6c37e5a +27.152,201,5.7,fe75c6c37e5a +27.259,201,4.6,fe75c6c37e5a +27.371,201,3.3,fe75c6c37e5a +27.478,201,4.0,fe75c6c37e5a +27.584,201,4.8,ff81f93e8b0d +27.691,201,5.0,ff81f93e8b0d +27.796,201,5.0,ff81f93e8b0d +27.903,201,6.3,fe75c6c37e5a +28.016,201,4.7,ff81f93e8b0d +28.122,201,3.9,fe75c6c37e5a +28.234,201,3.8,fe75c6c37e5a +28.348,201,4.8,ff81f93e8b0d +28.462,201,5.1,ff81f93e8b0d +28.575,201,5.4,ff81f93e8b0d +28.69,201,3.6,fe75c6c37e5a +28.803,201,3.8,fe75c6c37e5a +28.915,201,2.7,fe75c6c37e5a +29.022,201,2.7,fe75c6c37e5a +29.132,201,3.1,fe75c6c37e5a +29.24,201,4.1,fe75c6c37e5a +29.345,201,5.4,ff81f93e8b0d +29.452,201,4.4,ff81f93e8b0d +29.564,201,4.4,ff81f93e8b0d +29.677,201,4.7,fe75c6c37e5a +29.783,201,3.1,ff81f93e8b0d +29.896,201,3.0,ff81f93e8b0d +30.008,201,3.7,fe75c6c37e5a +30.122,201,3.9,fe75c6c37e5a +30.232,201,4.8,fe75c6c37e5a +30.339,201,4.1,fe75c6c37e5a +30.452,201,4.5,fe75c6c37e5a +30.563,201,3.8,fe75c6c37e5a +30.67,201,2.8,fe75c6c37e5a +30.777,201,5.9,fe75c6c37e5a +30.886,201,5.9,fe75c6c37e5a +30.994,201,5.0,ff81f93e8b0d +31.102,201,3.3,ff81f93e8b0d +31.21,201,4.0,ff81f93e8b0d +31.322,201,6.4,ff81f93e8b0d +31.433,201,31.4,fe75c6c37e5a +31.566,201,4.3,ff81f93e8b0d +31.679,201,8.0,fe75c6c37e5a +31.798,201,3.8,ff81f93e8b0d +31.909,201,5.1,ff81f93e8b0d +32.019,201,3.6,ff81f93e8b0d +32.126,201,5.0,fe75c6c37e5a +32.24,201,6.7,ff81f93e8b0d +32.356,201,5.7,fe75c6c37e5a +32.469,201,6.4,fe75c6c37e5a +32.577,201,4.1,ff81f93e8b0d +32.684,201,3.5,ff81f93e8b0d +32.789,201,7.0,ff81f93e8b0d +32.899,201,5.3,ff81f93e8b0d +33.012,201,5.0,ff81f93e8b0d +33.126,201,3.9,ff81f93e8b0d +33.237,201,8.1,fe75c6c37e5a +33.349,201,4.8,fe75c6c37e5a +33.464,201,3.7,fe75c6c37e5a +33.571,201,4.4,fe75c6c37e5a +33.68,201,4.1,fe75c6c37e5a +33.791,201,5.0,fe75c6c37e5a +33.898,201,4.9,fe75c6c37e5a +34.013,201,4.1,fe75c6c37e5a +34.127,201,4.2,fe75c6c37e5a +34.234,201,4.9,fe75c6c37e5a +34.343,201,4.0,fe75c6c37e5a +34.454,201,4.9,fe75c6c37e5a +34.566,201,4.9,fe75c6c37e5a +34.679,201,3.6,ff81f93e8b0d +34.787,201,5.5,ff81f93e8b0d +34.896,201,5.1,fe75c6c37e5a +35.011,201,5.3,ff81f93e8b0d +35.122,201,6.6,ff81f93e8b0d +35.235,201,3.9,ff81f93e8b0d +35.349,201,3.8,fe75c6c37e5a +35.462,201,3.0,fe75c6c37e5a +35.575,201,3.8,fe75c6c37e5a +35.689,201,10.8,ff81f93e8b0d +35.807,201,5.1,fe75c6c37e5a +35.912,201,4.2,ff81f93e8b0d +36.02,201,8.2,ff81f93e8b0d +36.133,201,4.1,ff81f93e8b0d +36.247,201,4.1,fe75c6c37e5a +36.355,201,6.2,ff81f93e8b0d +36.465,201,3.0,ff81f93e8b0d +36.574,201,9.7,fe75c6c37e5a +36.688,201,8.0,fe75c6c37e5a +36.806,201,7.5,ff81f93e8b0d +36.92,201,6.5,ff81f93e8b0d +37.03,201,5.9,ff81f93e8b0d +37.146,201,4.6,ff81f93e8b0d +37.253,201,5.6,ff81f93e8b0d +37.366,201,3.0,ff81f93e8b0d +37.472,201,5.2,ff81f93e8b0d +37.581,201,5.0,ff81f93e8b0d +37.695,201,5.6,ff81f93e8b0d +37.802,201,6.3,ff81f93e8b0d +37.913,201,4.5,ff81f93e8b0d +38.026,201,3.6,ff81f93e8b0d +38.132,201,4.5,ff81f93e8b0d +38.238,201,4.4,ff81f93e8b0d +38.343,201,3.2,fe75c6c37e5a +38.453,201,4.6,fe75c6c37e5a +38.561,201,4.8,fe75c6c37e5a +38.667,201,4.7,fe75c6c37e5a +38.78,201,4.3,fe75c6c37e5a +38.885,201,4.6,ff81f93e8b0d +38.997,201,4.4,fe75c6c37e5a +39.108,201,4.0,fe75c6c37e5a +39.219,201,3.8,fe75c6c37e5a +39.326,201,3.8,ff81f93e8b0d +39.436,201,4.5,fe75c6c37e5a +39.545,201,4.4,ff81f93e8b0d +39.653,201,3.7,ff81f93e8b0d +39.758,201,4.2,ff81f93e8b0d +39.872,201,6.1,ff81f93e8b0d +39.988,201,5.5,fe75c6c37e5a +40.096,201,5.1,ff81f93e8b0d +40.21,201,7.3,fe75c6c37e5a +40.32,201,5.7,fe75c6c37e5a +40.428,201,4.6,fe75c6c37e5a +40.536,201,4.1,ff81f93e8b0d +40.646,201,4.2,ff81f93e8b0d +40.756,201,6.5,fe75c6c37e5a +40.869,201,4.4,fe75c6c37e5a +40.98,201,4.4,fe75c6c37e5a +41.093,201,4.3,fe75c6c37e5a +41.204,201,3.3,fe75c6c37e5a +41.309,201,6.1,fe75c6c37e5a +41.416,201,4.9,fe75c6c37e5a +41.529,201,5.6,fe75c6c37e5a +41.641,201,4.8,fe75c6c37e5a +41.747,201,5.8,fe75c6c37e5a +41.863,201,18.6,fe75c6c37e5a +41.992,201,5.2,fe75c6c37e5a +42.104,201,6.8,fe75c6c37e5a +42.221,201,5.9,ff81f93e8b0d +42.331,201,5.3,ff81f93e8b0d +42.444,201,4.3,ff81f93e8b0d +42.551,201,4.8,ff81f93e8b0d +42.664,201,4.8,ff81f93e8b0d +42.769,201,4.3,ff81f93e8b0d +42.876,201,4.0,fe75c6c37e5a +42.988,201,7.2,ff81f93e8b0d +43.098,201,3.6,fe75c6c37e5a +43.211,201,4.7,ff81f93e8b0d +43.317,201,4.7,ff81f93e8b0d +43.43,201,4.6,ff81f93e8b0d +43.542,201,3.9,ff81f93e8b0d +43.655,201,6.3,fe75c6c37e5a +43.769,201,4.7,fe75c6c37e5a +43.879,201,14.6,ff81f93e8b0d +44.001,201,4.4,ff81f93e8b0d +44.112,201,4.8,ff81f93e8b0d +44.225,201,4.6,ff81f93e8b0d +44.34,201,6.7,fe75c6c37e5a +44.451,201,6.0,fe75c6c37e5a +44.561,201,5.1,fe75c6c37e5a +44.672,201,6.5,fe75c6c37e5a +44.782,201,3.5,fe75c6c37e5a +44.893,201,3.4,fe75c6c37e5a +45.006,201,6.0,fe75c6c37e5a +45.112,201,6.0,ff81f93e8b0d +45.226,201,6.8,fe75c6c37e5a +45.339,201,11.3,ff81f93e8b0d +45.459,201,5.7,fe75c6c37e5a diff --git a/evidence/failover-each/fa81adafcb69/result.json b/evidence/failover-each/fe75c6c37e5a/result.json similarity index 66% rename from evidence/failover-each/fa81adafcb69/result.json rename to evidence/failover-each/fe75c6c37e5a/result.json index a4488368..0b2b0034 100644 --- a/evidence/failover-each/fa81adafcb69/result.json +++ b/evidence/failover-each/fe75c6c37e5a/result.json @@ -1,32 +1,32 @@ { - "label": "fa81adafcb69", + "label": "fe75c6c37e5a", "action": [ "sh", "-c", - "scripts/stop-one.sh && docker compose ps -a --format '{{.ID}} {{.Service}} {{.Status}}' api && sleep 10 && scripts/restore.sh" + "scripts/stop-one.sh && docker compose ps -a --format '{{.ID}} {{.Service}} {{.Status}}' api && { scripts/stand-usage.sh & sleep 10; wait; } && scripts/restore.sh" ], "action_exit": 0, - "action_seconds": 14.776, + "action_seconds": 14.56, "action_finished_before_load_end": true, "lb_up_before": 2, "lb_up_min": 1, - "detection_seconds": 1.065, - "rejoin_seconds": 14.587, + "detection_seconds": 0.859, + "rejoin_seconds": 14.343, "probe": { - "attempts": 655, + "attempts": 646, "failed_attempts": 0, "first_failure_s": null, "recovery_s": 0.0, "instances_before": { - "fa81adafcb69": 113, - "286766bf2b32": 125 + "fe75c6c37e5a": 130, + "ff81f93e8b0d": 105 }, "instances_during_outage": { - "286766bf2b32": 123 + "ff81f93e8b0d": 121 }, "instances_after": { - "286766bf2b32": 148, - "fa81adafcb69": 134 + "ff81f93e8b0d": 123, + "fe75c6c37e5a": 156 } }, "lb_counters": { @@ -42,9 +42,9 @@ "ok_rps": 100.02, "failed_ratio": 0, "dropped_iterations": 0, - "p50_ms": 2.1, - "p95_ms": 6.46, - "p99_ms": 14.16, + "p50_ms": 1.57, + "p95_ms": 3.62, + "p99_ms": 6.24, "exit": 0, "rate": 100 }, diff --git a/evidence/failover-each/ff81f93e8b0d/action.txt b/evidence/failover-each/ff81f93e8b0d/action.txt new file mode 100644 index 00000000..e5e33782 --- /dev/null +++ b/evidence/failover-each/ff81f93e8b0d/action.txt @@ -0,0 +1,14 @@ +ff81f93e8b0d api Exited (0) Less than a second ago +fe75c6c37e5a api Up About a minute (healthy) +02:48:39 database bytes,messages: 9672371,2759 +mtusi2026lab3-api-2 cpu=12.79% mem=125.6MiB / 512MiB +mtusi2026lab3-lb-1 cpu=3.32% mem=19.51MiB / 128MiB +mtusi2026lab3-postgres-1 cpu=4.32% mem=54.65MiB / 1GiB +mtusi2026lab3-valkey-1 cpu=1.20% mem=13.09MiB / 128MiB + Container mtusi2026lab3-api-2 Running + Container mtusi2026lab3-api-1 Starting + Container mtusi2026lab3-api-1 Started + Container mtusi2026lab3-api-1 Waiting + Container mtusi2026lab3-api-2 Waiting + Container mtusi2026lab3-api-1 Healthy + Container mtusi2026lab3-api-2 Healthy diff --git a/evidence/failover-each/ff81f93e8b0d/k6/k6.txt b/evidence/failover-each/ff81f93e8b0d/k6/k6.txt new file mode 100644 index 00000000..5d53c98a --- /dev/null +++ b/evidence/failover-each/ff81f93e8b0d/k6/k6.txt @@ -0,0 +1,2 @@ +time="2026-10-30T02:48:11Z" level=info msg=LOAD-START source=console +measure: 6001 requests, failed ratio 0 diff --git a/evidence/failover-each/286766bf2b32/k6/summary.json b/evidence/failover-each/ff81f93e8b0d/k6/summary.json similarity index 54% rename from evidence/failover-each/286766bf2b32/k6/summary.json rename to evidence/failover-each/ff81f93e8b0d/k6/summary.json index 73718a79..c813e862 100644 --- a/evidence/failover-each/286766bf2b32/k6/summary.json +++ b/evidence/failover-each/ff81f93e8b0d/k6/summary.json @@ -9,19 +9,21 @@ "name": "message 201", "path": "::message 201", "id": "6445aff337e1ade0bc10402fbac79882", - "passes": 5595, + "passes": 5647, "fails": 0 }, { - "name": "history 200", - "path": "::history 200", "id": "fe27b3b8edd292c7f2170a6357b087d0", - "passes": 1406, - "fails": 0 + "passes": 1355, + "fails": 0, + "name": "history 200", + "path": "::history 200" } ] }, "options": { + "summaryTimeUnit": "", + "noColor": false, "summaryTrendStats": [ "avg", "min", @@ -30,218 +32,204 @@ "p(95)", "p(99)", "max" - ], - "summaryTimeUnit": "", - "noColor": false + ] }, "state": { "isStdOutTTY": false, "isStdErrTTY": false, - "testRunDurationMs": 70604.007839 + "testRunDurationMs": 70525.755241 }, "metrics": { - "iterations": { - "type": "counter", - "contains": "default", - "values": { - "count": 7001, - "rate": 99.158676883677 - } - }, - "checks": { - "type": "rate", - "contains": "default", - "values": { - "rate": 1, - "passes": 7001, - "fails": 0 - } - }, - "http_req_duration{scenario:measure,name:get_history}": { - "type": "trend", - "contains": "time", - "values": { - "max": 25.061083, - "avg": 2.7268544019769383, - "min": 1.150167, - "med": 2.065792, - "p(90)": 4.5437706, - "p(95)": 6.454100100000001, - "p(99)": 11.404247329999999 - } - }, - "data_sent": { - "type": "counter", - "contains": "data", - "values": { - "count": 2050861, - "rate": 29047.37369409152 - } - }, - "dropped_iterations{scenario:measure}": { - "contains": "default", - "values": { - "count": 0, - "rate": 0 - }, - "type": "counter" - }, "http_req_duration{expected_response:true}": { - "type": "trend", "contains": "time", "values": { - "max": 75.03075, - "avg": 3.0178732642178376, - "min": 0.959875, - "med": 2.093625, - "p(90)": 5.073458, - "p(95)": 7.402916999999996, - "p(99)": 15.439604499999998 - } - }, - "http_req_blocked": { - "type": "trend", - "contains": "time", - "values": { - "max": 1.506917, - "avg": 0.004055044532690343, - "min": 0.000875, - "med": 0.002792, - "p(90)": 0.00475, - "p(95)": 0.005708, - "p(99)": 0.01006249999999997 - } - }, - "http_reqs{scenario:measure}": { - "values": { - "count": 6000, - "rate": 84.98101147008457 + "med": 1.566875, + "p(90)": 3.0046625000000007, + "p(95)": 3.926481399999998, + "p(99)": 9.87922391999999, + "max": 31.835458, + "avg": 1.9633167280204142, + "min": 0.883916 }, - "type": "counter", - "contains": "default" + "type": "trend" }, - "http_req_connecting": { - "type": "trend", - "contains": "time", + "http_req_waiting": { "values": { - "max": 0.293292, - "avg": 0.0005168768968940576, - "min": 0, - "med": 0, - "p(90)": 0, - "p(95)": 0, - "p(99)": 0 - } - }, - "http_req_duration{scenario:measure,name:post_message}": { + "p(99)": 9.739183839999988, + "max": 31.802583, + "avg": 1.921257879608627, + "min": 0.871708, + "med": 1.528979, + "p(90)": 2.9510836, + "p(95)": 3.8628975499999996 + }, "type": "trend", - "contains": "time", - "values": { - "avg": 2.8565231669452675, - "min": 0.959875, - "med": 2.0321664999999998, - "p(90)": 4.8346875, - "p(95)": 6.5679479999999995, - "p(99)": 15.178241949999997, - "max": 54.672875 - } + "contains": "time" }, "http_reqs": { "type": "counter", "contains": "default", "values": { - "count": 7051, - "rate": 99.86685197926104 + "count": 7052, + "rate": 99.9918395187966 + } + }, + "http_req_receiving": { + "values": { + "med": 0.023791, + "p(90)": 0.042791, + "p(95)": 0.05251479999999996, + "p(99)": 0.08951307999999995, + "max": 1.60625, + "avg": 0.027876955757232046, + "min": 0.003375 + }, + "type": "trend", + "contains": "time" + }, + "http_req_connecting": { + "type": "trend", + "contains": "time", + "values": { + "avg": 0.0004884490924560408, + "min": 0, + "med": 0, + "p(90)": 0, + "p(95)": 0, + "p(99)": 0, + "max": 0.33575 + } + }, + "http_req_failed": { + "type": "rate", + "contains": "default", + "values": { + "rate": 0, + "passes": 0, + "fails": 7052 } }, "http_req_tls_handshaking": { "type": "trend", "contains": "time", "values": { - "p(95)": 0, - "p(99)": 0, - "max": 0, "avg": 0, "min": 0, "med": 0, - "p(90)": 0 + "p(90)": 0, + "p(95)": 0, + "p(99)": 0, + "max": 0 } }, - "http_req_waiting": { - "type": "trend", - "contains": "time", - "values": { - "p(90)": 4.998333, - "p(95)": 7.267228999999986, - "p(99)": 15.349603999999996, - "max": 74.98575, - "avg": 2.960073415402071, - "min": 0.931709, - "med": 2.037334 - } - }, - "data_received": { + "data_sent": { "type": "counter", "contains": "data", "values": { - "count": 17424756, - "rate": 246795.56491657082 + "count": 2057256, + "rate": 29170.279608775018 } }, - "dropped_iterations": { + "checks": { + "contains": "default", "values": { - "rate": 0, - "count": 0 + "rate": 1, + "passes": 7002, + "fails": 0 }, - "type": "counter", - "contains": "default" + "type": "rate" }, "http_req_sending": { - "values": { - "avg": 0.01855326762161392, - "min": 0.002833, - "med": 0.015583, - "p(90)": 0.023083, - "p(95)": 0.029833, - "p(99)": 0.07649999999999997, - "max": 1.973125 - }, - "type": "trend", - "contains": "time" - }, - "iteration_duration": { "type": "trend", "contains": "time", "values": { - "med": 2.221375, - "p(90)": 5.163417, - "p(95)": 7.156375, - "p(99)": 15.588167, - "max": 75.18325, - "avg": 3.0953851525496296, - "min": 1.017792 + "p(90)": 0.018375, + "p(95)": 0.023042, + "p(99)": 0.05424916, + "max": 1.320584, + "avg": 0.01418189265456617, + "min": 0.003084, + "med": 0.011792 } }, - "vus_max": { - "type": "gauge", + "http_reqs{scenario:measure}": { + "type": "counter", "contains": "default", "values": { - "value": 20, - "min": 20, - "max": 20 + "count": 6001, + "rate": 85.08948226776778 + } + }, + "dropped_iterations{scenario:measure}": { + "type": "counter", + "contains": "default", + "values": { + "count": 0, + "rate": 0 } }, "http_req_duration{scenario:measure}": { "type": "trend", "contains": "time", "values": { - "max": 54.672875, - "avg": 2.8302868534999988, - "min": 0.959875, - "med": 2.0370625, - "p(90)": 4.7776962, - "p(95)": 6.556693449999997, - "p(99)": 13.68157416 + "p(90)": 3.067875, + "p(95)": 3.922292, + "p(99)": 7.314708, + "max": 31.835458, + "avg": 1.9610305627395372, + "min": 0.883916, + "med": 1.595209 + } + }, + "http_req_blocked": { + "type": "trend", + "contains": "time", + "values": { + "p(90)": 0.003375, + "p(95)": 0.004125, + "p(99)": 0.006292, + "max": 0.932542, + "avg": 0.00281850311968237, + "min": 0.000708, + "med": 0.001875 + } + }, + "data_received": { + "type": "counter", + "contains": "data", + "values": { + "count": 16698312, + "rate": 236768.99230555806 + } + }, + "vus": { + "type": "gauge", + "contains": "default", + "values": { + "value": 1, + "min": 0, + "max": 1 + } + }, + "http_req_duration": { + "type": "trend", + "contains": "time", + "values": { + "med": 1.566875, + "p(90)": 3.0046625000000007, + "p(95)": 3.926481399999998, + "p(99)": 9.87922391999999, + "max": 31.835458, + "avg": 1.9633167280204142, + "min": 0.883916 + } + }, + "dropped_iterations": { + "type": "counter", + "contains": "default", + "values": { + "rate": 0, + "count": 0 } }, "http_req_failed{scenario:measure}": { @@ -250,60 +238,72 @@ "values": { "rate": 0, "passes": 0, - "fails": 6000 + "fails": 6001 } }, "iterations{scenario:measure}": { "type": "counter", "contains": "default", "values": { - "rate": 84.98101147008457, - "count": 6000 + "count": 6001, + "rate": 85.08948226776778 } }, - "vus": { + "iterations": { + "type": "counter", + "contains": "default", "values": { - "value": 1, - "min": 0, - "max": 1 - }, - "type": "gauge", - "contains": "default" + "rate": 99.28287866004166, + "count": 7002 + } }, - "http_req_receiving": { - "values": { - "max": 1.770083, - "avg": 0.03924658119415675, - "min": 0.005333, - "med": 0.033583, - "p(90)": 0.056792, - "p(95)": 0.072, - "p(99)": 0.13835399999999998 - }, - "type": "trend", - "contains": "time" - }, - "http_req_duration": { + "http_req_duration{scenario:measure,name:get_history}": { "type": "trend", "contains": "time", "values": { - "p(95)": 7.402916999999996, - "p(99)": 15.439604499999998, - "max": 75.03075, - "avg": 3.0178732642178376, - "min": 0.959875, - "med": 2.093625, - "p(90)": 5.073458 + "max": 19.542875, + "avg": 2.039735076521738, + "min": 1.055333, + "med": 1.6431455000000001, + "p(90)": 3.2530464, + "p(95)": 3.958685449999999, + "p(99)": 7.853225919999997 } }, - "http_req_failed": { + "vus_max": { + "contains": "default", "values": { - "rate": 0, - "passes": 0, - "fails": 7051 + "max": 20, + "value": 20, + "min": 20 }, - "type": "rate", - "contains": "default" + "type": "gauge" + }, + "http_req_duration{scenario:measure,name:post_message}": { + "type": "trend", + "contains": "time", + "values": { + "max": 31.835458, + "avg": 1.942372514739224, + "min": 0.883916, + "med": 1.582625, + "p(90)": 3.030458, + "p(95)": 3.9060624999999978, + "p(99)": 7.141624999999999 + } + }, + "iteration_duration": { + "contains": "time", + "values": { + "med": 1.6496255, + "p(90)": 3.0859256000000004, + "p(95)": 3.944686049999999, + "p(99)": 7.210350089999998, + "max": 31.969333, + "avg": 1.9984389771493831, + "min": 0.9315 + }, + "type": "trend" } } } \ No newline at end of file diff --git a/evidence/failover-each/ff81f93e8b0d/lb_up.csv b/evidence/failover-each/ff81f93e8b0d/lb_up.csv new file mode 100644 index 00000000..cdbf7e50 --- /dev/null +++ b/evidence/failover-each/ff81f93e8b0d/lb_up.csv @@ -0,0 +1,655 @@ +t_rel_s,up +-25.788,2 +-25.681,2 +-25.575,2 +-25.464,2 +-25.351,2 +-25.244,2 +-25.139,2 +-25.026,2 +-24.911,2 +-24.8,2 +-24.687,2 +-24.584,2 +-24.47,2 +-24.363,2 +-24.251,2 +-24.145,2 +-24.036,2 +-23.924,2 +-23.811,2 +-23.697,2 +-23.587,2 +-23.482,2 +-23.37,2 +-23.258,2 +-23.146,2 +-23.04,2 +-22.928,2 +-22.818,2 +-22.712,2 +-22.604,2 +-22.495,2 +-22.386,2 +-22.283,2 +-22.174,2 +-22.063,2 +-21.95,2 +-21.84,2 +-21.727,2 +-21.619,2 +-21.507,2 +-21.394,2 +-21.279,2 +-21.166,2 +-21.055,2 +-20.942,2 +-20.831,2 +-20.719,2 +-20.61,2 +-20.505,2 +-20.401,2 +-20.291,2 +-20.18,2 +-20.069,2 +-19.956,2 +-19.846,2 +-19.735,2 +-19.626,2 +-19.52,2 +-19.408,2 +-19.303,2 +-19.195,2 +-19.084,2 +-18.98,2 +-18.877,2 +-18.767,2 +-18.657,2 +-18.544,2 +-18.438,2 +-18.325,2 +-18.212,2 +-18.107,2 +-18.002,2 +-17.891,2 +-17.784,2 +-17.67,2 +-17.564,2 +-17.45,2 +-17.341,2 +-17.234,2 +-17.126,2 +-17.013,2 +-16.908,2 +-16.794,2 +-16.688,2 +-16.58,2 +-16.475,2 +-16.368,2 +-16.265,2 +-16.16,2 +-16.047,2 +-15.942,2 +-15.83,2 +-15.721,2 +-15.612,2 +-15.5,2 +-15.389,2 +-15.282,2 +-15.167,2 +-15.055,2 +-14.946,2 +-14.837,2 +-14.728,2 +-14.618,2 +-14.508,2 +-14.398,2 +-14.287,2 +-14.176,2 +-14.067,2 +-13.956,2 +-13.851,2 +-13.738,2 +-13.625,2 +-13.514,2 +-13.405,2 +-13.293,2 +-13.186,2 +-13.075,2 +-12.964,2 +-12.858,2 +-12.748,2 +-12.641,2 +-12.528,2 +-12.415,2 +-12.303,2 +-12.199,2 +-12.093,2 +-11.988,2 +-11.884,2 +-11.771,2 +-11.661,2 +-11.548,2 +-11.433,2 +-11.321,2 +-11.214,2 +-11.107,2 +-10.995,2 +-10.89,2 +-10.785,2 +-10.679,2 +-10.555,2 +-10.441,2 +-10.33,2 +-10.224,2 +-10.114,2 +-10.005,2 +-9.892,2 +-9.78,2 +-9.664,2 +-9.555,2 +-9.442,2 +-9.331,2 +-9.214,2 +-9.105,2 +-8.992,2 +-8.889,2 +-8.777,2 +-8.668,2 +-8.558,2 +-8.446,2 +-8.339,2 +-8.229,2 +-8.122,2 +-8.014,2 +-7.908,2 +-7.798,2 +-7.684,2 +-7.57,2 +-7.464,2 +-7.351,2 +-7.242,2 +-7.129,2 +-7.016,2 +-6.904,2 +-6.799,2 +-6.695,2 +-6.579,2 +-6.474,2 +-6.365,2 +-6.259,2 +-6.15,2 +-6.043,2 +-5.932,2 +-5.818,2 +-5.706,2 +-5.6,2 +-5.488,2 +-5.381,2 +-5.276,2 +-5.172,2 +-5.063,2 +-4.953,2 +-4.841,2 +-4.734,2 +-4.628,2 +-4.519,2 +-4.407,2 +-4.293,2 +-4.182,2 +-4.073,2 +-3.963,2 +-3.852,2 +-3.738,2 +-3.634,2 +-3.525,2 +-3.414,2 +-3.301,2 +-3.189,2 +-3.082,2 +-2.971,2 +-2.863,2 +-2.759,2 +-2.649,2 +-2.539,2 +-2.43,2 +-2.315,2 +-2.208,2 +-2.097,2 +-1.987,2 +-1.873,2 +-1.764,2 +-1.656,2 +-1.547,2 +-1.445,2 +-1.329,2 +-1.217,2 +-1.109,2 +-0.995,2 +-0.884,2 +-0.773,2 +-0.661,2 +-0.554,2 +-0.443,2 +-0.329,2 +-0.219,2 +-0.109,2 +-0.0,2 +0.115,2 +0.224,2 +0.331,2 +0.439,2 +0.545,2 +0.651,2 +0.755,2 +0.866,2 +0.975,2 +1.082,2 +1.189,2 +1.296,2 +1.405,1 +1.516,1 +1.621,1 +1.726,1 +1.836,1 +1.948,1 +2.059,1 +2.17,1 +2.284,1 +2.396,1 +2.508,1 +2.62,1 +2.734,1 +2.842,1 +2.954,1 +3.057,1 +3.17,1 +3.281,1 +3.39,1 +3.5,1 +3.61,1 +3.717,1 +3.83,1 +3.94,1 +4.05,1 +4.16,1 +4.271,1 +4.375,1 +4.48,1 +4.594,1 +4.7,1 +4.812,1 +4.918,1 +5.03,1 +5.141,1 +5.251,1 +5.364,1 +5.474,1 +5.587,1 +5.695,1 +5.805,1 +5.909,1 +6.014,1 +6.12,1 +6.23,1 +6.344,1 +6.455,1 +6.568,1 +6.674,1 +6.787,1 +6.893,1 +6.996,1 +7.103,1 +7.212,1 +7.322,1 +7.431,1 +7.543,1 +7.651,1 +7.762,1 +7.872,1 +7.983,1 +8.096,1 +8.206,1 +8.315,1 +8.43,1 +8.536,1 +8.644,1 +8.75,1 +8.861,1 +8.973,1 +9.086,1 +9.196,1 +9.307,1 +9.413,1 +9.527,1 +9.631,1 +9.738,1 +9.85,1 +9.954,1 +10.059,1 +10.172,1 +10.283,1 +10.395,1 +10.504,1 +10.616,1 +10.724,1 +10.832,1 +10.945,1 +11.05,1 +11.159,1 +11.265,1 +11.368,1 +11.472,1 +11.576,1 +11.682,1 +11.793,1 +11.898,1 +12.01,1 +12.123,1 +12.23,1 +12.343,1 +12.452,1 +12.559,1 +12.665,1 +12.774,1 +12.887,1 +12.995,1 +13.103,1 +13.211,1 +13.326,1 +13.431,1 +13.535,1 +13.648,1 +13.753,1 +13.865,1 +13.974,1 +14.085,1 +14.188,1 +14.291,1 +14.395,1 +14.506,1 +14.619,1 +14.727,1 +14.834,2 +14.942,2 +15.054,2 +15.166,2 +15.273,2 +15.398,2 +15.51,2 +15.623,2 +15.737,2 +15.843,2 +15.954,2 +16.065,2 +16.172,2 +16.279,2 +16.382,2 +16.496,2 +16.605,2 +16.708,2 +16.819,2 +16.93,2 +17.038,2 +17.144,2 +17.25,2 +17.361,2 +17.473,2 +17.576,2 +17.684,2 +17.794,2 +17.906,2 +18.021,2 +18.123,2 +18.23,2 +18.337,2 +18.44,2 +18.55,2 +18.654,2 +18.767,2 +18.878,2 +18.987,2 +19.091,2 +19.2,2 +19.307,2 +19.422,2 +19.526,2 +19.636,2 +19.741,2 +19.847,2 +19.959,2 +20.068,2 +20.173,2 +20.285,2 +20.388,2 +20.493,2 +20.602,2 +20.714,2 +20.824,2 +20.93,2 +21.036,2 +21.139,2 +21.251,2 +21.354,2 +21.465,2 +21.575,2 +21.678,2 +21.781,2 +21.886,2 +21.995,2 +22.101,2 +22.206,2 +22.315,2 +22.421,2 +22.526,2 +22.637,2 +22.741,2 +22.856,2 +22.959,2 +23.063,2 +23.174,2 +23.288,2 +23.393,2 +23.5,2 +23.613,2 +23.721,2 +23.831,2 +23.935,2 +24.047,2 +24.155,2 +24.266,2 +24.376,2 +24.483,2 +24.596,2 +24.703,2 +24.816,2 +24.927,2 +25.036,2 +25.147,2 +25.253,2 +25.356,2 +25.464,2 +25.57,2 +25.677,2 +25.789,2 +25.901,2 +26.006,2 +26.113,2 +26.224,2 +26.334,2 +26.446,2 +26.553,2 +26.656,2 +26.759,2 +26.866,2 +26.972,2 +27.078,2 +27.191,2 +27.295,2 +27.405,2 +27.517,2 +27.626,2 +27.734,2 +27.846,2 +27.958,2 +28.069,2 +28.18,2 +28.288,2 +28.395,2 +28.504,2 +28.614,2 +28.724,2 +28.835,2 +28.94,2 +29.051,2 +29.162,2 +29.274,2 +29.392,2 +29.502,2 +29.605,2 +29.713,2 +29.818,2 +29.931,2 +30.042,2 +30.154,2 +30.26,2 +30.367,2 +30.475,2 +30.582,2 +30.69,2 +30.797,2 +30.91,2 +31.016,2 +31.131,2 +31.238,2 +31.351,2 +31.455,2 +31.569,2 +31.678,2 +31.79,2 +31.899,2 +32.01,2 +32.116,2 +32.22,2 +32.324,2 +32.436,2 +32.539,2 +32.642,2 +32.756,2 +32.866,2 +32.978,2 +33.09,2 +33.202,2 +33.312,2 +33.421,2 +33.53,2 +33.639,2 +33.743,2 +33.848,2 +33.959,2 +34.073,2 +34.184,2 +34.29,2 +34.398,2 +34.503,2 +34.614,2 +34.718,2 +34.825,2 +34.938,2 +35.045,2 +35.159,2 +35.265,2 +35.378,2 +35.485,2 +35.591,2 +35.693,2 +35.797,2 +35.908,2 +36.01,2 +36.115,2 +36.218,2 +36.325,2 +36.436,2 +36.549,2 +36.657,2 +36.763,2 +36.872,2 +36.981,2 +37.089,2 +37.198,2 +37.311,2 +37.422,2 +37.526,2 +37.637,2 +37.745,2 +37.848,2 +37.958,2 +38.062,2 +38.164,2 +38.271,2 +38.378,2 +38.486,2 +38.601,2 +38.711,2 +38.822,2 +38.928,2 +39.032,2 +39.142,2 +39.255,2 +39.368,2 +39.475,2 +39.581,2 +39.691,2 +39.795,2 +39.906,2 +40.017,2 +40.123,2 +40.235,2 +40.342,2 +40.452,2 +40.556,2 +40.666,2 +40.776,2 +40.889,2 +41.001,2 +41.112,2 +41.223,2 +41.335,2 +41.441,2 +41.551,2 +41.664,2 +41.776,2 +41.885,2 +41.999,2 +42.105,2 +42.219,2 +42.329,2 +42.44,2 +42.549,2 +42.657,2 +42.762,2 +42.874,2 +42.978,2 +43.087,2 +43.19,2 +43.303,2 +43.406,2 +43.517,2 +43.625,2 +43.734,2 +43.841,2 +43.954,2 +44.067,2 +44.171,2 +44.275,2 +44.38,2 +44.487,2 +44.593,2 +44.704,2 +44.807,2 +44.919,2 +45.032,2 +45.136,2 +45.243,2 +45.352,2 +45.458,2 diff --git a/evidence/failover-each/ff81f93e8b0d/probe.csv b/evidence/failover-each/ff81f93e8b0d/probe.csv new file mode 100644 index 00000000..b15ea058 --- /dev/null +++ b/evidence/failover-each/ff81f93e8b0d/probe.csv @@ -0,0 +1,647 @@ +t_rel_s,status,latency_ms,instance +-25.788,201,19.6,ff81f93e8b0d +-25.668,201,5.5,fe75c6c37e5a +-25.561,201,15.1,ff81f93e8b0d +-25.441,201,5.8,fe75c6c37e5a +-25.326,201,4.4,fe75c6c37e5a +-25.217,201,3.8,fe75c6c37e5a +-25.104,201,3.9,ff81f93e8b0d +-24.997,201,3.6,fe75c6c37e5a +-24.884,201,5.8,fe75c6c37e5a +-24.768,201,5.7,ff81f93e8b0d +-24.655,201,3.6,ff81f93e8b0d +-24.542,201,5.1,ff81f93e8b0d +-24.436,201,4.9,ff81f93e8b0d +-24.33,201,3.5,ff81f93e8b0d +-24.218,201,5.3,ff81f93e8b0d +-24.105,201,5.0,ff81f93e8b0d +-23.99,201,6.1,fe75c6c37e5a +-23.884,201,4.6,ff81f93e8b0d +-23.775,201,4.7,ff81f93e8b0d +-23.666,201,4.2,ff81f93e8b0d +-23.554,201,3.3,ff81f93e8b0d +-23.441,201,4.6,ff81f93e8b0d +-23.333,201,3.5,ff81f93e8b0d +-23.22,201,4.9,fe75c6c37e5a +-23.11,201,4.8,fe75c6c37e5a +-23.004,201,4.1,ff81f93e8b0d +-22.899,201,4.4,ff81f93e8b0d +-22.788,201,5.7,ff81f93e8b0d +-22.673,201,3.8,ff81f93e8b0d +-22.559,201,4.9,fe75c6c37e5a +-22.447,201,3.0,fe75c6c37e5a +-22.339,201,4.0,fe75c6c37e5a +-22.234,201,4.5,ff81f93e8b0d +-22.122,201,6.1,fe75c6c37e5a +-22.013,201,4.3,ff81f93e8b0d +-21.907,201,3.5,ff81f93e8b0d +-21.795,201,5.8,ff81f93e8b0d +-21.68,201,5.4,fe75c6c37e5a +-21.574,201,3.8,ff81f93e8b0d +-21.462,201,5.4,ff81f93e8b0d +-21.354,201,4.7,ff81f93e8b0d +-21.241,201,5.2,ff81f93e8b0d +-21.128,201,4.4,fe75c6c37e5a +-21.015,201,5.1,fe75c6c37e5a +-20.908,201,4.2,fe75c6c37e5a +-20.794,201,3.3,fe75c6c37e5a +-20.685,201,4.4,fe75c6c37e5a +-20.571,201,3.1,fe75c6c37e5a +-20.459,201,4.1,ff81f93e8b0d +-20.351,201,4.6,fe75c6c37e5a +-20.239,201,5.1,ff81f93e8b0d +-20.128,201,4.2,ff81f93e8b0d +-20.018,201,3.7,ff81f93e8b0d +-19.904,201,5.5,ff81f93e8b0d +-19.794,201,3.4,ff81f93e8b0d +-19.683,201,4.9,ff81f93e8b0d +-19.576,201,4.4,ff81f93e8b0d +-19.467,201,4.5,ff81f93e8b0d +-19.362,201,4.6,fe75c6c37e5a +-19.25,201,5.3,fe75c6c37e5a +-19.139,201,3.6,ff81f93e8b0d +-19.027,201,3.3,ff81f93e8b0d +-18.914,201,4.6,ff81f93e8b0d +-18.802,201,5.7,ff81f93e8b0d +-18.692,201,4.5,ff81f93e8b0d +-18.578,201,4.5,fe75c6c37e5a +-18.471,201,5.3,fe75c6c37e5a +-18.36,201,3.3,fe75c6c37e5a +-18.252,201,3.7,ff81f93e8b0d +-18.148,201,3.9,ff81f93e8b0d +-18.036,201,4.5,ff81f93e8b0d +-17.924,201,5.9,ff81f93e8b0d +-17.815,201,6.3,ff81f93e8b0d +-17.7,201,5.9,fe75c6c37e5a +-17.591,201,4.3,fe75c6c37e5a +-17.477,201,3.4,fe75c6c37e5a +-17.373,201,3.0,ff81f93e8b0d +-17.264,201,5.0,ff81f93e8b0d +-17.149,201,5.1,fe75c6c37e5a +-17.034,201,4.9,fe75c6c37e5a +-16.924,201,4.6,fe75c6c37e5a +-16.816,201,4.2,fe75c6c37e5a +-16.706,201,3.8,fe75c6c37e5a +-16.597,201,3.5,fe75c6c37e5a +-16.484,201,3.3,fe75c6c37e5a +-16.376,201,4.1,fe75c6c37e5a +-16.267,201,6.1,fe75c6c37e5a +-16.159,201,4.4,fe75c6c37e5a +-16.048,201,5.2,fe75c6c37e5a +-15.933,201,3.7,fe75c6c37e5a +-15.821,201,3.8,fe75c6c37e5a +-15.707,201,2.7,ff81f93e8b0d +-15.599,201,2.6,ff81f93e8b0d +-15.488,201,4.0,ff81f93e8b0d +-15.384,201,3.9,fe75c6c37e5a +-15.275,201,3.9,fe75c6c37e5a +-15.161,201,3.2,fe75c6c37e5a +-15.051,201,3.4,fe75c6c37e5a +-14.938,201,4.0,fe75c6c37e5a +-14.828,201,2.7,fe75c6c37e5a +-14.725,201,2.6,ff81f93e8b0d +-14.616,201,3.7,ff81f93e8b0d +-14.509,201,4.0,fe75c6c37e5a +-14.403,201,5.0,fe75c6c37e5a +-14.294,201,5.5,fe75c6c37e5a +-14.178,201,4.8,ff81f93e8b0d +-14.063,201,4.1,ff81f93e8b0d +-13.955,201,4.3,ff81f93e8b0d +-13.851,201,4.0,fe75c6c37e5a +-13.738,201,5.9,ff81f93e8b0d +-13.629,201,4.7,ff81f93e8b0d +-13.514,201,6.7,ff81f93e8b0d +-13.407,201,5.9,ff81f93e8b0d +-13.295,201,5.7,ff81f93e8b0d +-13.185,201,4.0,ff81f93e8b0d +-13.071,201,2.9,ff81f93e8b0d +-12.967,201,3.5,ff81f93e8b0d +-12.855,201,4.8,ff81f93e8b0d +-12.746,201,4.7,ff81f93e8b0d +-12.637,201,4.3,ff81f93e8b0d +-12.524,201,5.0,ff81f93e8b0d +-12.411,201,3.5,ff81f93e8b0d +-12.304,201,4.5,ff81f93e8b0d +-12.199,201,5.4,ff81f93e8b0d +-12.093,201,4.6,fe75c6c37e5a +-11.978,201,3.1,ff81f93e8b0d +-11.866,201,4.7,ff81f93e8b0d +-11.752,201,5.2,fe75c6c37e5a +-11.636,201,5.0,fe75c6c37e5a +-11.525,201,4.5,fe75c6c37e5a +-11.411,201,7.4,ff81f93e8b0d +-11.297,201,3.8,ff81f93e8b0d +-11.192,201,2.9,fe75c6c37e5a +-11.081,201,4.8,fe75c6c37e5a +-10.968,201,4.3,ff81f93e8b0d +-10.862,201,3.8,fe75c6c37e5a +-10.75,201,5.0,fe75c6c37e5a +-10.644,201,3.9,fe75c6c37e5a +-10.534,201,8.5,ff81f93e8b0d +-10.419,201,4.9,ff81f93e8b0d +-10.304,201,6.5,ff81f93e8b0d +-10.196,201,3.8,ff81f93e8b0d +-10.086,201,4.0,ff81f93e8b0d +-9.98,201,14.6,ff81f93e8b0d +-9.857,201,10.9,fe75c6c37e5a +-9.741,201,10.3,fe75c6c37e5a +-9.627,201,6.2,ff81f93e8b0d +-9.514,201,8.7,ff81f93e8b0d +-9.4,201,5.0,ff81f93e8b0d +-9.286,201,4.9,fe75c6c37e5a +-9.172,201,4.6,fe75c6c37e5a +-9.06,201,6.8,fe75c6c37e5a +-8.952,201,6.2,fe75c6c37e5a +-8.843,201,7.5,fe75c6c37e5a +-8.729,201,6.0,fe75c6c37e5a +-8.615,201,9.7,ff81f93e8b0d +-8.496,201,8.2,fe75c6c37e5a +-8.382,201,11.3,fe75c6c37e5a +-8.263,201,5.0,ff81f93e8b0d +-8.157,201,5.3,ff81f93e8b0d +-8.048,201,6.2,ff81f93e8b0d +-7.936,201,5.7,ff81f93e8b0d +-7.824,201,8.2,ff81f93e8b0d +-7.707,201,6.9,fe75c6c37e5a +-7.593,201,6.7,fe75c6c37e5a +-7.482,201,4.9,fe75c6c37e5a +-7.373,201,5.1,fe75c6c37e5a +-7.26,201,12.5,ff81f93e8b0d +-7.144,201,8.6,fe75c6c37e5a +-7.027,201,8.1,fe75c6c37e5a +-6.918,201,5.2,fe75c6c37e5a +-6.806,201,6.4,fe75c6c37e5a +-6.699,201,5.1,fe75c6c37e5a +-6.583,201,4.1,fe75c6c37e5a +-6.474,201,5.0,fe75c6c37e5a +-6.364,201,3.3,fe75c6c37e5a +-6.259,201,4.7,fe75c6c37e5a +-6.152,201,9.2,fe75c6c37e5a +-6.034,201,4.7,fe75c6c37e5a +-5.92,201,8.7,ff81f93e8b0d +-5.806,201,4.8,ff81f93e8b0d +-5.699,201,5.2,fe75c6c37e5a +-5.591,201,4.2,fe75c6c37e5a +-5.481,201,3.3,fe75c6c37e5a +-5.371,201,3.5,fe75c6c37e5a +-5.258,201,7.0,ff81f93e8b0d +-5.142,201,7.8,ff81f93e8b0d +-5.026,201,5.2,fe75c6c37e5a +-4.92,201,5.1,fe75c6c37e5a +-4.804,201,4.2,fe75c6c37e5a +-4.692,201,5.1,fe75c6c37e5a +-4.586,201,3.6,fe75c6c37e5a +-4.478,201,5.5,fe75c6c37e5a +-4.366,201,6.3,fe75c6c37e5a +-4.256,201,4.2,fe75c6c37e5a +-4.146,201,9.5,fe75c6c37e5a +-4.028,201,6.7,ff81f93e8b0d +-3.913,201,5.2,ff81f93e8b0d +-3.8,201,6.4,fe75c6c37e5a +-3.69,201,5.3,fe75c6c37e5a +-3.574,201,4.6,fe75c6c37e5a +-3.464,201,3.3,fe75c6c37e5a +-3.355,201,3.7,fe75c6c37e5a +-3.243,201,7.0,fe75c6c37e5a +-3.13,201,5.2,fe75c6c37e5a +-3.02,201,5.5,fe75c6c37e5a +-2.908,201,5.6,ff81f93e8b0d +-2.803,201,5.7,fe75c6c37e5a +-2.687,201,3.8,ff81f93e8b0d +-2.58,201,4.9,ff81f93e8b0d +-2.471,201,5.7,ff81f93e8b0d +-2.356,201,4.9,ff81f93e8b0d +-2.251,201,6.1,ff81f93e8b0d +-2.137,201,5.0,ff81f93e8b0d +-2.025,201,5.3,ff81f93e8b0d +-1.918,201,4.7,ff81f93e8b0d +-1.805,201,3.6,ff81f93e8b0d +-1.7,201,5.7,fe75c6c37e5a +-1.595,201,4.7,fe75c6c37e5a +-1.484,201,5.2,fe75c6c37e5a +-1.369,201,5.7,ff81f93e8b0d +-1.255,201,6.0,ff81f93e8b0d +-1.149,201,6.1,ff81f93e8b0d +-1.034,201,5.9,ff81f93e8b0d +-0.921,201,4.7,ff81f93e8b0d +-0.808,201,3.3,fe75c6c37e5a +-0.702,201,4.7,ff81f93e8b0d +-0.588,201,4.7,fe75c6c37e5a +-0.474,201,5.5,fe75c6c37e5a +-0.361,201,4.5,fe75c6c37e5a +-0.253,201,6.2,fe75c6c37e5a +-0.141,201,5.0,fe75c6c37e5a +-0.027,201,5.0,ff81f93e8b0d +0.087,201,6.4,ff81f93e8b0d +0.203,201,3.1,fe75c6c37e5a +0.315,201,4.3,fe75c6c37e5a +0.427,201,4.6,fe75c6c37e5a +0.535,201,7.2,fe75c6c37e5a +0.642,201,4.4,fe75c6c37e5a +0.757,201,4.6,fe75c6c37e5a +0.864,201,4.0,fe75c6c37e5a +0.976,201,2.8,fe75c6c37e5a +1.082,201,3.6,fe75c6c37e5a +1.19,201,5.3,ff81f93e8b0d +1.302,201,5.9,fe75c6c37e5a +1.408,201,4.5,fe75c6c37e5a +1.521,201,4.6,fe75c6c37e5a +1.626,201,2.8,fe75c6c37e5a +1.728,201,3.7,fe75c6c37e5a +1.84,201,3.8,fe75c6c37e5a +1.947,201,3.5,fe75c6c37e5a +2.05,201,3.6,fe75c6c37e5a +2.156,201,4.9,fe75c6c37e5a +2.265,201,4.4,fe75c6c37e5a +2.377,201,13.1,fe75c6c37e5a +2.491,201,28.9,fe75c6c37e5a +2.622,201,9.4,fe75c6c37e5a +2.739,201,5.0,fe75c6c37e5a +2.845,201,9.4,fe75c6c37e5a +2.962,201,3.2,fe75c6c37e5a +3.066,201,4.3,fe75c6c37e5a +3.176,201,3.8,fe75c6c37e5a +3.283,201,7.4,fe75c6c37e5a +3.393,201,4.2,fe75c6c37e5a +3.507,201,4.6,fe75c6c37e5a +3.619,201,4.6,fe75c6c37e5a +3.733,201,4.3,fe75c6c37e5a +3.842,201,5.3,fe75c6c37e5a +3.957,201,6.3,fe75c6c37e5a +4.067,201,4.0,fe75c6c37e5a +4.178,201,4.3,fe75c6c37e5a +4.285,201,4.7,fe75c6c37e5a +4.396,201,4.0,fe75c6c37e5a +4.503,201,8.8,fe75c6c37e5a +4.616,201,11.8,fe75c6c37e5a +4.735,201,3.9,fe75c6c37e5a +4.847,201,14.6,fe75c6c37e5a +4.971,201,5.8,fe75c6c37e5a +5.08,201,6.2,fe75c6c37e5a +5.194,201,3.7,fe75c6c37e5a +5.306,201,6.6,fe75c6c37e5a +5.417,201,5.8,fe75c6c37e5a +5.533,201,4.8,fe75c6c37e5a +5.639,201,5.3,fe75c6c37e5a +5.753,201,3.2,fe75c6c37e5a +5.857,201,6.7,fe75c6c37e5a +5.973,201,6.9,fe75c6c37e5a +6.088,201,5.5,fe75c6c37e5a +6.202,201,5.7,fe75c6c37e5a +6.315,201,5.0,fe75c6c37e5a +6.425,201,5.2,fe75c6c37e5a +6.537,201,4.8,fe75c6c37e5a +6.646,201,3.3,fe75c6c37e5a +6.755,201,6.7,fe75c6c37e5a +6.868,201,4.5,fe75c6c37e5a +6.979,201,4.5,fe75c6c37e5a +7.088,201,5.4,fe75c6c37e5a +7.199,201,4.9,fe75c6c37e5a +7.312,201,5.1,fe75c6c37e5a +7.42,201,4.4,fe75c6c37e5a +7.534,201,4.6,fe75c6c37e5a +7.647,201,3.4,fe75c6c37e5a +7.755,201,4.9,fe75c6c37e5a +7.867,201,3.3,fe75c6c37e5a +7.974,201,6.0,fe75c6c37e5a +8.088,201,6.2,fe75c6c37e5a +8.203,201,11.6,fe75c6c37e5a +8.317,201,4.0,fe75c6c37e5a +8.426,201,4.0,fe75c6c37e5a +8.538,201,2.6,fe75c6c37e5a +8.645,201,4.8,fe75c6c37e5a +8.756,201,8.3,fe75c6c37e5a +8.869,201,5.0,fe75c6c37e5a +8.978,201,4.5,fe75c6c37e5a +9.087,201,3.8,fe75c6c37e5a +9.201,201,4.7,fe75c6c37e5a +9.311,201,4.1,fe75c6c37e5a +9.423,201,5.8,fe75c6c37e5a +9.538,201,2.8,fe75c6c37e5a +9.647,201,3.0,fe75c6c37e5a +9.76,201,4.3,fe75c6c37e5a +9.872,201,6.4,fe75c6c37e5a +9.984,201,3.7,fe75c6c37e5a +10.089,201,7.5,fe75c6c37e5a +10.199,201,5.3,fe75c6c37e5a +10.305,201,6.6,fe75c6c37e5a +10.421,201,3.1,fe75c6c37e5a +10.534,201,3.0,fe75c6c37e5a +10.647,201,3.1,fe75c6c37e5a +10.752,201,4.8,fe75c6c37e5a +10.867,201,4.4,fe75c6c37e5a +10.974,201,6.7,fe75c6c37e5a +11.084,201,5.7,fe75c6c37e5a +11.191,201,6.4,fe75c6c37e5a +11.303,201,3.2,fe75c6c37e5a +11.407,201,4.9,fe75c6c37e5a +11.515,201,5.0,fe75c6c37e5a +11.628,201,4.7,fe75c6c37e5a +11.742,201,4.7,fe75c6c37e5a +11.851,201,6.6,fe75c6c37e5a +11.966,201,5.4,fe75c6c37e5a +12.076,201,4.1,fe75c6c37e5a +12.19,201,7.0,fe75c6c37e5a +12.299,201,4.9,fe75c6c37e5a +12.414,201,4.8,fe75c6c37e5a +12.52,201,7.8,fe75c6c37e5a +12.637,201,3.5,fe75c6c37e5a +12.746,201,3.7,fe75c6c37e5a +12.854,201,3.4,fe75c6c37e5a +12.961,201,3.7,fe75c6c37e5a +13.069,201,3.8,fe75c6c37e5a +13.183,201,3.7,fe75c6c37e5a +13.293,201,5.8,fe75c6c37e5a +13.402,201,7.9,fe75c6c37e5a +13.513,201,6.1,fe75c6c37e5a +13.626,201,3.7,fe75c6c37e5a +13.736,201,4.1,fe75c6c37e5a +13.848,201,3.5,fe75c6c37e5a +13.96,201,3.2,fe75c6c37e5a +14.07,201,3.6,fe75c6c37e5a +14.183,201,3.4,fe75c6c37e5a +14.29,201,4.4,fe75c6c37e5a +14.397,201,3.1,fe75c6c37e5a +14.506,201,3.5,fe75c6c37e5a +14.615,201,3.5,fe75c6c37e5a +14.72,201,3.4,fe75c6c37e5a +14.826,201,3.6,fe75c6c37e5a +14.93,201,4.2,ff81f93e8b0d +15.034,201,3.8,ff81f93e8b0d +15.147,201,3.6,ff81f93e8b0d +15.261,201,3.7,fe75c6c37e5a +15.366,201,3.4,ff81f93e8b0d +15.474,201,3.4,ff81f93e8b0d +15.586,201,5.0,ff81f93e8b0d +15.701,201,3.7,ff81f93e8b0d +15.813,201,3.9,fe75c6c37e5a +15.926,201,4.0,fe75c6c37e5a +16.04,201,6.1,fe75c6c37e5a +16.157,201,5.0,ff81f93e8b0d +16.265,201,3.9,ff81f93e8b0d +16.375,201,14.9,ff81f93e8b0d +16.494,201,4.5,fe75c6c37e5a +16.599,201,4.6,ff81f93e8b0d +16.708,201,5.7,ff81f93e8b0d +16.815,201,4.9,ff81f93e8b0d +16.922,201,6.2,ff81f93e8b0d +17.029,201,4.6,fe75c6c37e5a +17.135,201,4.3,fe75c6c37e5a +17.241,201,4.7,fe75c6c37e5a +17.353,201,4.6,fe75c6c37e5a +17.468,201,4.0,fe75c6c37e5a +17.575,201,4.3,fe75c6c37e5a +17.685,201,2.8,fe75c6c37e5a +17.792,201,5.1,fe75c6c37e5a +17.904,201,3.7,fe75c6c37e5a +18.018,201,4.0,fe75c6c37e5a +18.126,201,3.3,fe75c6c37e5a +18.23,201,4.0,ff81f93e8b0d +18.34,201,5.9,ff81f93e8b0d +18.455,201,5.9,fe75c6c37e5a +18.571,201,3.5,fe75c6c37e5a +18.678,201,5.3,fe75c6c37e5a +18.791,201,5.5,ff81f93e8b0d +18.899,201,3.0,fe75c6c37e5a +19.01,201,3.8,fe75c6c37e5a +19.116,201,5.1,fe75c6c37e5a +19.224,201,5.0,fe75c6c37e5a +19.336,201,3.7,fe75c6c37e5a +19.446,201,3.4,fe75c6c37e5a +19.555,201,10.6,fe75c6c37e5a +19.672,201,6.1,ff81f93e8b0d +19.787,201,7.7,ff81f93e8b0d +19.905,201,7.1,fe75c6c37e5a +20.02,201,7.8,ff81f93e8b0d +20.132,201,4.3,ff81f93e8b0d +20.237,201,6.4,fe75c6c37e5a +20.35,201,3.7,fe75c6c37e5a +20.462,201,4.3,ff81f93e8b0d +20.574,201,3.3,ff81f93e8b0d +20.679,201,3.1,fe75c6c37e5a +20.784,201,3.5,fe75c6c37e5a +20.894,201,4.0,fe75c6c37e5a +21.006,201,4.4,fe75c6c37e5a +21.115,201,3.7,fe75c6c37e5a +21.222,201,5.5,fe75c6c37e5a +21.336,201,3.6,fe75c6c37e5a +21.44,201,6.4,ff81f93e8b0d +21.556,201,5.8,fe75c6c37e5a +21.671,201,4.8,ff81f93e8b0d +21.783,201,2.6,ff81f93e8b0d +21.893,201,4.7,ff81f93e8b0d +21.999,201,3.1,fe75c6c37e5a +22.104,201,2.7,fe75c6c37e5a +22.207,201,5.7,ff81f93e8b0d +22.319,201,2.9,ff81f93e8b0d +22.422,201,5.5,fe75c6c37e5a +22.534,201,4.2,ff81f93e8b0d +22.638,201,5.8,fe75c6c37e5a +22.745,201,2.8,fe75c6c37e5a +22.858,201,4.4,fe75c6c37e5a +22.967,201,3.1,fe75c6c37e5a +23.076,201,3.2,fe75c6c37e5a +23.185,201,3.6,fe75c6c37e5a +23.292,201,3.9,fe75c6c37e5a +23.403,201,3.7,fe75c6c37e5a +23.516,201,3.8,fe75c6c37e5a +23.625,201,4.3,fe75c6c37e5a +23.731,201,2.7,fe75c6c37e5a +23.844,201,3.3,fe75c6c37e5a +23.957,201,5.7,fe75c6c37e5a +24.064,201,3.4,fe75c6c37e5a +24.172,201,5.3,fe75c6c37e5a +24.285,201,2.9,fe75c6c37e5a +24.392,201,5.5,fe75c6c37e5a +24.501,201,3.8,fe75c6c37e5a +24.611,201,3.3,ff81f93e8b0d +24.719,201,5.0,ff81f93e8b0d +24.824,201,4.2,ff81f93e8b0d +24.93,201,2.8,fe75c6c37e5a +25.042,201,4.8,ff81f93e8b0d +25.151,201,3.1,ff81f93e8b0d +25.261,201,3.1,fe75c6c37e5a +25.365,201,3.1,fe75c6c37e5a +25.477,201,4.1,fe75c6c37e5a +25.588,201,3.3,fe75c6c37e5a +25.691,201,4.4,fe75c6c37e5a +25.797,201,3.1,ff81f93e8b0d +25.904,201,2.8,ff81f93e8b0d +26.011,201,3.1,fe75c6c37e5a +26.124,201,5.2,ff81f93e8b0d +26.239,201,5.3,ff81f93e8b0d +26.35,201,3.1,fe75c6c37e5a +26.46,201,4.1,fe75c6c37e5a +26.57,201,3.5,ff81f93e8b0d +26.683,201,3.1,fe75c6c37e5a +26.788,201,4.1,ff81f93e8b0d +26.893,201,3.0,ff81f93e8b0d +26.996,201,4.1,fe75c6c37e5a +27.109,201,4.0,fe75c6c37e5a +27.22,201,3.2,fe75c6c37e5a +27.325,201,4.6,fe75c6c37e5a +27.431,201,2.5,fe75c6c37e5a +27.536,201,2.9,ff81f93e8b0d +27.641,201,4.3,ff81f93e8b0d +27.747,201,3.2,fe75c6c37e5a +27.86,201,3.3,ff81f93e8b0d +27.972,201,4.7,fe75c6c37e5a +28.084,201,2.8,ff81f93e8b0d +28.197,201,4.0,ff81f93e8b0d +28.302,201,3.3,ff81f93e8b0d +28.408,201,2.9,fe75c6c37e5a +28.517,201,2.8,fe75c6c37e5a +28.625,201,4.3,fe75c6c37e5a +28.737,201,3.4,fe75c6c37e5a +28.842,201,3.2,fe75c6c37e5a +28.953,201,3.1,fe75c6c37e5a +29.065,201,2.9,fe75c6c37e5a +29.178,201,5.1,fe75c6c37e5a +29.291,201,3.5,ff81f93e8b0d +29.404,201,11.5,ff81f93e8b0d +29.517,201,3.0,ff81f93e8b0d +29.625,201,2.8,ff81f93e8b0d +29.737,201,3.3,ff81f93e8b0d +29.841,201,4.1,fe75c6c37e5a +29.954,201,4.0,ff81f93e8b0d +30.062,201,4.1,ff81f93e8b0d +30.167,201,2.9,fe75c6c37e5a +30.273,201,3.6,fe75c6c37e5a +30.387,201,3.5,fe75c6c37e5a +30.498,201,3.1,fe75c6c37e5a +30.602,201,3.8,fe75c6c37e5a +30.707,201,4.5,ff81f93e8b0d +30.822,201,3.8,fe75c6c37e5a +30.932,201,3.9,fe75c6c37e5a +31.045,201,7.3,fe75c6c37e5a +31.158,201,5.1,fe75c6c37e5a +31.271,201,3.7,ff81f93e8b0d +31.381,201,4.5,ff81f93e8b0d +31.491,201,3.9,ff81f93e8b0d +31.598,201,3.0,fe75c6c37e5a +31.706,201,3.5,fe75c6c37e5a +31.815,201,4.9,fe75c6c37e5a +31.925,201,2.9,fe75c6c37e5a +32.032,201,3.4,fe75c6c37e5a +32.144,201,4.1,fe75c6c37e5a +32.249,201,5.3,ff81f93e8b0d +32.364,201,3.2,fe75c6c37e5a +32.475,201,3.3,fe75c6c37e5a +32.579,201,3.6,ff81f93e8b0d +32.691,201,3.1,ff81f93e8b0d +32.797,201,4.3,ff81f93e8b0d +32.91,201,3.5,ff81f93e8b0d +33.018,201,3.2,ff81f93e8b0d +33.131,201,2.9,fe75c6c37e5a +33.236,201,4.3,ff81f93e8b0d +33.343,201,3.5,ff81f93e8b0d +33.453,201,3.2,ff81f93e8b0d +33.558,201,3.4,fe75c6c37e5a +33.671,201,3.4,ff81f93e8b0d +33.776,201,4.7,fe75c6c37e5a +33.889,201,3.8,fe75c6c37e5a +34.002,201,4.0,ff81f93e8b0d +34.114,201,3.8,ff81f93e8b0d +34.228,201,3.0,ff81f93e8b0d +34.333,201,3.5,ff81f93e8b0d +34.437,201,3.7,fe75c6c37e5a +34.543,201,4.2,fe75c6c37e5a +34.657,201,4.4,fe75c6c37e5a +34.77,201,4.5,ff81f93e8b0d +34.882,201,5.8,ff81f93e8b0d +34.995,201,4.4,ff81f93e8b0d +35.107,201,3.4,ff81f93e8b0d +35.215,201,5.2,ff81f93e8b0d +35.328,201,4.3,ff81f93e8b0d +35.443,201,3.8,fe75c6c37e5a +35.557,201,16.2,fe75c6c37e5a +35.68,201,3.3,fe75c6c37e5a +35.786,201,3.3,ff81f93e8b0d +35.897,201,3.2,ff81f93e8b0d +36.01,201,3.6,ff81f93e8b0d +36.116,201,2.7,ff81f93e8b0d +36.227,201,4.7,ff81f93e8b0d +36.335,201,2.7,ff81f93e8b0d +36.442,201,3.0,ff81f93e8b0d +36.55,201,3.2,fe75c6c37e5a +36.654,201,3.4,fe75c6c37e5a +36.763,201,3.5,fe75c6c37e5a +36.872,201,3.4,fe75c6c37e5a +36.981,201,5.0,ff81f93e8b0d +37.089,201,5.0,ff81f93e8b0d +37.199,201,2.9,ff81f93e8b0d +37.305,201,3.6,ff81f93e8b0d +37.415,201,3.7,fe75c6c37e5a +37.521,201,5.5,ff81f93e8b0d +37.632,201,4.0,ff81f93e8b0d +37.744,201,3.7,ff81f93e8b0d +37.858,201,3.5,ff81f93e8b0d +37.966,201,2.8,ff81f93e8b0d +38.074,201,2.9,ff81f93e8b0d +38.185,201,3.6,ff81f93e8b0d +38.297,201,5.1,ff81f93e8b0d +38.407,201,3.5,ff81f93e8b0d +38.52,201,3.1,ff81f93e8b0d +38.632,201,3.4,ff81f93e8b0d +38.744,201,3.0,fe75c6c37e5a +38.849,201,3.6,ff81f93e8b0d +38.954,201,3.2,ff81f93e8b0d +39.062,201,3.2,ff81f93e8b0d +39.168,201,3.3,fe75c6c37e5a +39.276,201,2.7,fe75c6c37e5a +39.388,201,2.9,fe75c6c37e5a +39.497,201,3.0,fe75c6c37e5a +39.606,201,3.6,fe75c6c37e5a +39.714,201,2.9,fe75c6c37e5a +39.82,201,3.2,ff81f93e8b0d +39.932,201,2.9,fe75c6c37e5a +40.043,201,3.4,fe75c6c37e5a +40.155,201,7.2,fe75c6c37e5a +40.262,201,3.0,fe75c6c37e5a +40.368,201,2.7,ff81f93e8b0d +40.476,201,3.7,ff81f93e8b0d +40.584,201,3.7,ff81f93e8b0d +40.691,201,4.9,fe75c6c37e5a +40.805,201,4.2,ff81f93e8b0d +40.911,201,3.8,ff81f93e8b0d +41.015,201,2.7,fe75c6c37e5a +41.125,201,3.0,fe75c6c37e5a +41.234,201,3.1,fe75c6c37e5a +41.339,201,2.7,ff81f93e8b0d +41.45,201,2.7,ff81f93e8b0d +41.56,201,2.6,ff81f93e8b0d +41.665,201,3.8,ff81f93e8b0d +41.775,201,4.8,ff81f93e8b0d +41.885,201,6.7,ff81f93e8b0d +41.997,201,5.8,ff81f93e8b0d +42.105,201,5.2,ff81f93e8b0d +42.216,201,4.7,ff81f93e8b0d +42.326,201,4.1,ff81f93e8b0d +42.44,201,5.0,ff81f93e8b0d +42.553,201,3.3,fe75c6c37e5a +42.657,201,3.5,ff81f93e8b0d +42.762,201,4.0,ff81f93e8b0d +42.875,201,2.7,ff81f93e8b0d +42.986,201,2.9,ff81f93e8b0d +43.096,201,2.8,ff81f93e8b0d +43.202,201,3.7,ff81f93e8b0d +43.316,201,2.8,ff81f93e8b0d +43.426,201,3.4,ff81f93e8b0d +43.537,201,3.1,ff81f93e8b0d +43.649,201,3.6,ff81f93e8b0d +43.763,201,3.5,fe75c6c37e5a +43.875,201,3.3,fe75c6c37e5a +43.98,201,4.2,ff81f93e8b0d +44.087,201,3.8,ff81f93e8b0d +44.191,201,3.8,ff81f93e8b0d +44.304,201,6.3,ff81f93e8b0d +44.415,201,7.9,ff81f93e8b0d +44.523,201,3.5,ff81f93e8b0d +44.63,201,20.6,ff81f93e8b0d +44.759,201,3.5,fe75c6c37e5a +44.864,201,3.7,fe75c6c37e5a +44.974,201,4.8,fe75c6c37e5a +45.083,201,3.6,ff81f93e8b0d +45.19,201,5.5,fe75c6c37e5a +45.297,201,4.3,ff81f93e8b0d +45.406,201,6.9,fe75c6c37e5a diff --git a/evidence/failover-each/286766bf2b32/result.json b/evidence/failover-each/ff81f93e8b0d/result.json similarity index 61% rename from evidence/failover-each/286766bf2b32/result.json rename to evidence/failover-each/ff81f93e8b0d/result.json index dcc99dee..19b00d49 100644 --- a/evidence/failover-each/286766bf2b32/result.json +++ b/evidence/failover-each/ff81f93e8b0d/result.json @@ -1,32 +1,32 @@ { - "label": "286766bf2b32", + "label": "ff81f93e8b0d", "action": [ "sh", "-c", - "scripts/stop-one.sh && docker compose ps -a --format '{{.ID}} {{.Service}} {{.Status}}' api && sleep 10 && scripts/restore.sh" + "scripts/stop-one.sh && docker compose ps -a --format '{{.ID}} {{.Service}} {{.Status}}' api && { scripts/stand-usage.sh & sleep 10; wait; } && scripts/restore.sh" ], "action_exit": 0, - "action_seconds": 15.231, + "action_seconds": 15.296, "action_finished_before_load_end": true, "lb_up_before": 2, "lb_up_min": 1, - "detection_seconds": 0.926, - "rejoin_seconds": 14.932, + "detection_seconds": 1.405, + "rejoin_seconds": 14.834, "probe": { - "attempts": 655, + "attempts": 646, "failed_attempts": 0, "first_failure_s": null, "recovery_s": 0.0, "instances_before": { - "286766bf2b32": 122, - "fa81adafcb69": 115 + "ff81f93e8b0d": 116, + "fe75c6c37e5a": 117 }, "instances_during_outage": { - "fa81adafcb69": 128 + "fe75c6c37e5a": 121 }, "instances_after": { - "286766bf2b32": 155, - "fa81adafcb69": 123 + "ff81f93e8b0d": 137, + "fe75c6c37e5a": 138 } }, "lb_counters": { @@ -37,14 +37,14 @@ "hrsp_5xx": 0 }, "k6": { - "requests": 6000, - "rps": 100.0, - "ok_rps": 100.0, + "requests": 6001, + "rps": 100.02, + "ok_rps": 100.02, "failed_ratio": 0, "dropped_iterations": 0, - "p50_ms": 2.04, - "p95_ms": 6.56, - "p99_ms": 13.68, + "p50_ms": 1.6, + "p95_ms": 3.92, + "p99_ms": 7.31, "exit": 0, "rate": 100 }, diff --git a/evidence/failover-each/summary.json b/evidence/failover-each/summary.json index 94d2b9fa..69b68b88 100644 --- a/evidence/failover-each/summary.json +++ b/evidence/failover-each/summary.json @@ -1,93 +1,33 @@ [ { - "label": "286766bf2b32", + "label": "ff81f93e8b0d", "action": [ "sh", "-c", - "scripts/stop-one.sh && docker compose ps -a --format '{{.ID}} {{.Service}} {{.Status}}' api && sleep 10 && scripts/restore.sh" + "scripts/stop-one.sh && docker compose ps -a --format '{{.ID}} {{.Service}} {{.Status}}' api && { scripts/stand-usage.sh & sleep 10; wait; } && scripts/restore.sh" ], "action_exit": 0, - "action_seconds": 15.231, + "action_seconds": 15.296, "action_finished_before_load_end": true, "lb_up_before": 2, "lb_up_min": 1, - "detection_seconds": 0.926, - "rejoin_seconds": 14.932, + "detection_seconds": 1.405, + "rejoin_seconds": 14.834, "probe": { - "attempts": 655, + "attempts": 646, "failed_attempts": 0, "first_failure_s": null, "recovery_s": 0.0, "instances_before": { - "286766bf2b32": 122, - "fa81adafcb69": 115 + "ff81f93e8b0d": 116, + "fe75c6c37e5a": 117 }, "instances_during_outage": { - "fa81adafcb69": 128 + "fe75c6c37e5a": 121 }, "instances_after": { - "286766bf2b32": 155, - "fa81adafcb69": 123 - } - }, - "lb_counters": { - "wretr": 0, - "wredis": 0, - "econ": 0, - "eresp": 0, - "hrsp_5xx": 0 - }, - "k6": { - "requests": 6000, - "rps": 100.0, - "ok_rps": 100.0, - "failed_ratio": 0, - "dropped_iterations": 0, - "p50_ms": 2.04, - "p95_ms": 6.56, - "p99_ms": 13.68, - "exit": 0, - "rate": 100 - }, - "checks": { - "action_ok": true, - "load_errors_ok": true, - "write_recovery_ok": true, - "detected": true, - "target_excluded": true, - "rejoined": true - }, - "pass": true - }, - { - "label": "fa81adafcb69", - "action": [ - "sh", - "-c", - "scripts/stop-one.sh && docker compose ps -a --format '{{.ID}} {{.Service}} {{.Status}}' api && sleep 10 && scripts/restore.sh" - ], - "action_exit": 0, - "action_seconds": 14.776, - "action_finished_before_load_end": true, - "lb_up_before": 2, - "lb_up_min": 1, - "detection_seconds": 1.065, - "rejoin_seconds": 14.587, - "probe": { - "attempts": 655, - "failed_attempts": 0, - "first_failure_s": null, - "recovery_s": 0.0, - "instances_before": { - "fa81adafcb69": 113, - "286766bf2b32": 125 - }, - "instances_during_outage": { - "286766bf2b32": 123 - }, - "instances_after": { - "286766bf2b32": 148, - "fa81adafcb69": 134 + "ff81f93e8b0d": 137, + "fe75c6c37e5a": 138 } }, "lb_counters": { @@ -103,9 +43,69 @@ "ok_rps": 100.02, "failed_ratio": 0, "dropped_iterations": 0, - "p50_ms": 2.1, - "p95_ms": 6.46, - "p99_ms": 14.16, + "p50_ms": 1.6, + "p95_ms": 3.92, + "p99_ms": 7.31, + "exit": 0, + "rate": 100 + }, + "checks": { + "action_ok": true, + "load_errors_ok": true, + "write_recovery_ok": true, + "detected": true, + "target_excluded": true, + "rejoined": true + }, + "pass": true + }, + { + "label": "fe75c6c37e5a", + "action": [ + "sh", + "-c", + "scripts/stop-one.sh && docker compose ps -a --format '{{.ID}} {{.Service}} {{.Status}}' api && { scripts/stand-usage.sh & sleep 10; wait; } && scripts/restore.sh" + ], + "action_exit": 0, + "action_seconds": 14.56, + "action_finished_before_load_end": true, + "lb_up_before": 2, + "lb_up_min": 1, + "detection_seconds": 0.859, + "rejoin_seconds": 14.343, + "probe": { + "attempts": 646, + "failed_attempts": 0, + "first_failure_s": null, + "recovery_s": 0.0, + "instances_before": { + "fe75c6c37e5a": 130, + "ff81f93e8b0d": 105 + }, + "instances_during_outage": { + "ff81f93e8b0d": 121 + }, + "instances_after": { + "ff81f93e8b0d": 123, + "fe75c6c37e5a": 156 + } + }, + "lb_counters": { + "wretr": 0, + "wredis": 0, + "econ": 0, + "eresp": 0, + "hrsp_5xx": 0 + }, + "k6": { + "requests": 6001, + "rps": 100.02, + "ok_rps": 100.02, + "failed_ratio": 0, + "dropped_iterations": 0, + "p50_ms": 1.57, + "p95_ms": 3.62, + "p99_ms": 6.24, "exit": 0, "rate": 100 }, diff --git a/evidence/failover-fa81adafcb69.txt b/evidence/failover-fa81adafcb69.txt deleted file mode 100644 index 3fbfbbab..00000000 --- a/evidence/failover-fa81adafcb69.txt +++ /dev/null @@ -1,38 +0,0 @@ -date: 2026-10-29T23:44:07Z commit: b1c80ee -== before: api replicas (hostname = X-Instance-Id), state, StartedAt, FinishedAt -286766bf2b32 running started=2026-10-29T23:44:05.033337427Z finished=2026-10-29T23:43:52.024916004Z -fa81adafcb69 running started=2026-10-29T23:43:39.090674429Z finished=0001-01-01T00:00:00Z -$ make test-failover ACTION_SCRIPT=scripts/stop-one.sh -python3 tests/resilience.py --mode failover --action-script "scripts/stop-one.sh" --base-url "http://127.0.0.1:18083" -Executing explicit failover hook; hook output suppressed to avoid leaking secrets. -{"observed_instances_before": 2, "successful_writes": 138, "failed_attempts": 0, "first_recovery_seconds": 2.747} -PASS: failover preserved confirmed data and existing session. Hook scope needs operator evidence. -== after: api replicas -286766bf2b32 running started=2026-10-29T23:44:05.033337427Z finished=2026-10-29T23:43:52.024916004Z -fa81adafcb69 exited started=2026-10-29T23:43:39.090674429Z finished=2026-10-29T23:44:10.137449096Z -== stopped replica: fa81adafcb69; shutdown: signal, drain window with readiness 503, close, exit -{"event":"Handling signal: term","level":"info","ts":"2026-10-29T23:44:07.710976Z"} -{"event":"Draining for 2.0 s","level":"info","ts":"2026-10-29T23:44:07.756678Z"} -{"event":"Draining for 2.0 s","level":"info","ts":"2026-10-29T23:44:07.770491Z"} -{"method":"GET","route":"/health/ready","status":503,"request_id":"2f965d245d53475c9ab43ce9dcab6852","duration_ms":1.826,"event":"request.handled","level":"info","ts":"2026-10-29T23:44:08.165019Z"} -{"method":"GET","route":"/health/ready","status":503,"request_id":"3c719bab920a4a93a5f02879ee7b9956","duration_ms":0.311,"event":"request.handled","level":"info","ts":"2026-10-29T23:44:08.668643Z"} -{"event":"Shutting down","level":"info","ts":"2026-10-29T23:44:09.763079Z"} -{"event":"Shutting down","level":"info","ts":"2026-10-29T23:44:09.774449Z"} -{"event":"service.stopped","level":"info","ts":"2026-10-29T23:44:09.869115Z"} -{"event":"Finished server process [13]","level":"info","ts":"2026-10-29T23:44:09.869290Z"} -{"event":"service.stopped","level":"info","ts":"2026-10-29T23:44:09.877846Z"} -{"event":"Finished server process [14]","level":"info","ts":"2026-10-29T23:44:09.878011Z"} -{"event":"Worker (pid:13) was sent SIGTERM!","level":"info","ts":"2026-10-29T23:44:09.969112Z"} -{"event":"Worker (pid:14) was sent SIGTERM!","level":"info","ts":"2026-10-29T23:44:09.969204Z"} -{"event":"Shutting down: Master","level":"info","ts":"2026-10-29T23:44:10.075447Z"} -$ scripts/restore.sh - Container mtusi2026lab3-api-1 Running - Container mtusi2026lab3-api-2 Starting - Container mtusi2026lab3-api-2 Started - Container mtusi2026lab3-api-2 Waiting - Container mtusi2026lab3-api-1 Waiting - Container mtusi2026lab3-api-2 Healthy - Container mtusi2026lab3-api-1 Healthy -== after restore -286766bf2b32 running started=2026-10-29T23:44:05.033337427Z finished=2026-10-29T23:43:52.024916004Z -fa81adafcb69 running started=2026-10-29T23:44:23.064230129Z finished=2026-10-29T23:44:10.137449096Z diff --git a/evidence/failover-fe75c6c37e5a.txt b/evidence/failover-fe75c6c37e5a.txt new file mode 100644 index 00000000..f61b9d13 --- /dev/null +++ b/evidence/failover-fe75c6c37e5a.txt @@ -0,0 +1,39 @@ +date: 2026-10-30T02:45:26Z commit: e049c26 +== before: api replicas (hostname = X-Instance-Id), state, StartedAt, FinishedAt +ff81f93e8b0d running started=2026-10-30T02:45:24.812924046Z finished=2026-10-30T02:45:12.063064055Z +fe75c6c37e5a running started=2026-10-30T02:44:57.104698047Z finished=0001-01-01T00:00:00Z +$ make test-failover ACTION_SCRIPT=scripts/stop-one.sh +python3 tests/resilience.py --mode failover --action-script "scripts/stop-one.sh" --base-url "http://127.0.0.1:18083" +Executing explicit failover hook; hook output suppressed to avoid leaking secrets. +{"observed_instances_before": 2, "successful_writes": 136, "failed_attempts": 0, "first_recovery_seconds": 2.682} +PASS: failover preserved confirmed data and existing session. Hook scope needs operator evidence. +== after: api replicas +ff81f93e8b0d running started=2026-10-30T02:45:24.812924046Z finished=2026-10-30T02:45:12.063064055Z +fe75c6c37e5a exited started=2026-10-30T02:44:57.104698047Z finished=2026-10-30T02:45:29.956667174Z +== stopped replica: fe75c6c37e5a; shutdown: signal, drain window with readiness 503, close, exit +{"event":"Handling signal: term","level":"info","ts":"2026-10-30T02:45:27.514055Z"} +{"limit":2.0,"event":"service.draining","level":"info","ts":"2026-10-30T02:45:27.518751Z"} +{"limit":2.0,"event":"service.draining","level":"info","ts":"2026-10-30T02:45:27.528773Z"} +{"method":"GET","route":"/health/ready","status":503,"request_id":"efd64978c14445e3a460198e8ef66a32","duration_ms":0.358,"event":"request.handled","level":"info","ts":"2026-10-30T02:45:27.962664Z"} +{"method":"GET","route":"/health/ready","status":503,"request_id":"53b0876587c14b2cbae1936781f79fc0","duration_ms":0.401,"event":"request.handled","level":"info","ts":"2026-10-30T02:45:28.465375Z"} +{"method":"GET","route":"/health/ready","status":503,"request_id":"947ec9729b774819b5de906d12ad0f91","duration_ms":0.306,"event":"request.handled","level":"info","ts":"2026-10-30T02:45:29.005486Z"} +{"event":"Shutting down","level":"info","ts":"2026-10-30T02:45:29.520790Z"} +{"event":"Shutting down","level":"info","ts":"2026-10-30T02:45:29.529825Z"} +{"event":"service.stopped","level":"info","ts":"2026-10-30T02:45:29.623527Z"} +{"event":"Finished server process [14]","level":"info","ts":"2026-10-30T02:45:29.623728Z"} +{"event":"service.stopped","level":"info","ts":"2026-10-30T02:45:29.632649Z"} +{"event":"Finished server process [13]","level":"info","ts":"2026-10-30T02:45:29.632781Z"} +{"event":"Worker (pid:13) was sent SIGTERM!","level":"info","ts":"2026-10-30T02:45:29.635792Z"} +{"event":"Worker (pid:14) was sent SIGTERM!","level":"info","ts":"2026-10-30T02:45:29.635917Z"} +{"event":"Shutting down: Master","level":"info","ts":"2026-10-30T02:45:29.737995Z"} +$ scripts/restore.sh + Container mtusi2026lab3-api-1 Running + Container mtusi2026lab3-api-2 Starting + Container mtusi2026lab3-api-2 Started + Container mtusi2026lab3-api-1 Waiting + Container mtusi2026lab3-api-2 Waiting + Container mtusi2026lab3-api-1 Healthy + Container mtusi2026lab3-api-2 Healthy +== after restore +ff81f93e8b0d running started=2026-10-30T02:45:24.812924046Z finished=2026-10-30T02:45:12.063064055Z +fe75c6c37e5a running started=2026-10-30T02:45:42.870380597Z finished=2026-10-30T02:45:29.956667174Z diff --git a/evidence/failover-ff81f93e8b0d.txt b/evidence/failover-ff81f93e8b0d.txt new file mode 100644 index 00000000..e289634c --- /dev/null +++ b/evidence/failover-ff81f93e8b0d.txt @@ -0,0 +1,38 @@ +date: 2026-10-30T02:45:08Z commit: e049c26 +== before: api replicas (hostname = X-Instance-Id), state, StartedAt, FinishedAt +ff81f93e8b0d running started=2026-10-30T02:44:57.018195381Z finished=0001-01-01T00:00:00Z +fe75c6c37e5a running started=2026-10-30T02:44:57.104698047Z finished=0001-01-01T00:00:00Z +$ make test-failover ACTION_SCRIPT=scripts/stop-one.sh +python3 tests/resilience.py --mode failover --action-script "scripts/stop-one.sh" --base-url "http://127.0.0.1:18083" +Executing explicit failover hook; hook output suppressed to avoid leaking secrets. +{"observed_instances_before": 2, "successful_writes": 132, "failed_attempts": 0, "first_recovery_seconds": 2.858} +PASS: failover preserved confirmed data and existing session. Hook scope needs operator evidence. +== after: api replicas +ff81f93e8b0d exited started=2026-10-30T02:44:57.018195381Z finished=2026-10-30T02:45:12.063064055Z +fe75c6c37e5a running started=2026-10-30T02:44:57.104698047Z finished=0001-01-01T00:00:00Z +== stopped replica: ff81f93e8b0d; shutdown: signal, drain window with readiness 503, close, exit +{"event":"Handling signal: term","level":"info","ts":"2026-10-30T02:45:09.656770Z"} +{"limit":2.0,"event":"service.draining","level":"info","ts":"2026-10-30T02:45:09.714534Z"} +{"limit":2.0,"event":"service.draining","level":"info","ts":"2026-10-30T02:45:09.722268Z"} +{"method":"GET","route":"/health/ready","status":503,"request_id":"468d7db9c6d24e9797a43d901e9bdbb1","duration_ms":0.312,"event":"request.handled","level":"info","ts":"2026-10-30T02:45:10.589248Z"} +{"method":"GET","route":"/health/ready","status":503,"request_id":"771ff57a02304724b1de9c40033c5157","duration_ms":0.304,"event":"request.handled","level":"info","ts":"2026-10-30T02:45:11.091968Z"} +{"event":"Shutting down","level":"info","ts":"2026-10-30T02:45:11.715907Z"} +{"event":"Shutting down","level":"info","ts":"2026-10-30T02:45:11.728294Z"} +{"event":"service.stopped","level":"info","ts":"2026-10-30T02:45:11.826861Z"} +{"event":"Finished server process [14]","level":"info","ts":"2026-10-30T02:45:11.827508Z"} +{"event":"service.stopped","level":"info","ts":"2026-10-30T02:45:11.835753Z"} +{"event":"Finished server process [13]","level":"info","ts":"2026-10-30T02:45:11.835868Z"} +{"event":"Worker (pid:13) was sent SIGTERM!","level":"info","ts":"2026-10-30T02:45:11.887319Z"} +{"event":"Worker (pid:14) was sent SIGTERM!","level":"info","ts":"2026-10-30T02:45:11.887404Z"} +{"event":"Shutting down: Master","level":"info","ts":"2026-10-30T02:45:11.990788Z"} +$ scripts/restore.sh + Container mtusi2026lab3-api-2 Running + Container mtusi2026lab3-api-1 Starting + Container mtusi2026lab3-api-1 Started + Container mtusi2026lab3-api-1 Waiting + Container mtusi2026lab3-api-2 Waiting + Container mtusi2026lab3-api-1 Healthy + Container mtusi2026lab3-api-2 Healthy +== after restore +ff81f93e8b0d running started=2026-10-30T02:45:24.812924046Z finished=2026-10-30T02:45:12.063064055Z +fe75c6c37e5a running started=2026-10-30T02:44:57.104698047Z finished=0001-01-01T00:00:00Z diff --git a/evidence/faults.txt b/evidence/faults.txt index 05492a89..2f9480f5 100644 --- a/evidence/faults.txt +++ b/evidence/faults.txt @@ -1,4 +1,4 @@ -date: 2026-10-29T23:44:48Z commit: b1c80ee +date: 2026-10-30T02:46:09Z commit: e049c26 $ make test-faults BASE_URL="http://127.0.0.1:18083" .venv/bin/pytest -m stack -v -s student-tests/stack ============================= test session starts ============================== @@ -15,7 +15,7 @@ PASSED student-tests/stack/test_faults.py::test_chat_creation_rolls_back_on_unknown_member чат с несуществующим участником: 400 invalid_request PASSED student-tests/stack/test_faults.py::test_wrong_password_and_unknown_user_get_same_basic_challenge неверный пароль: 401 за 0.012 с -неизвестный пользователь: 401 за 0.012 с +неизвестный пользователь: 401 за 0.013 с PASSED student-tests/stack/test_faults.py::test_logout_then_token_is_dead logout: 204, затем 401, повтор 401 PASSED @@ -26,26 +26,26 @@ valkey остановлен, неизвестный токен: 401 за 0.003 valkey остановлен: ready 200, вход 201, выход 503 valkey снова запущен: повторный выход 204 PASSED -student-tests/stack/test_faults.py::test_valkey_restart_keeps_cache_and_revocations рестарт valkey: ключей 16 → 16 +student-tests/stack/test_faults.py::test_valkey_restart_keeps_cache_and_revocations рестарт valkey: ключей 15 → 15 рестарт valkey: живой 200, отозванный 401 PASSED student-tests/stack/test_faults.py::test_valkey_flushall_loses_nothing FLUSHALL: живой 200, отозванный 401 PASSED student-tests/stack/test_faults.py::test_postgres_stopped_gives_bounded_503_and_recovers postgres остановлен, ready: 503 за 0.004 с postgres остановлен, me: 503 за 0.003 с -postgres остановлен, stranger: 503 за 0.002 с +postgres остановлен, stranger: 503 за 0.003 с postgres остановлен, login: 503 за 0.002 с postgres остановлен, register: 503 за 0.014 с -live внутри реплики 200; LB исключил все реплики ещё через 0.93 с +live внутри реплики 200; LB исключил все реплики ещё через 1.04 с live через LB без реплик: 503 за 0.000 с -postgres запущен: готовность через 2.3 с, прежний токен 200 +postgres запущен: готовность через 2.1 с, прежний токен 200 PASSED -student-tests/stack/test_faults.py::test_api_restart_keeps_session_without_extending_it рестарт api: готовность через 2.6 с, токен 200 -expires_at при входе 2026-10-30T00:45:03.281184Z, в БД после рестарта 2026-10-30T00:45:03.281184Z +student-tests/stack/test_faults.py::test_api_restart_keeps_session_without_extending_it рестарт api: готовность через 2.3 с, токен 200 +expires_at при входе 2026-10-30T03:46:23.761174Z, в БД после рестарта 2026-10-30T03:46:23.761174Z PASSED student-tests/stack/test_faults.py::test_full_restart_keeps_session_until_logout restart.sh: готовность через 0.0 с, прежний токен 200, выход 204, затем 401 PASSED student-tests/stack/test_faults.py::test_session_expires_after_restart_at_original_time срок сессии сокращён до 20 с, рестарт api: готовность через 1.5 с, до срока 200, после срока 401 PASSED -============================= 12 passed in 48.83s ============================== +============================= 12 passed in 48.01s ============================== diff --git a/evidence/hooks.txt b/evidence/hooks.txt index 222d3af9..ae2da33a 100644 --- a/evidence/hooks.txt +++ b/evidence/hooks.txt @@ -1,12 +1,12 @@ -date: 2026-10-29T23:44:35Z commit: b1c80ee +date: 2026-10-30T02:45:56Z commit: e049c26 $ TARGET_INSTANCE_ID= scripts/stop-one.sh; echo exit=$? # seconds — длительность хука (окно вывода из ротации 2 с + остановка) -target=286766bf2b32 exit=0 seconds=2.63 -286766bf2b32 exited exit_code=0 oom=false -fa81adafcb69 running exit_code=0 oom=false +target=ff81f93e8b0d exit=0 seconds=2.66 +ff81f93e8b0d exited exit_code=0 oom=false +fe75c6c37e5a running exit_code=0 oom=false $ scripts/restore.sh exit=0 -286766bf2b32 running -fa81adafcb69 running +ff81f93e8b0d running +fe75c6c37e5a running $ TARGET_INSTANCE_ID=no-such-replica scripts/stop-one.sh; echo exit=$? no running api replica answers as no-such-replica exit=3 diff --git a/evidence/kdf.txt b/evidence/kdf.txt index b3d83868..b20f9cbc 100644 --- a/evidence/kdf.txt +++ b/evidence/kdf.txt @@ -1,13 +1,13 @@ -date: 2026-10-29T23:43:48Z commit: b1c80ee +date: 2026-10-30T02:54:58Z commit: e049c26 $ psql -c "SELECT substring(password_hash from '^[$]argon2id[$]v=[0-9]+[$]m=[0-9]+,t=[0-9]+,p=[0-9]+[$]') AS kdf_prefix, username = 'seed_author' AS seed_stub, count(*) AS users, min(length(password_hash)) AS min_length, max(length(password_hash)) AS max_length FROM users GROUP BY 1, 2 ORDER BY 2" kdf_prefix | seed_stub | users | min_length | max_length ---------------------------------+-----------+-------+------------+------------ - $argon2id$v=19$m=19456,t=2,p=1$ | f | 28 | 97 | 97 + $argon2id$v=19$m=19456,t=2,p=1$ | f | 120 | 97 | 97 (1 row) $ psql -c "SELECT octet_length(token_hash) AS stored_bytes, count(*) AS sessions FROM sessions GROUP BY 1" stored_bytes | sessions --------------+---------- - 32 | 21 + 32 | 114 (1 row) diff --git a/evidence/lb-check.json b/evidence/lb-check.json index ca37305d..2d94f7a5 100644 --- a/evidence/lb-check.json +++ b/evidence/lb-check.json @@ -1,7 +1,7 @@ { "instances_one_token": { - "fa81adafcb69": 20, - "286766bf2b32": 20 + "fe75c6c37e5a": 20, + "ff81f93e8b0d": 20 }, "same_key": { "rounds": 20, @@ -10,8 +10,8 @@ "201": 160 }, "instances": { - "fa81adafcb69": 80, - "286766bf2b32": 80 + "ff81f93e8b0d": 80, + "fe75c6c37e5a": 80 }, "identical_bodies_rounds": 20, "single_copy_rounds": 20, diff --git a/evidence/limits-violations.txt b/evidence/limits-violations.txt index bc93b33d..69121317 100644 --- a/evidence/limits-violations.txt +++ b/evidence/limits-violations.txt @@ -1,4 +1,4 @@ -date: 2026-10-29T23:45:39Z commit: b1c80ee +date: 2026-10-30T02:46:59Z commit: e049c26 # намеренные нарушения политики во временном override (не в репозитории): # services: # api: diff --git a/evidence/limits.txt b/evidence/limits.txt index 0bd98f3a..bb3534af 100644 --- a/evidence/limits.txt +++ b/evidence/limits.txt @@ -1,4 +1,4 @@ -date: 2026-10-29T23:45:39Z commit: b1c80ee +date: 2026-10-30T02:46:59Z commit: e049c26 $ docker compose --profile bench config --format json (declared) service cpus/mem ports secrets volumes networks ro -------- ---------- ------------------------------- ------------------------------------ ---------- ---------------------- ----- @@ -12,10 +12,10 @@ valkey 0.5/128MiB - valkey.conf $ docker inspect (running containers: hostname = X-Instance-Id, applied limits) service hostname cpus memory published -------- ------------ ---- ------- --------------------------------------------------- -api 286766bf2b32 1 512MiB -api fa81adafcb69 1 512MiB -lb 55229893641c 1 128MiB 127.0.0.1:18083->8080/tcp,127.0.0.1:23083->8404/tcp -postgres 308851b9dd07 2 1024MiB -valkey 70f5ef5be346 0.5 128MiB +api fe75c6c37e5a 1 512MiB +api ff81f93e8b0d 1 512MiB +lb 35712870f3c4 1 128MiB 127.0.0.1:18083->8080/tcp,127.0.0.1:23083->8404/tcp +postgres cd7b0d78bc19 2 1024MiB +valkey c9501d6e445a 0.5 128MiB PASS: limits, ports, secrets, volumes and networks match the policy diff --git a/evidence/migrations.txt b/evidence/migrations.txt index dcc9301f..3b76e6bd 100644 --- a/evidence/migrations.txt +++ b/evidence/migrations.txt @@ -1,15 +1,15 @@ -date: 2026-10-29T23:43:46Z commit: b1c80ee +date: 2026-10-30T02:54:56Z commit: e049c26 $ psql -c "SELECT (SELECT count(*) FROM users) users, (SELECT count(*) FROM sessions) sessions, (SELECT count(*) FROM chats) chats, (SELECT count(*) FROM chat_members) members, (SELECT count(*) FROM messages) messages, (SELECT count(*) FROM idempotency_keys) keys, (SELECT count(*) FROM schema_migrations) versions" - users | sessions | chats | members | messages | keys | versions --------+----------+-------+---------+----------+------+---------- - 28 | 21 | 5 | 10 | 160 | 160 | 2 + users | sessions | chats | members | messages | keys | versions +-------+----------+-------+---------+----------+-------+---------- + 120 | 114 | 51 | 102 | 30748 | 30748 | 2 (1 row) $ make migrate -{"reason":"up to date","event":"migration.completed","level":"info","ts":"2026-10-29T23:43:48.260384Z"} +{"reason":"up to date","event":"migration.completed","level":"info","ts":"2026-10-30T02:54:58.470450Z"} $ psql -c "SELECT (SELECT count(*) FROM users) users, (SELECT count(*) FROM sessions) sessions, (SELECT count(*) FROM chats) chats, (SELECT count(*) FROM chat_members) members, (SELECT count(*) FROM messages) messages, (SELECT count(*) FROM idempotency_keys) keys, (SELECT count(*) FROM schema_migrations) versions" - users | sessions | chats | members | messages | keys | versions --------+----------+-------+---------+----------+------+---------- - 28 | 21 | 5 | 10 | 160 | 160 | 2 + users | sessions | chats | members | messages | keys | versions +-------+----------+-------+---------+----------+-------+---------- + 120 | 114 | 51 | 102 | 30748 | 30748 | 2 (1 row) diff --git a/evidence/persistence.txt b/evidence/persistence.txt index 2d5dece0..4b578e11 100644 --- a/evidence/persistence.txt +++ b/evidence/persistence.txt @@ -1,18 +1,18 @@ -date: 2026-10-29T23:44:25Z commit: b1c80ee +date: 2026-10-30T02:45:46Z commit: e049c26 == before: service hostname StartedAt status -api 286766bf2b32 2026-10-29T23:44:05.033337427Z running -api fa81adafcb69 2026-10-29T23:44:23.064230129Z running -lb 55229893641c 2026-10-29T23:43:37.43351697Z running -migrate f96b3b30d8b6 2026-10-29T23:43:38.009238428Z exited -postgres 308851b9dd07 2026-10-29T23:43:37.439197053Z running -valkey 70f5ef5be346 2026-10-29T23:43:37.44071622Z running +api fe75c6c37e5a 2026-10-30T02:45:42.870380597Z running +api ff81f93e8b0d 2026-10-30T02:45:24.812924046Z running +lb 35712870f3c4 2026-10-30T02:44:54.845670713Z running +migrate a384e9cbafb2 2026-10-30T02:44:55.92784763Z exited +postgres cd7b0d78bc19 2026-10-30T02:44:54.84929213Z running +valkey c9501d6e445a 2026-10-30T02:44:54.848454921Z running python3 tests/resilience.py --mode persistence --action-script "scripts/restart.sh" --base-url "http://127.0.0.1:18083" Executing explicit persistence hook; hook output suppressed to avoid leaking secrets. PASS: persistence preserved confirmed data and existing session. Hook scope needs operator evidence. == after: service hostname StartedAt status -api 286766bf2b32 2026-10-29T23:44:30.9011453Z running -api fa81adafcb69 2026-10-29T23:44:30.81607705Z running -lb 55229893641c 2026-10-29T23:44:29.250888591Z running -migrate f96b3b30d8b6 2026-10-29T23:44:29.754462591Z exited -postgres 308851b9dd07 2026-10-29T23:44:28.995295966Z running -valkey 70f5ef5be346 2026-10-29T23:44:29.034226424Z running +api fe75c6c37e5a 2026-10-30T02:45:51.665472503Z running +api ff81f93e8b0d 2026-10-30T02:45:51.605189211Z running +lb 35712870f3c4 2026-10-30T02:45:50.031474752Z running +migrate a384e9cbafb2 2026-10-30T02:45:50.534128753Z exited +postgres cd7b0d78bc19 2026-10-30T02:45:49.755618211Z running +valkey c9501d6e445a 2026-10-30T02:45:49.792453169Z running diff --git a/evidence/retry.json b/evidence/retry.json new file mode 100644 index 00000000..3a45d458 --- /dev/null +++ b/evidence/retry.json @@ -0,0 +1,47 @@ +{ + "variants": [ + { + "variant": "timeout", + "lost_attempt": { + "status": 0, + "client_timeout_s": 0.5, + "chat_lock_held_s": 1.5, + "replica": "fe75c6c37e5a", + "replica_killed": false, + "replica_answered": 201 + }, + "retry": { + "after_s": 1.522, + "status": 201, + "attempts": 1, + "replica": "ff81f93e8b0d" + }, + "copies_in_history": 1, + "same_message": true, + "written_by": "lost attempt", + "pass": true + }, + { + "variant": "kill", + "lost_attempt": { + "status": 0, + "client_timeout_s": 0.5, + "chat_lock_held_s": 1.5, + "replica": "ff81f93e8b0d", + "replica_killed": true, + "replica_answered": null + }, + "retry": { + "after_s": 1.518, + "status": 201, + "attempts": 1, + "replica": "fe75c6c37e5a" + }, + "copies_in_history": 1, + "same_message": true, + "written_by": "lost attempt", + "pass": true + } + ], + "pass": true +} diff --git a/evidence/rolling-from-8d28d45/action.txt b/evidence/rolling-from-8d28d45/action.txt index a5c0dcba..719644ef 100644 --- a/evidence/rolling-from-8d28d45/action.txt +++ b/evidence/rolling-from-8d28d45/action.txt @@ -1,5 +1,6 @@ -23:49:46 migrate once before the first replacement -{"reason":"up to date","event":"migration.completed","level":"info","ts":"2026-10-29T23:49:47.138073Z"} +02:51:09 migrate once before the first replacement +02:51:09 database bytes,messages: 16037555,15139 +{"reason":"up to date","event":"migration.completed","level":"info","ts":"2026-10-30T02:51:10.450477Z"} Container mtusi2026lab3-api-1 Running Container mtusi2026lab3-api-2 Running Container mtusi2026lab3-api-3 Creating @@ -7,12 +8,17 @@ Container mtusi2026lab3-api-3 Starting Container mtusi2026lab3-api-3 Started Container mtusi2026lab3-api-3 Waiting - Container mtusi2026lab3-api-1 Waiting Container mtusi2026lab3-api-2 Waiting + Container mtusi2026lab3-api-1 Waiting Container mtusi2026lab3-api-3 Healthy - Container mtusi2026lab3-api-1 Healthy Container mtusi2026lab3-api-2 Healthy -23:49:49 replace e2d392075b96 image=84c47c47ad8a -> c84bddf582a8 image=cb0dac56ff0b + Container mtusi2026lab3-api-1 Healthy +mtusi2026lab3-api-1 cpu=19.95% mem=144.9MiB / 512MiB +mtusi2026lab3-api-2 cpu=20.90% mem=144.9MiB / 512MiB +mtusi2026lab3-lb-1 cpu=2.66% mem=20.86MiB / 128MiB +mtusi2026lab3-postgres-1 cpu=5.25% mem=71.67MiB / 1GiB +mtusi2026lab3-valkey-1 cpu=0.48% mem=13.11MiB / 128MiB +02:51:12 replace 3e741644dba4 image=mtusi-messenger:8d28d45@75eeba4b5bfd -> 6c2a02267340 image=mtusi-messenger:mtusi2026lab3@c69a721bc974 Container mtusi2026lab3-api-2 Running Container mtusi2026lab3-api-3 Running Container mtusi2026lab3-api-4 Creating @@ -25,5 +31,5 @@ Container mtusi2026lab3-api-4 Healthy Container mtusi2026lab3-api-3 Healthy Container mtusi2026lab3-api-2 Healthy -23:49:52 replace bc58bf60e518 image=84c47c47ad8a -> 225f56282b82 image=cb0dac56ff0b -23:49:52 done: 2 replicas replaced +02:51:16 replace 3e62ff0322c6 image=mtusi-messenger:8d28d45@75eeba4b5bfd -> 158dfc1bd95d image=mtusi-messenger:mtusi2026lab3@c69a721bc974 +02:51:17 done: 2 replicas replaced diff --git a/evidence/rolling-from-8d28d45/k6/k6.txt b/evidence/rolling-from-8d28d45/k6/k6.txt index 8c3d01eb..b5cef14d 100644 --- a/evidence/rolling-from-8d28d45/k6/k6.txt +++ b/evidence/rolling-from-8d28d45/k6/k6.txt @@ -1,2 +1,2 @@ -time="2026-10-29T23:49:20Z" level=info msg=LOAD-START source=console +time="2026-10-30T02:50:44Z" level=info msg=LOAD-START source=console measure: 8996 requests, failed ratio 0 diff --git a/evidence/rolling-from-8d28d45/k6/summary.json b/evidence/rolling-from-8d28d45/k6/summary.json index 6b453264..4991ad6e 100644 --- a/evidence/rolling-from-8d28d45/k6/summary.json +++ b/evidence/rolling-from-8d28d45/k6/summary.json @@ -1,276 +1,4 @@ { - "state": { - "isStdOutTTY": false, - "isStdErrTTY": false, - "testRunDurationMs": 100874.730963 - }, - "metrics": { - "vus": { - "type": "gauge", - "contains": "default", - "values": { - "value": 0, - "min": 0, - "max": 12 - } - }, - "iterations{scenario:measure}": { - "contains": "default", - "values": { - "count": 8996, - "rate": 89.17991566490181 - }, - "type": "counter" - }, - "http_req_duration{scenario:measure,name:get_history}": { - "type": "trend", - "contains": "time", - "values": { - "p(99)": 10.810374999999999, - "max": 506.553417, - "avg": 3.4162380623179915, - "min": 1.148667, - "med": 2.184792, - "p(90)": 4.6460088, - "p(95)": 5.96221659999999 - } - }, - "http_req_connecting": { - "type": "trend", - "contains": "time", - "values": { - "avg": 0.0009374853190006968, - "min": 0, - "med": 0, - "p(90)": 0, - "p(95)": 0, - "p(99)": 0, - "max": 2.104541 - } - }, - "http_req_blocked": { - "type": "trend", - "contains": "time", - "values": { - "avg": 0.004537697223051537, - "min": 0.00075, - "med": 0.002875, - "p(90)": 0.004791, - "p(95)": 0.005708, - "p(99)": 0.012730679999999996, - "max": 2.150584 - } - }, - "http_req_duration": { - "type": "trend", - "contains": "time", - "values": { - "p(99)": 16.943507679999996, - "max": 506.934292, - "avg": 4.0993488849407616, - "min": 1.07975, - "med": 2.217625, - "p(90)": 5.204008400000002, - "p(95)": 7.153895499999999 - } - }, - "http_req_duration{scenario:measure,name:post_message}": { - "type": "trend", - "contains": "time", - "values": { - "avg": 4.280711416265974, - "min": 1.07975, - "med": 2.173167, - "p(90)": 5.1596664, - "p(95)": 7.02031309999999, - "p(99)": 16.865270259999996, - "max": 506.934292 - } - }, - "http_req_failed{scenario:measure}": { - "type": "rate", - "contains": "default", - "values": { - "fails": 8996, - "rate": 0, - "passes": 0 - } - }, - "data_sent": { - "type": "counter", - "contains": "data", - "values": { - "count": 2934813, - "rate": 29093.638931998386 - } - }, - "data_received": { - "type": "counter", - "contains": "data", - "values": { - "count": 24234460, - "rate": 240243.11905118235 - } - }, - "http_req_sending": { - "type": "trend", - "contains": "time", - "values": { - "med": 0.016042, - "p(90)": 0.024333, - "p(95)": 0.031208, - "p(99)": 0.077917, - "max": 1.474458, - "avg": 0.01933352154872103, - "min": 0.003084 - } - }, - "dropped_iterations{scenario:measure}": { - "type": "counter", - "contains": "default", - "values": { - "count": 5, - "rate": 0.04956642711477424 - } - }, - "http_reqs{scenario:measure}": { - "contains": "default", - "values": { - "count": 8996, - "rate": 89.17991566490181 - }, - "type": "counter" - }, - "http_req_duration{expected_response:true}": { - "contains": "time", - "values": { - "p(90)": 5.204008400000002, - "p(95)": 7.153895499999999, - "p(99)": 16.943507679999996, - "max": 506.934292, - "avg": 4.0993488849407616, - "min": 1.07975, - "med": 2.217625 - }, - "type": "trend" - }, - "http_req_receiving": { - "type": "trend", - "contains": "time", - "values": { - "p(95)": 0.076542, - "p(99)": 0.1354425, - "max": 3.474125, - "avg": 0.04115558783716541, - "min": 0.005292, - "med": 0.034959, - "p(90)": 0.061042 - } - }, - "http_req_duration{scenario:measure}": { - "values": { - "p(90)": 5.0467085, - "p(95)": 6.8923024999999996, - "p(99)": 15.4118399, - "max": 506.934292, - "avg": 4.115715779457533, - "min": 1.07975, - "med": 2.1758755 - }, - "type": "trend", - "contains": "time" - }, - "http_req_tls_handshaking": { - "type": "trend", - "contains": "time", - "values": { - "p(95)": 0, - "p(99)": 0, - "max": 0, - "avg": 0, - "min": 0, - "med": 0, - "p(90)": 0 - } - }, - "vus_max": { - "values": { - "value": 25, - "min": 20, - "max": 25 - }, - "type": "gauge", - "contains": "default" - }, - "http_reqs": { - "type": "counter", - "contains": "default", - "values": { - "count": 10047, - "rate": 99.59877864442736 - } - }, - "dropped_iterations": { - "type": "counter", - "contains": "default", - "values": { - "count": 5, - "rate": 0.04956642711477424 - } - }, - "checks": { - "type": "rate", - "contains": "default", - "values": { - "rate": 1, - "passes": 9997, - "fails": 0 - } - }, - "http_req_failed": { - "type": "rate", - "contains": "default", - "values": { - "rate": 0, - "passes": 0, - "fails": 10047 - } - }, - "iteration_duration": { - "type": "trend", - "contains": "time", - "values": { - "p(90)": 5.282500000000001, - "p(95)": 7.103508999999998, - "p(99)": 15.10760636, - "max": 507.033459, - "avg": 4.177039797039128, - "min": 1.136084, - "med": 2.350125 - } - }, - "iterations": { - "values": { - "count": 9997, - "rate": 99.10311437327961 - }, - "type": "counter", - "contains": "default" - }, - "http_req_waiting": { - "type": "trend", - "contains": "time", - "values": { - "avg": 4.038859775554884, - "min": 1.055209, - "med": 2.161666, - "p(90)": 5.118991200000001, - "p(95)": 7.076970699999999, - "p(99)": 16.83238567999999, - "max": 506.875876 - } - } - }, "root_group": { "name": "", "path": "", @@ -278,18 +6,18 @@ "groups": [], "checks": [ { - "name": "message 201", - "path": "::message 201", - "id": "6445aff337e1ade0bc10402fbac79882", - "passes": 8063, - "fails": 0 - }, - { - "name": "history 200", "path": "::history 200", "id": "fe27b3b8edd292c7f2170a6357b087d0", - "passes": 1934, - "fails": 0 + "passes": 2025, + "fails": 0, + "name": "history 200" + }, + { + "id": "6445aff337e1ade0bc10402fbac79882", + "passes": 7972, + "fails": 0, + "name": "message 201", + "path": "::message 201" } ] }, @@ -305,5 +33,277 @@ ], "summaryTimeUnit": "", "noColor": false + }, + "state": { + "isStdOutTTY": false, + "isStdErrTTY": false, + "testRunDurationMs": 100536.118408 + }, + "metrics": { + "http_req_tls_handshaking": { + "type": "trend", + "contains": "time", + "values": { + "med": 0, + "p(90)": 0, + "p(95)": 0, + "p(99)": 0, + "max": 0, + "avg": 0, + "min": 0 + } + }, + "checks": { + "type": "rate", + "contains": "default", + "values": { + "rate": 1, + "passes": 9997, + "fails": 0 + } + }, + "http_req_failed": { + "contains": "default", + "values": { + "rate": 0, + "passes": 0, + "fails": 10047 + }, + "type": "rate" + }, + "data_sent": { + "type": "counter", + "contains": "data", + "values": { + "count": 2924036, + "rate": 29084.43300082018 + } + }, + "iterations": { + "type": "counter", + "contains": "default", + "values": { + "count": 9997, + "rate": 99.43690047222378 + } + }, + "http_req_failed{scenario:measure}": { + "type": "rate", + "contains": "default", + "values": { + "rate": 0, + "passes": 0, + "fails": 8996 + } + }, + "iterations{scenario:measure}": { + "type": "counter", + "contains": "default", + "values": { + "count": 8996, + "rate": 89.48027974873713 + } + }, + "http_req_duration{scenario:measure,name:get_history}": { + "values": { + "p(99)": 6.954994759999992, + "max": 504.015792, + "avg": 3.0482905051940916, + "min": 0.990042, + "med": 1.490542, + "p(90)": 2.1491834, + "p(95)": 2.7643331999999994 + }, + "type": "trend", + "contains": "time" + }, + "http_req_receiving": { + "type": "trend", + "contains": "time", + "values": { + "p(95)": 0.04544569999999998, + "p(99)": 0.07339217999999996, + "max": 0.904875, + "avg": 0.024761768985766895, + "min": 0.007292, + "med": 0.021333, + "p(90)": 0.037458399999999996 + } + }, + "vus_max": { + "type": "gauge", + "contains": "default", + "values": { + "value": 25, + "min": 20, + "max": 25 + } + }, + "http_reqs": { + "type": "counter", + "contains": "default", + "values": { + "count": 10047, + "rate": 99.93423417469563 + } + }, + "http_req_connecting": { + "type": "trend", + "contains": "time", + "values": { + "max": 0.424459, + "avg": 0.00045999651637304665, + "min": 0, + "med": 0, + "p(90)": 0, + "p(95)": 0, + "p(99)": 0 + } + }, + "http_req_sending": { + "type": "trend", + "contains": "time", + "values": { + "med": 0.010667, + "p(90)": 0.01572540000000001, + "p(95)": 0.01925, + "p(99)": 0.04798395999999999, + "max": 0.715042, + "avg": 0.012423745993829055, + "min": 0.001917 + } + }, + "http_req_duration": { + "type": "trend", + "contains": "time", + "values": { + "avg": 2.8894621974718784, + "min": 0.891584, + "med": 1.481583, + "p(90)": 2.2351168, + "p(95)": 2.943450099999998, + "p(99)": 9.369177679999998, + "max": 506.304125 + } + }, + "http_reqs{scenario:measure}": { + "type": "counter", + "contains": "default", + "values": { + "count": 8996, + "rate": 89.48027974873713 + } + }, + "http_req_duration{scenario:measure}": { + "type": "trend", + "contains": "time", + "values": { + "p(90)": 2.1691255000000003, + "p(95)": 2.7820417499999976, + "p(99)": 5.988716649999999, + "max": 506.304125, + "avg": 2.9473552137616696, + "min": 0.891584, + "med": 1.468729 + } + }, + "http_req_waiting": { + "type": "trend", + "contains": "time", + "values": { + "avg": 2.8522766824922727, + "min": 0.869917, + "med": 1.447125, + "p(90)": 2.1879166000000003, + "p(95)": 2.8952456, + "p(99)": 9.305861139999994, + "max": 506.264292 + } + }, + "iteration_duration": { + "values": { + "p(95)": 2.961742199999998, + "p(99)": 7.183348639999999, + "max": 506.406875, + "avg": 2.934752488946681, + "min": 0.944167, + "med": 1.558959, + "p(90)": 2.3227586000000002 + }, + "type": "trend", + "contains": "time" + }, + "dropped_iterations{scenario:measure}": { + "type": "counter", + "contains": "default", + "values": { + "count": 5, + "rate": 0.04973337024718604 + } + }, + "http_req_duration{expected_response:true}": { + "type": "trend", + "contains": "time", + "values": { + "p(99)": 9.369177679999998, + "max": 506.304125, + "avg": 2.8894621974718784, + "min": 0.891584, + "med": 1.481583, + "p(90)": 2.2351168, + "p(95)": 2.943450099999998 + } + }, + "data_received": { + "type": "counter", + "contains": "data", + "values": { + "count": 25183904, + "rate": 250496.08438031792 + } + }, + "vus": { + "type": "gauge", + "contains": "default", + "values": { + "value": 0, + "min": 0, + "max": 8 + } + }, + "http_req_duration{scenario:measure,name:post_message}": { + "type": "trend", + "contains": "time", + "values": { + "max": 506.304125, + "avg": 2.9215967865215493, + "min": 0.891584, + "med": 1.461417, + "p(90)": 2.1887166000000002, + "p(95)": 2.7914587999999996, + "p(99)": 5.747117719999982 + } + }, + "dropped_iterations": { + "values": { + "count": 5, + "rate": 0.04973337024718604 + }, + "type": "counter", + "contains": "default" + }, + "http_req_blocked": { + "type": "trend", + "contains": "time", + "values": { + "max": 0.944292, + "avg": 0.0025697045884342812, + "min": 0.0005, + "med": 0.001667, + "p(90)": 0.002709, + "p(95)": 0.00325, + "p(99)": 0.00525 + } + } } } \ No newline at end of file diff --git a/evidence/rolling-from-8d28d45/lb_up.csv b/evidence/rolling-from-8d28d45/lb_up.csv index 59f91acc..d73bb713 100644 --- a/evidence/rolling-from-8d28d45/lb_up.csv +++ b/evidence/rolling-from-8d28d45/lb_up.csv @@ -1,954 +1,929 @@ t_rel_s,up --26.402,2 --26.294,2 --26.186,2 --26.075,2 --25.97,2 --25.864,2 --25.759,2 --25.65,2 --25.546,2 --25.441,2 --25.338,2 --25.228,2 --25.124,2 --25.015,2 --24.908,2 --24.802,2 --24.693,2 --24.588,2 --24.481,2 --24.373,2 --24.27,2 --24.164,2 --24.055,2 --23.948,2 --23.844,2 --23.741,2 --23.635,2 --23.53,2 --23.424,2 +-25.945,2 +-25.84,2 +-25.736,2 +-25.623,2 +-25.514,2 +-25.41,2 +-25.3,2 +-25.19,2 +-25.076,2 +-24.966,2 +-24.858,2 +-24.751,2 +-24.644,2 +-24.531,2 +-24.419,2 +-24.31,2 +-24.205,2 +-24.095,2 +-23.983,2 +-23.87,2 +-23.759,2 +-23.653,2 +-23.545,2 +-23.43,2 -23.32,2 --23.214,2 --23.104,2 --22.995,2 --22.887,2 --22.775,2 --22.667,2 --22.559,2 --22.454,2 --22.345,2 --22.237,2 +-23.206,2 +-23.098,2 +-22.987,2 +-22.876,2 +-22.77,2 +-22.659,2 +-22.555,2 +-22.448,2 +-22.337,2 +-22.232,2 -22.127,2 --22.018,2 --21.914,2 --21.809,2 --21.702,2 --21.596,2 --21.487,2 --21.383,2 --21.278,2 --21.172,2 --21.059,2 --20.957,2 --20.852,2 --20.743,2 --20.635,2 --20.53,2 --20.422,2 --20.315,2 --20.212,2 --20.102,2 --19.998,2 --19.89,2 --19.778,2 --19.673,2 --19.565,2 --19.454,2 --19.344,2 --19.24,2 --19.135,2 --19.03,2 --18.921,2 --18.812,2 --18.707,2 --18.596,2 --18.491,2 --18.383,2 +-22.019,2 +-21.908,2 +-21.801,2 +-21.694,2 +-21.584,2 +-21.474,2 +-21.365,2 +-21.259,2 +-21.152,2 +-21.04,2 +-20.926,2 +-20.816,2 +-20.705,2 +-20.594,2 +-20.486,2 +-20.372,2 +-20.257,2 +-20.142,2 +-20.028,2 +-19.92,2 +-19.811,2 +-19.704,2 +-19.596,2 +-19.483,2 +-19.374,2 +-19.268,2 +-19.157,2 +-19.043,2 +-18.93,2 +-18.82,2 +-18.708,2 +-18.595,2 +-18.49,2 +-18.381,2 -18.275,2 --18.17,2 --18.058,2 --17.953,2 --17.844,2 --17.737,2 --17.626,2 --17.522,2 --17.415,2 --17.313,2 --17.205,2 --17.099,2 --16.991,2 --16.883,2 --16.775,2 --16.67,2 --16.562,2 --16.455,2 --16.35,2 --16.241,2 --16.123,2 --16.011,2 --15.904,2 --15.798,2 --15.696,2 --15.591,2 --15.481,2 --15.371,2 --15.263,2 --15.154,2 --15.046,2 --14.938,2 --14.834,2 --14.723,2 --14.608,2 --14.497,2 --14.386,2 --14.278,2 --14.17,2 --14.045,2 --13.942,2 --13.831,2 --13.724,2 --13.62,2 --13.512,2 --13.406,2 --13.301,2 --13.193,2 --13.086,2 --12.978,2 --12.871,2 --12.754,2 --12.646,2 --12.537,2 --12.43,2 --12.325,2 --12.221,2 --12.112,2 --12.002,2 --11.891,2 --11.783,2 --11.675,2 --11.553,2 --11.444,2 --11.34,2 --11.237,2 --11.128,2 --11.021,2 --10.909,2 --10.802,2 --10.698,2 --10.592,2 --10.488,2 --10.379,2 --10.276,2 --10.172,2 --10.063,2 --9.96,2 --9.857,2 --9.753,2 --9.647,2 --9.536,2 --9.425,2 --9.317,2 --9.19,2 --9.081,2 --8.97,2 --8.849,2 --8.741,2 --8.634,2 --8.53,2 --8.418,2 --8.31,2 --8.2,2 --8.091,2 --7.987,2 --7.879,2 --7.776,2 --7.668,2 --7.558,2 --7.45,2 --7.339,2 --7.221,2 --7.114,2 --7.009,2 --6.9,2 --6.795,2 --6.688,2 --6.584,2 --6.479,2 --6.374,2 --6.265,2 --6.161,2 --6.053,2 --5.946,2 --5.842,2 --5.738,2 --5.633,2 --5.526,2 --5.421,2 --5.316,2 --5.212,2 --5.109,2 --5.002,2 --4.894,2 --4.785,2 --4.679,2 --4.572,2 --4.465,2 --4.353,2 --4.244,2 --4.139,2 --4.033,2 --3.925,2 --3.821,2 --3.713,2 --3.606,2 --3.504,2 --3.399,2 --3.291,2 --3.18,2 --3.073,2 --2.963,2 --2.854,2 --2.743,2 --2.64,2 --2.536,2 --2.426,2 --2.32,2 --2.212,2 --2.105,2 --1.998,2 --1.893,2 --1.788,2 --1.678,2 --1.57,2 --1.46,2 --1.354,2 --1.245,2 --1.141,2 --1.036,2 --0.928,2 --0.824,2 --0.715,2 --0.609,2 --0.502,2 --0.397,2 --0.291,2 --0.184,2 --0.081,2 -0.025,2 -0.129,2 -0.235,2 -0.344,2 -0.45,2 -0.554,2 -0.658,2 -0.763,2 -0.87,2 -0.975,2 -1.079,2 -1.184,2 -1.291,2 -1.394,2 -1.497,2 -1.604,2 -1.713,2 -1.819,2 -1.926,2 -2.04,2 -2.148,2 -2.256,2 -2.36,2 -2.462,2 -2.572,2 -2.679,2 -2.787,2 -2.891,2 -2.996,2 -3.102,2 -3.206,2 -3.312,2 -3.417,2 -3.526,3 -3.634,3 -3.74,3 -3.847,3 -3.959,3 -4.073,3 -4.181,2 -4.288,2 -4.393,2 -4.495,2 -4.603,2 -4.71,2 -4.815,2 -4.921,2 -5.026,2 -5.137,2 -5.246,2 -5.358,2 -5.47,2 -5.573,2 -5.679,2 -5.791,2 -5.897,2 -6.005,3 -6.108,3 -6.212,3 -6.321,3 -6.426,3 -6.53,3 -6.637,3 -6.745,3 -6.852,3 -6.956,3 -7.062,3 -7.167,2 -7.275,2 -7.383,2 -7.489,2 -7.592,2 -7.7,2 -7.807,2 -7.926,2 -8.029,2 -8.134,2 -8.239,2 -8.345,2 -8.453,2 -8.556,2 -8.66,2 -8.768,2 -8.873,2 -8.977,2 -9.081,2 -9.189,2 -9.298,2 -9.401,2 -9.51,2 -9.617,2 -9.725,2 -9.832,2 -9.947,2 -10.052,2 -10.158,2 -10.263,2 -10.368,2 -10.473,2 -10.58,2 -10.685,2 -10.792,2 -10.895,2 -11.004,2 -11.113,2 -11.223,2 -11.329,2 -11.436,2 -11.54,2 -11.647,2 -11.755,2 -11.863,2 -11.97,2 -12.077,2 -12.203,2 +-18.164,2 +-18.059,2 +-17.945,2 +-17.838,2 +-17.728,2 +-17.618,2 +-17.505,2 +-17.39,2 +-17.282,2 +-17.176,2 +-17.072,2 +-16.963,2 +-16.855,2 +-16.743,2 +-16.633,2 +-16.528,2 +-16.412,2 +-16.301,2 +-16.197,2 +-16.085,2 +-15.974,2 +-15.863,2 +-15.754,2 +-15.645,2 +-15.542,2 +-15.435,2 +-15.323,2 +-15.213,2 +-15.107,2 +-15.0,2 +-14.887,2 +-14.775,2 +-14.668,2 +-14.554,2 +-14.44,2 +-14.327,2 +-14.219,2 +-14.105,2 +-13.995,2 +-13.89,2 +-13.776,2 +-13.673,2 +-13.561,2 +-13.448,2 +-13.333,2 +-13.222,2 +-13.106,2 +-13.001,2 +-12.886,2 +-12.774,2 +-12.662,2 +-12.551,2 +-12.439,2 +-12.331,2 +-12.217,2 +-12.108,2 +-11.997,2 +-11.89,2 +-11.781,2 +-11.67,2 +-11.567,2 +-11.455,2 +-11.346,2 +-11.24,2 +-11.126,2 +-11.015,2 +-10.91,2 +-10.805,2 +-10.693,2 +-10.579,2 +-10.465,2 +-10.357,2 +-10.253,2 +-10.145,2 +-10.032,2 +-9.924,2 +-9.816,2 +-9.704,2 +-9.59,2 +-9.479,2 +-9.367,2 +-9.258,2 +-9.146,2 +-9.038,2 +-8.926,2 +-8.823,2 +-8.719,2 +-8.612,2 +-8.508,2 +-8.397,2 +-8.285,2 +-8.176,2 +-8.063,2 +-7.956,2 +-7.845,2 +-7.732,2 +-7.622,2 +-7.512,2 +-7.401,2 +-7.29,2 +-7.184,2 +-7.072,2 +-6.963,2 +-6.856,2 +-6.75,2 +-6.64,2 +-6.534,2 +-6.421,2 +-6.31,2 +-6.197,2 +-6.082,2 +-5.973,2 +-5.86,2 +-5.748,2 +-5.636,2 +-5.529,2 +-5.424,2 +-5.314,2 +-5.21,2 +-5.099,2 +-4.985,2 +-4.877,2 +-4.768,2 +-4.654,2 +-4.544,2 +-4.438,2 +-4.325,2 +-4.213,2 +-4.104,2 +-4.0,2 +-3.89,2 +-3.784,2 +-3.675,2 +-3.568,2 +-3.459,2 +-3.345,2 +-3.241,2 +-3.134,2 +-3.028,2 +-2.923,2 +-2.813,2 +-2.704,2 +-2.599,2 +-2.49,2 +-2.377,2 +-2.273,2 +-2.164,2 +-2.055,2 +-1.951,2 +-1.844,2 +-1.733,2 +-1.62,2 +-1.507,2 +-1.396,2 +-1.282,2 +-1.177,2 +-1.062,2 +-0.955,2 +-0.844,2 +-0.735,2 +-0.623,2 +-0.51,2 +-0.394,2 +-0.281,2 +-0.17,2 +-0.064,2 +0.048,2 +0.151,2 +0.257,2 +0.367,2 +0.479,2 +0.589,2 +0.696,2 +0.802,2 +0.91,2 +1.015,2 +1.123,2 +1.226,2 +1.332,2 +1.438,2 +1.549,2 +1.658,2 +1.77,2 +1.876,2 +1.984,2 +2.089,2 +2.2,2 +2.307,2 +2.417,2 +2.528,2 +2.637,2 +2.747,2 +2.849,3 +2.962,3 +3.071,3 +3.176,3 +3.28,3 +3.388,3 +3.492,3 +3.599,3 +3.706,3 +3.815,3 +3.92,3 +4.026,2 +4.138,2 +4.245,2 +4.354,2 +4.467,2 +4.577,2 +4.681,2 +4.788,2 +4.899,2 +5.01,2 +5.118,2 +5.227,2 +5.34,2 +5.452,2 +5.563,2 +5.675,2 +5.778,2 +5.891,2 +6.001,2 +6.106,2 +6.218,2 +6.327,2 +6.433,2 +6.546,3 +6.653,3 +6.757,3 +6.864,3 +6.971,3 +7.084,3 +7.196,3 +7.303,3 +7.409,3 +7.511,2 +7.623,2 +7.732,2 +7.842,2 +7.951,2 +8.057,2 +8.163,2 +8.275,2 +8.38,2 +8.489,2 +8.603,2 +8.713,2 +8.822,2 +8.933,2 +9.038,2 +9.15,2 +9.257,2 +9.37,2 +9.481,2 +9.588,2 +9.696,2 +9.804,2 +9.91,2 +10.017,2 +10.123,2 +10.227,2 +10.34,2 +10.451,2 +10.56,2 +10.666,2 +10.774,2 +10.886,2 +10.998,2 +11.109,2 +11.218,2 +11.322,2 +11.435,2 +11.547,2 +11.656,2 +11.76,2 +11.872,2 +11.98,2 +12.082,2 +12.195,2 12.308,2 -12.412,2 +12.419,2 12.53,2 -12.637,2 -12.742,2 -12.845,2 -12.952,2 -13.057,2 -13.162,2 -13.268,2 -13.375,2 -13.483,2 -13.587,2 -13.69,2 -13.796,2 -13.899,2 -14.002,2 -14.105,2 -14.213,2 -14.321,2 -14.427,2 -14.535,2 -14.641,2 -14.744,2 -14.848,2 -14.951,2 -15.057,2 -15.163,2 -15.267,2 -15.381,2 -15.49,2 -15.607,2 -15.715,2 -15.82,2 -15.926,2 -16.032,2 -16.14,2 -16.245,2 -16.353,2 -16.46,2 -16.566,2 -16.67,2 -16.773,2 -16.878,2 -16.988,2 -17.096,2 -17.2,2 -17.303,2 -17.409,2 -17.517,2 -17.622,2 -17.73,2 -17.834,2 -17.938,2 -18.043,2 -18.147,2 -18.253,2 -18.363,2 -18.469,2 -18.576,2 -18.681,2 -18.786,2 -18.89,2 -18.997,2 -19.106,2 -19.213,2 -19.32,2 -19.425,2 -19.531,2 -19.639,2 -19.747,2 -19.853,2 -19.958,2 -20.062,2 -20.166,2 -20.275,2 -20.379,2 -20.486,2 -20.589,2 -20.693,2 -20.796,2 -20.905,2 -21.009,2 -21.115,2 -21.223,2 -21.326,2 -21.429,2 -21.533,2 -21.641,2 -21.751,2 -21.86,2 -21.968,2 -22.072,2 -22.181,2 -22.287,2 -22.393,2 -22.504,2 -22.612,2 -22.722,2 -22.831,2 -22.939,2 -23.046,2 -23.15,2 -23.263,2 -23.37,2 -23.475,2 -23.58,2 -23.687,2 -23.794,2 -23.9,2 -24.005,2 -24.114,2 -24.22,2 -24.324,2 -24.434,2 -24.538,2 -24.642,2 -24.75,2 -24.858,2 -24.965,2 -25.075,2 -25.177,2 -25.284,2 -25.388,2 -25.497,2 -25.608,2 -25.717,2 -25.824,2 -25.927,2 -26.034,2 -26.142,2 -26.25,2 -26.355,2 -26.461,2 -26.572,2 -26.681,2 -26.788,2 -26.895,2 -27.003,2 -27.112,2 -27.218,2 -27.324,2 -27.429,2 -27.537,2 -27.645,2 -27.754,2 -27.856,2 -27.966,2 -28.069,2 -28.176,2 -28.286,2 -28.39,2 -28.498,2 -28.607,2 -28.713,2 -28.82,2 -28.928,2 -29.036,2 -29.142,2 -29.248,2 -29.356,2 -29.464,2 -29.571,2 -29.678,2 -29.782,2 +12.635,2 +12.747,2 +12.858,2 +12.964,2 +13.075,2 +13.185,2 +13.3,2 +13.41,2 +13.523,2 +13.637,2 +13.749,2 +13.856,2 +13.966,2 +14.072,2 +14.176,2 +14.285,2 +14.392,2 +14.504,2 +14.617,2 +14.726,2 +14.835,2 +14.941,2 +15.049,2 +15.154,2 +15.266,2 +15.369,2 +15.479,2 +15.582,2 +15.69,2 +15.801,2 +15.913,2 +16.025,2 +16.129,2 +16.242,2 +16.352,2 +16.462,2 +16.573,2 +16.685,2 +16.789,2 +16.901,2 +17.013,2 +17.126,2 +17.239,2 +17.344,2 +17.452,2 +17.567,2 +17.674,2 +17.784,2 +17.891,2 +18.004,2 +18.112,2 +18.224,2 +18.335,2 +18.438,2 +18.541,2 +18.651,2 +18.759,2 +18.869,2 +18.98,2 +19.087,2 +19.195,2 +19.302,2 +19.409,2 +19.516,2 +19.619,2 +19.727,2 +19.837,2 +19.952,2 +20.061,2 +20.169,2 +20.278,2 +20.385,2 +20.491,2 +20.598,2 +20.707,2 +20.814,2 +20.925,2 +21.034,2 +21.137,2 +21.246,2 +21.353,2 +21.464,2 +21.569,2 +21.674,2 +21.787,2 +21.9,2 +22.008,2 +22.118,2 +22.226,2 +22.331,2 +22.435,2 +22.537,2 +22.647,2 +22.759,2 +22.867,2 +22.976,2 +23.087,2 +23.199,2 +23.309,2 +23.419,2 +23.53,2 +23.645,2 +23.757,2 +23.864,2 +23.976,2 +24.082,2 +24.191,2 +24.295,2 +24.406,2 +24.515,2 +24.628,2 +24.743,2 +24.856,2 +24.967,2 +25.08,2 +25.189,2 +25.297,2 +25.409,2 +25.514,2 +25.619,2 +25.728,2 +25.84,2 +25.95,2 +26.057,2 +26.163,2 +26.275,2 +26.39,2 +26.496,2 +26.61,2 +26.723,2 +26.83,2 +26.942,2 +27.057,2 +27.162,2 +27.275,2 +27.385,2 +27.493,2 +27.606,2 +27.716,2 +27.821,2 +27.93,2 +28.038,2 +28.147,2 +28.25,2 +28.364,2 +28.478,2 +28.589,2 +28.698,2 +28.809,2 +28.922,2 +29.026,2 +29.139,2 +29.243,2 +29.354,2 +29.46,2 +29.565,2 +29.67,2 +29.779,2 29.889,2 -30.01,2 -30.118,2 -30.228,2 -30.337,2 -30.446,2 -30.554,2 -30.662,2 -30.769,2 -30.875,2 -30.978,2 -31.083,2 -31.188,2 -31.297,2 -31.405,2 -31.515,2 -31.622,2 -31.73,2 -31.839,2 -31.945,2 -32.057,2 -32.165,2 -32.269,2 -32.373,2 -32.481,2 -32.586,2 -32.698,2 -32.806,2 -32.915,2 -33.02,2 -33.124,2 -33.231,2 -33.34,2 -33.448,2 -33.554,2 -33.664,2 -33.772,2 -33.879,2 -33.986,2 -34.09,2 -34.195,2 -34.303,2 -34.41,2 -34.516,2 -34.62,2 -34.729,2 -34.833,2 -34.942,2 -35.05,2 -35.154,2 -35.262,2 -35.367,2 -35.473,2 -35.58,2 -35.691,2 -35.798,2 -35.907,2 -36.015,2 -36.117,2 -36.221,2 -36.327,2 -36.435,2 -36.539,2 -36.644,2 -36.75,2 -36.859,2 -36.964,2 -37.067,2 -37.174,2 -37.277,2 -37.382,2 -37.489,2 -37.597,2 -37.705,2 -37.812,2 -37.917,2 -38.026,2 -38.137,2 -38.243,2 -38.347,2 -38.456,2 -38.564,2 -38.669,2 -38.779,2 -38.883,2 -38.987,2 -39.095,2 -39.2,2 -39.309,2 -39.414,2 -39.521,2 -39.629,2 -39.734,2 -39.843,2 -39.95,2 -40.058,2 -40.171,2 -40.279,2 -40.384,2 -40.491,2 -40.598,2 -40.704,2 -40.807,2 -40.912,2 -41.019,2 -41.123,2 -41.227,2 -41.331,2 -41.438,2 -41.542,2 -41.649,2 -41.751,2 -41.857,2 -41.962,2 -42.071,2 -42.179,2 -42.289,2 -42.392,2 -42.496,2 -42.613,2 -42.718,2 -42.822,2 -42.929,2 -43.037,2 -43.141,2 -43.249,2 +30.001,2 +30.113,2 +30.226,2 +30.336,2 +30.441,2 +30.546,2 +30.653,2 +30.766,2 +30.88,2 +30.99,2 +31.102,2 +31.212,2 +31.321,2 +31.431,2 +31.546,2 +31.655,2 +31.767,2 +31.872,2 +31.977,2 +32.083,2 +32.196,2 +32.31,2 +32.415,2 +32.526,2 +32.633,2 +32.746,2 +32.857,2 +32.969,2 +33.076,2 +33.185,2 +33.296,2 +33.41,2 +33.522,2 +33.632,2 +33.747,2 +33.855,2 +33.966,2 +34.08,2 +34.188,2 +34.296,2 +34.402,2 +34.511,2 +34.615,2 +34.726,2 +34.834,2 +34.941,2 +35.049,2 +35.158,2 +35.264,2 +35.377,2 +35.482,2 +35.592,2 +35.696,2 +35.809,2 +35.919,2 +36.025,2 +36.131,2 +36.233,2 +36.345,2 +36.457,2 +36.568,2 +36.681,2 +36.787,2 +36.894,2 +37.007,2 +37.118,2 +37.23,2 +37.344,2 +37.458,2 +37.571,2 +37.681,2 +37.791,2 +37.898,2 +38.007,2 +38.115,2 +38.219,2 +38.333,2 +38.437,2 +38.54,2 +38.653,2 +38.761,2 +38.864,2 +38.975,2 +39.081,2 +39.187,2 +39.303,2 +39.41,2 +39.515,2 +39.625,2 +39.738,2 +39.85,2 +39.958,2 +40.069,2 +40.174,2 +40.288,2 +40.401,2 +40.516,2 +40.628,2 +40.739,2 +40.842,2 +40.948,2 +41.057,2 +41.168,2 +41.282,2 +41.388,2 +41.501,2 +41.606,2 +41.716,2 +41.825,2 +41.934,2 +42.043,2 +42.156,2 +42.265,2 +42.373,2 +42.484,2 +42.598,2 +42.705,2 +42.816,2 +42.928,2 +43.039,2 +43.142,2 +43.252,2 43.356,2 -43.463,2 -43.569,2 -43.676,2 -43.785,2 -43.893,2 -44.002,2 -44.107,2 -44.212,2 -44.316,2 -44.424,2 -44.529,2 -44.634,2 -44.742,2 -44.851,2 -44.957,2 -45.066,2 -45.174,2 -45.287,2 -45.394,2 -45.504,2 -45.611,2 -45.719,2 -45.826,2 -45.934,2 -46.039,2 -46.143,2 -46.249,2 -46.357,2 -46.465,2 -46.576,2 -46.685,2 -46.792,2 -46.899,2 -47.004,2 -47.106,2 -47.209,2 -47.311,2 -47.417,2 -47.524,2 -47.638,2 -47.748,2 -47.854,2 -47.963,2 -48.086,2 -48.194,2 -48.306,2 -48.416,2 -48.523,2 -48.626,2 -48.734,2 -48.844,2 -48.949,2 -49.055,2 -49.164,2 -49.267,2 -49.373,2 -49.476,2 -49.581,2 -49.684,2 -49.793,2 -49.901,2 -50.005,2 -50.109,2 -50.221,2 -50.325,2 -50.432,2 -50.537,2 -50.641,2 -50.748,2 -50.854,2 -50.961,2 -51.067,2 -51.173,2 -51.28,2 -51.386,2 -51.489,2 -51.596,2 -51.701,2 -51.805,2 -51.914,2 -52.019,2 -52.145,2 -52.25,2 -52.355,2 -52.463,2 -52.571,2 +43.461,2 +43.565,2 +43.671,2 +43.775,2 +43.889,2 +44.001,2 +44.112,2 +44.224,2 +44.336,2 +44.444,2 +44.552,2 +44.659,2 +44.767,2 +44.871,2 +44.982,2 +45.088,2 +45.199,2 +45.308,2 +45.412,2 +45.515,2 +45.619,2 +45.728,2 +45.837,2 +45.946,2 +46.059,2 +46.169,2 +46.277,2 +46.388,2 +46.498,2 +46.607,2 +46.714,2 +46.822,2 +46.935,2 +47.045,2 +47.16,2 +47.266,2 +47.381,2 +47.493,2 +47.607,2 +47.715,2 +47.82,2 +47.931,2 +48.044,2 +48.158,2 +48.263,2 +48.37,2 +48.477,2 +48.581,2 +48.69,2 +48.804,2 +48.917,2 +49.03,2 +49.141,2 +49.256,2 +49.363,2 +49.473,2 +49.585,2 +49.699,2 +49.81,2 +49.92,2 +50.032,2 +50.144,2 +50.252,2 +50.362,2 +50.467,2 +50.577,2 +50.69,2 +50.804,2 +50.914,2 +51.023,2 +51.127,2 +51.239,2 +51.347,2 +51.457,2 +51.568,2 +51.676,2 +51.785,2 +51.898,2 +52.016,2 +52.125,2 +52.233,2 +52.339,2 +52.448,2 +52.56,2 52.674,2 -52.78,2 -52.888,2 -52.996,2 -53.102,2 -53.211,2 -53.317,2 -53.421,2 -53.53,2 -53.637,2 -53.741,2 -53.847,2 -53.953,2 -54.061,2 -54.167,2 -54.275,2 -54.383,2 -54.489,2 -54.598,2 -54.706,2 -54.81,2 -54.917,2 -55.02,2 -55.126,2 -55.234,2 -55.337,2 -55.444,2 -55.553,2 -55.658,2 -55.765,2 -55.874,2 -55.983,2 -56.087,2 -56.193,2 -56.303,2 -56.409,2 -56.518,2 -56.62,2 -56.729,2 -56.838,2 -56.942,2 -57.052,2 -57.159,2 -57.265,2 -57.369,2 -57.475,2 -57.582,2 -57.687,2 -57.794,2 -57.904,2 -58.009,2 -58.115,2 -58.222,2 -58.329,2 -58.437,2 -58.546,2 -58.654,2 -58.762,2 -58.866,2 -58.972,2 -59.077,2 -59.183,2 -59.29,2 -59.398,2 -59.504,2 -59.609,2 -59.715,2 -59.822,2 -59.925,2 -60.037,2 -60.142,2 -60.245,2 -60.353,2 -60.461,2 -60.568,2 -60.675,2 -60.786,2 -60.891,2 -61.002,2 -61.108,2 -61.216,2 -61.323,2 -61.433,2 -61.54,2 -61.646,2 -61.75,2 -61.86,2 -61.97,2 -62.075,2 -62.186,2 -62.288,2 -62.393,2 -62.5,2 -62.607,2 -62.712,2 -62.82,2 -62.929,2 -63.034,2 -63.143,2 -63.252,2 -63.363,2 -63.47,2 -63.578,2 -63.686,2 -63.795,2 -63.903,2 -64.013,2 -64.117,2 -64.226,2 -64.331,2 -64.437,2 -64.544,2 -64.649,2 -64.759,2 -64.869,2 -64.978,2 -65.086,2 -65.19,2 -65.295,2 -65.403,2 -65.51,2 -65.614,2 -65.721,2 -65.829,2 -65.933,2 -66.037,2 -66.144,2 -66.25,2 -66.358,2 -66.466,2 -66.571,2 -66.68,2 -66.79,2 -66.896,2 -67.004,2 -67.112,2 -67.221,2 -67.33,2 -67.437,2 -67.545,2 -67.648,2 -67.75,2 -67.857,2 -67.966,2 -68.08,2 -68.188,2 -68.295,2 -68.403,2 -68.512,2 -68.62,2 -68.727,2 -68.832,2 -68.941,2 -69.049,2 -69.179,2 -69.287,2 -69.391,2 -69.499,2 -69.605,2 -69.711,2 -69.819,2 -69.923,2 -70.031,2 -70.141,2 -70.248,2 -70.354,2 -70.459,2 -70.565,2 -70.672,2 -70.78,2 -70.882,2 -70.99,2 -71.093,2 -71.198,2 -71.301,2 -71.404,2 -71.511,2 -71.62,2 -71.726,2 -71.832,2 -71.942,2 -72.049,2 -72.158,2 -72.267,2 -72.373,2 -72.477,2 -72.584,2 -72.688,2 -72.792,2 -72.897,2 -73.008,2 -73.115,2 -73.221,2 -73.329,2 -73.437,2 -73.542,2 -73.65,2 -73.759,2 +52.785,2 +52.892,2 +53.004,2 +53.115,2 +53.227,2 +53.339,2 +53.452,2 +53.566,2 +53.67,2 +53.783,2 +53.896,2 +54.005,2 +54.11,2 +54.221,2 +54.335,2 +54.444,2 +54.554,2 +54.668,2 +54.775,2 +54.88,2 +54.985,2 +55.099,2 +55.21,2 +55.321,2 +55.426,2 +55.533,2 +55.64,2 +55.753,2 +55.862,2 +55.978,2 +56.091,2 +56.202,2 +56.307,2 +56.417,2 +56.53,2 +56.64,2 +56.753,2 +56.863,2 +56.968,2 +57.078,2 +57.186,2 +57.299,2 +57.406,2 +57.515,2 +57.62,2 +57.727,2 +57.832,2 +57.94,2 +58.054,2 +58.167,2 +58.277,2 +58.387,2 +58.493,2 +58.603,2 +58.716,2 +58.823,2 +58.934,2 +59.045,2 +59.15,2 +59.257,2 +59.368,2 +59.472,2 +59.577,2 +59.684,2 +59.795,2 +59.909,2 +60.018,2 +60.13,2 +60.236,2 +60.344,2 +60.455,2 +60.567,2 +60.679,2 +60.793,2 +60.9,2 +61.012,2 +61.122,2 +61.234,2 +61.345,2 +61.453,2 +61.567,2 +61.677,2 +61.789,2 +61.9,2 +62.013,2 +62.124,2 +62.229,2 +62.342,2 +62.454,2 +62.562,2 +62.671,2 +62.777,2 +62.886,2 +62.999,2 +63.11,2 +63.221,2 +63.334,2 +63.439,2 +63.55,2 +63.661,2 +63.773,2 +63.88,2 +63.992,2 +64.104,2 +64.217,2 +64.328,2 +64.435,2 +64.54,2 +64.651,2 +64.762,2 +64.873,2 +64.981,2 +65.092,2 +65.205,2 +65.316,2 +65.428,2 +65.531,2 +65.637,2 +65.749,2 +65.86,2 +65.972,2 +66.077,2 +66.188,2 +66.298,2 +66.404,2 +66.512,2 +66.622,2 +66.734,2 +66.843,2 +66.955,2 +67.066,2 +67.178,2 +67.287,2 +67.394,2 +67.506,2 +67.617,2 +67.728,2 +67.832,2 +67.937,2 +68.051,2 +68.16,2 +68.268,2 +68.381,2 +68.492,2 +68.606,2 +68.716,2 +68.826,2 +68.934,2 +69.038,2 +69.149,2 +69.258,2 +69.368,2 +69.481,2 +69.589,2 +69.696,2 +69.806,2 +69.918,2 +70.024,2 +70.135,2 +70.244,2 +70.353,2 +70.46,2 +70.574,2 +70.689,2 +70.798,2 +70.906,2 +71.008,2 +71.121,2 +71.228,2 +71.339,2 +71.449,2 +71.56,2 +71.664,2 +71.769,2 +71.887,2 +71.998,2 +72.107,2 +72.221,2 +72.334,2 +72.445,2 +72.549,2 +72.658,2 +72.767,2 +72.874,2 +72.979,2 +73.094,2 +73.206,2 +73.317,2 +73.427,2 +73.535,2 +73.647,2 +73.756,2 73.867,2 -73.975,2 -74.084,2 -74.194,2 -74.297,2 -74.404,2 +73.978,2 +74.081,2 +74.186,2 +74.298,2 +74.402,2 74.508,2 -74.618,2 -74.721,2 -74.827,2 +74.614,2 +74.727,2 +74.831,2 74.935,2 -75.038,2 -75.143,2 -75.247,2 -75.355,2 -75.464,2 +75.045,2 +75.158,2 +75.265,2 +75.369,2 +75.478,2 diff --git a/evidence/rolling-from-8d28d45/probe.csv b/evidence/rolling-from-8d28d45/probe.csv index a951c112..b6304533 100644 --- a/evidence/rolling-from-8d28d45/probe.csv +++ b/evidence/rolling-from-8d28d45/probe.csv @@ -1,935 +1,914 @@ t_rel_s,status,latency_ms,instance --26.402,201,14.2,e2d392075b96 --26.283,201,26.1,e2d392075b96 --26.156,201,28.2,bc58bf60e518 --26.025,201,9.5,e2d392075b96 --25.913,201,31.9,bc58bf60e518 --25.778,201,8.4,e2d392075b96 --25.664,201,13.1,bc58bf60e518 --25.548,201,6.6,bc58bf60e518 --25.44,201,8.3,bc58bf60e518 --25.328,201,5.0,bc58bf60e518 --25.218,201,6.4,e2d392075b96 --25.11,201,7.3,e2d392075b96 --25.002,201,7.3,e2d392075b96 --24.889,201,7.8,e2d392075b96 --24.777,201,5.1,e2d392075b96 --24.67,201,8.0,bc58bf60e518 --24.56,201,6.3,e2d392075b96 --24.448,201,4.2,e2d392075b96 --24.341,201,4.6,e2d392075b96 --24.236,201,5.0,e2d392075b96 --24.127,201,4.9,e2d392075b96 --24.019,201,6.4,bc58bf60e518 --23.908,201,6.9,e2d392075b96 --23.801,201,7.2,bc58bf60e518 --23.691,201,5.7,bc58bf60e518 --23.582,201,4.2,bc58bf60e518 --23.473,201,9.4,bc58bf60e518 --23.362,201,3.7,bc58bf60e518 --23.255,201,6.7,bc58bf60e518 --23.143,201,5.7,bc58bf60e518 --23.034,201,3.9,bc58bf60e518 --22.928,201,4.4,e2d392075b96 --22.819,201,5.5,e2d392075b96 --22.708,201,4.5,e2d392075b96 --22.599,201,4.0,e2d392075b96 --22.493,201,5.2,e2d392075b96 --22.385,201,4.7,e2d392075b96 --22.28,201,4.0,bc58bf60e518 --22.174,201,4.8,bc58bf60e518 --22.065,201,5.6,bc58bf60e518 --21.955,201,7.3,bc58bf60e518 --21.845,201,4.7,bc58bf60e518 --21.737,201,6.8,bc58bf60e518 --21.625,201,5.1,bc58bf60e518 --21.519,201,4.5,e2d392075b96 --21.412,201,6.3,e2d392075b96 --21.303,201,3.7,e2d392075b96 --21.196,201,5.5,e2d392075b96 --21.086,201,4.9,e2d392075b96 --20.978,201,5.5,e2d392075b96 --20.869,201,7.6,e2d392075b96 --20.757,201,7.3,e2d392075b96 --20.645,201,5.3,e2d392075b96 --20.536,201,6.0,e2d392075b96 --20.429,201,5.6,bc58bf60e518 --20.32,201,6.6,bc58bf60e518 --20.21,201,4.8,bc58bf60e518 --20.101,201,4.5,bc58bf60e518 --19.996,201,3.4,bc58bf60e518 --19.889,201,9.0,bc58bf60e518 --19.776,201,3.9,bc58bf60e518 --19.671,201,6.1,e2d392075b96 --19.563,201,4.6,e2d392075b96 --19.454,201,8.3,e2d392075b96 --19.345,201,5.0,e2d392075b96 --19.236,201,5.4,e2d392075b96 --19.13,201,3.6,bc58bf60e518 --19.025,201,3.9,bc58bf60e518 --18.918,201,4.7,bc58bf60e518 --18.808,201,3.1,e2d392075b96 --18.7,201,4.6,e2d392075b96 --18.59,201,7.9,e2d392075b96 --18.481,201,5.5,e2d392075b96 --18.376,201,3.9,e2d392075b96 --18.269,201,5.3,bc58bf60e518 --18.162,201,3.7,bc58bf60e518 --18.059,201,4.6,e2d392075b96 --17.954,201,8.6,e2d392075b96 --17.842,201,10.2,e2d392075b96 --17.729,201,6.7,e2d392075b96 --17.62,201,8.3,e2d392075b96 --17.506,201,9.6,bc58bf60e518 --17.396,201,4.8,bc58bf60e518 --17.29,201,4.8,e2d392075b96 --17.183,201,4.3,e2d392075b96 --17.076,201,6.2,e2d392075b96 --16.968,201,7.5,e2d392075b96 --16.859,201,5.5,bc58bf60e518 --16.75,201,3.9,bc58bf60e518 --16.645,201,5.5,bc58bf60e518 --16.539,201,4.9,e2d392075b96 --16.429,201,6.5,e2d392075b96 --16.321,201,8.1,e2d392075b96 --16.208,201,9.9,e2d392075b96 --16.093,201,5.8,bc58bf60e518 --15.985,201,5.5,bc58bf60e518 --15.875,201,5.1,bc58bf60e518 --15.769,201,6.3,e2d392075b96 --15.661,201,4.5,e2d392075b96 --15.556,201,7.0,e2d392075b96 --15.444,201,5.6,e2d392075b96 --15.335,201,22.4,bc58bf60e518 --15.207,201,6.7,bc58bf60e518 --15.097,201,5.9,e2d392075b96 --14.986,201,6.2,bc58bf60e518 --14.875,201,11.7,bc58bf60e518 --14.758,201,7.2,bc58bf60e518 --14.65,201,7.2,bc58bf60e518 --14.54,201,9.9,bc58bf60e518 --14.425,201,18.6,e2d392075b96 --14.304,201,16.6,bc58bf60e518 --14.186,201,42.6,e2d392075b96 --14.04,201,13.6,bc58bf60e518 --13.924,201,12.1,e2d392075b96 --13.81,201,13.2,e2d392075b96 --13.692,201,5.1,bc58bf60e518 --13.583,201,5.3,bc58bf60e518 --13.472,201,9.7,bc58bf60e518 --13.357,201,5.2,bc58bf60e518 --13.247,201,13.1,e2d392075b96 --13.13,201,29.8,bc58bf60e518 --12.999,201,14.3,e2d392075b96 --12.884,201,29.5,bc58bf60e518 --12.754,201,5.9,bc58bf60e518 --12.643,201,4.0,bc58bf60e518 --12.535,201,4.9,bc58bf60e518 --12.425,201,4.2,bc58bf60e518 --12.317,201,5.8,e2d392075b96 --12.207,201,8.7,e2d392075b96 --12.097,201,4.7,e2d392075b96 --11.988,201,14.0,e2d392075b96 --11.869,201,5.1,bc58bf60e518 --11.758,201,7.1,bc58bf60e518 --11.65,201,8.5,bc58bf60e518 --11.537,201,7.3,bc58bf60e518 --11.428,201,12.9,e2d392075b96 --11.312,201,8.7,e2d392075b96 --11.2,201,7.5,e2d392075b96 --11.088,201,7.5,e2d392075b96 --10.976,201,16.2,bc58bf60e518 --10.858,201,11.4,e2d392075b96 --10.742,201,5.4,e2d392075b96 --10.635,201,8.3,e2d392075b96 --10.523,201,7.3,e2d392075b96 --10.413,201,4.6,e2d392075b96 --10.303,201,9.8,e2d392075b96 --10.188,201,6.9,e2d392075b96 --10.077,201,7.9,bc58bf60e518 --9.964,201,5.2,bc58bf60e518 --9.857,201,9.0,e2d392075b96 --9.746,201,6.0,bc58bf60e518 --9.637,201,9.7,bc58bf60e518 --9.526,201,8.1,e2d392075b96 --9.417,201,36.0,bc58bf60e518 --9.28,201,12.4,bc58bf60e518 --9.163,201,10.5,e2d392075b96 --9.049,201,8.4,e2d392075b96 --8.936,201,10.2,bc58bf60e518 --8.82,201,7.7,bc58bf60e518 --8.71,201,5.2,bc58bf60e518 --8.6,201,6.2,bc58bf60e518 --8.494,201,7.4,bc58bf60e518 --8.381,201,6.6,bc58bf60e518 --8.273,201,9.0,bc58bf60e518 --8.16,201,5.6,bc58bf60e518 --8.051,201,4.2,bc58bf60e518 --7.944,201,6.2,bc58bf60e518 --7.834,201,5.0,bc58bf60e518 --7.729,201,5.0,e2d392075b96 --7.623,201,22.0,e2d392075b96 --7.501,201,6.8,bc58bf60e518 --7.389,201,6.1,bc58bf60e518 --7.278,201,7.3,bc58bf60e518 --7.169,201,6.9,bc58bf60e518 --7.06,201,4.4,bc58bf60e518 --6.955,201,5.7,bc58bf60e518 --6.847,201,5.4,bc58bf60e518 --6.736,201,5.2,e2d392075b96 --6.629,201,5.0,e2d392075b96 --6.519,201,4.6,e2d392075b96 --6.411,201,5.9,e2d392075b96 --6.301,201,5.6,e2d392075b96 --6.194,201,4.6,e2d392075b96 --6.084,201,4.9,e2d392075b96 --5.977,201,6.2,e2d392075b96 --5.869,201,3.6,bc58bf60e518 --5.764,201,4.0,bc58bf60e518 --5.658,201,4.4,e2d392075b96 --5.552,201,4.6,e2d392075b96 --5.443,201,4.5,e2d392075b96 --5.338,201,5.7,bc58bf60e518 --5.232,201,4.8,bc58bf60e518 --5.126,201,4.0,e2d392075b96 --5.021,201,5.3,e2d392075b96 --4.916,201,7.1,e2d392075b96 --4.804,201,15.9,e2d392075b96 --4.688,201,10.4,bc58bf60e518 --4.573,201,7.5,bc58bf60e518 --4.463,201,6.3,bc58bf60e518 --4.353,201,5.9,bc58bf60e518 --4.244,201,4.8,bc58bf60e518 --4.137,201,5.9,e2d392075b96 --4.031,201,3.4,e2d392075b96 --3.923,201,7.2,e2d392075b96 --3.811,201,4.0,e2d392075b96 --3.703,201,5.9,e2d392075b96 --3.593,201,5.8,e2d392075b96 --3.484,201,4.0,e2d392075b96 --3.375,201,4.4,e2d392075b96 --3.268,201,3.9,bc58bf60e518 --3.162,201,4.6,bc58bf60e518 --3.053,201,7.6,bc58bf60e518 --2.941,201,7.2,bc58bf60e518 --2.832,201,3.4,bc58bf60e518 --2.727,201,4.6,e2d392075b96 --2.621,201,6.9,e2d392075b96 --2.511,201,4.1,e2d392075b96 --2.405,201,6.5,e2d392075b96 --2.293,201,4.4,e2d392075b96 --2.185,201,5.0,e2d392075b96 --2.075,201,3.5,e2d392075b96 --1.969,201,4.2,bc58bf60e518 --1.86,201,5.0,bc58bf60e518 --1.754,201,14.7,bc58bf60e518 --1.632,201,4.9,e2d392075b96 --1.525,201,3.5,e2d392075b96 --1.419,201,4.7,bc58bf60e518 --1.314,201,3.4,bc58bf60e518 --1.205,201,7.7,bc58bf60e518 --1.093,201,5.3,bc58bf60e518 --0.985,201,3.8,bc58bf60e518 --0.878,201,3.8,e2d392075b96 --0.773,201,7.9,e2d392075b96 --0.661,201,5.4,e2d392075b96 --0.555,201,8.6,e2d392075b96 --0.441,201,8.3,e2d392075b96 --0.328,201,5.1,e2d392075b96 --0.219,201,5.0,e2d392075b96 --0.111,201,3.7,e2d392075b96 --0.004,201,7.0,e2d392075b96 -0.105,201,5.3,e2d392075b96 -0.211,201,7.1,bc58bf60e518 -0.322,201,3.7,bc58bf60e518 -0.427,201,6.9,bc58bf60e518 -0.537,201,3.8,bc58bf60e518 -0.642,201,5.1,e2d392075b96 -0.752,201,3.6,e2d392075b96 -0.857,201,4.8,e2d392075b96 -0.966,201,3.8,e2d392075b96 -1.071,201,4.3,bc58bf60e518 -1.176,201,4.1,bc58bf60e518 -1.281,201,10.2,bc58bf60e518 -1.392,201,8.2,e2d392075b96 -1.504,201,4.7,e2d392075b96 -1.612,201,7.3,bc58bf60e518 -1.72,201,3.2,e2d392075b96 -1.825,201,3.4,e2d392075b96 -1.93,201,8.1,bc58bf60e518 -2.038,201,4.9,bc58bf60e518 -2.144,201,6.3,bc58bf60e518 -2.251,201,4.6,e2d392075b96 -2.358,201,4.3,e2d392075b96 -2.464,201,6.1,e2d392075b96 -2.574,201,3.3,e2d392075b96 -2.68,201,8.0,bc58bf60e518 -2.788,201,3.9,bc58bf60e518 -2.894,201,5.3,e2d392075b96 -3.002,201,3.8,e2d392075b96 -3.109,201,4.0,e2d392075b96 -3.217,201,5.0,e2d392075b96 -3.326,201,4.9,e2d392075b96 -3.432,201,3.4,bc58bf60e518 -3.541,201,3.9,e2d392075b96 -3.65,201,4.3,bc58bf60e518 -3.759,201,6.6,bc58bf60e518 -3.871,201,5.2,bc58bf60e518 -3.978,201,7.3,bc58bf60e518 -4.09,201,16.3,bc58bf60e518 -4.207,201,4.7,c84bddf582a8 -4.316,201,9.8,c84bddf582a8 -4.429,201,5.7,c84bddf582a8 -4.536,201,6.3,c84bddf582a8 -4.643,201,7.2,c84bddf582a8 -4.754,201,5.7,c84bddf582a8 -4.863,201,5.3,c84bddf582a8 -4.969,201,4.3,bc58bf60e518 -5.074,201,3.5,c84bddf582a8 -5.182,201,5.8,c84bddf582a8 -5.291,201,4.7,c84bddf582a8 -5.399,201,4.6,c84bddf582a8 -5.505,201,4.2,c84bddf582a8 -5.613,201,9.2,c84bddf582a8 -5.726,201,8.3,c84bddf582a8 -5.838,201,5.2,c84bddf582a8 -5.944,201,6.7,c84bddf582a8 -6.052,201,5.1,c84bddf582a8 -6.159,201,9.1,c84bddf582a8 -6.269,201,4.3,c84bddf582a8 -6.377,201,9.3,c84bddf582a8 -6.488,201,4.3,225f56282b82 -6.597,201,4.1,225f56282b82 -6.706,201,4.2,225f56282b82 -6.813,201,4.2,c84bddf582a8 -6.92,201,9.5,c84bddf582a8 -7.031,201,4.4,c84bddf582a8 -7.141,201,4.5,c84bddf582a8 -7.245,201,3.1,225f56282b82 -7.349,201,3.5,225f56282b82 -7.453,201,5.3,c84bddf582a8 -7.564,201,4.6,225f56282b82 -7.67,201,3.4,225f56282b82 -7.781,201,25.0,225f56282b82 -7.911,201,4.3,225f56282b82 -8.018,201,3.8,225f56282b82 -8.126,201,6.7,225f56282b82 -8.235,201,4.0,225f56282b82 -8.339,201,4.6,c84bddf582a8 -8.445,201,8.7,c84bddf582a8 -8.554,201,4.2,c84bddf582a8 -8.66,201,6.1,225f56282b82 -8.771,201,4.6,225f56282b82 -8.876,201,3.1,225f56282b82 -8.981,201,2.7,c84bddf582a8 -9.086,201,3.2,c84bddf582a8 -9.194,201,5.3,c84bddf582a8 -9.305,201,3.6,c84bddf582a8 -9.413,201,5.0,c84bddf582a8 -9.519,201,3.7,225f56282b82 -9.627,201,5.5,225f56282b82 -9.736,201,8.2,225f56282b82 -9.847,201,9.7,225f56282b82 -9.957,201,2.8,225f56282b82 -10.062,201,8.9,c84bddf582a8 -10.173,201,9.3,225f56282b82 -10.287,201,3.5,225f56282b82 -10.395,201,6.1,225f56282b82 -10.507,201,4.5,225f56282b82 -10.612,201,5.8,c84bddf582a8 -10.718,201,4.2,c84bddf582a8 -10.824,201,3.9,c84bddf582a8 -10.931,201,5.8,225f56282b82 -11.042,201,5.9,225f56282b82 -11.153,201,4.3,225f56282b82 -11.26,201,4.3,225f56282b82 -11.369,201,11.2,225f56282b82 -11.485,201,5.3,c84bddf582a8 -11.594,201,26.5,225f56282b82 -11.725,201,4.0,c84bddf582a8 -11.834,201,16.3,225f56282b82 -11.951,201,4.4,c84bddf582a8 -12.056,201,7.7,c84bddf582a8 -12.168,201,5.2,c84bddf582a8 -12.279,201,5.0,c84bddf582a8 -12.389,201,5.9,c84bddf582a8 -12.497,201,4.9,c84bddf582a8 -12.603,201,5.4,c84bddf582a8 -12.71,201,6.8,225f56282b82 -12.819,201,3.9,225f56282b82 -12.923,201,3.6,c84bddf582a8 -13.028,201,4.6,c84bddf582a8 -13.137,201,3.7,c84bddf582a8 -13.245,201,5.3,c84bddf582a8 -13.354,201,3.8,c84bddf582a8 -13.458,201,3.5,225f56282b82 -13.566,201,3.9,225f56282b82 -13.674,201,4.1,225f56282b82 -13.782,201,4.3,c84bddf582a8 -13.888,201,3.7,c84bddf582a8 -13.995,201,4.7,c84bddf582a8 -14.105,201,4.4,c84bddf582a8 -14.21,201,4.9,225f56282b82 -14.319,201,3.4,225f56282b82 -14.423,201,4.3,c84bddf582a8 -14.533,201,4.1,c84bddf582a8 -14.638,201,3.7,c84bddf582a8 -14.747,201,6.9,c84bddf582a8 -14.859,201,4.0,c84bddf582a8 -14.966,201,3.1,c84bddf582a8 -15.074,201,3.9,c84bddf582a8 -15.183,201,4.0,225f56282b82 -15.289,201,3.0,225f56282b82 -15.396,201,5.5,225f56282b82 -15.507,201,19.0,225f56282b82 -15.631,201,3.7,c84bddf582a8 -15.74,201,3.8,c84bddf582a8 -15.846,201,4.0,c84bddf582a8 -15.955,201,4.0,225f56282b82 -16.06,201,6.7,225f56282b82 -16.172,201,3.9,225f56282b82 -16.278,201,7.2,225f56282b82 -16.39,201,4.6,225f56282b82 -16.496,201,5.4,225f56282b82 -16.605,201,3.5,225f56282b82 -16.712,201,6.5,c84bddf582a8 -16.819,201,5.0,c84bddf582a8 -16.927,201,6.8,c84bddf582a8 -17.035,201,5.1,c84bddf582a8 -17.145,201,6.2,c84bddf582a8 -17.255,201,6.3,c84bddf582a8 -17.366,201,3.8,c84bddf582a8 -17.474,201,4.6,c84bddf582a8 -17.581,201,4.3,225f56282b82 -17.689,201,5.1,225f56282b82 -17.794,201,8.6,225f56282b82 -17.905,201,6.8,225f56282b82 -18.017,201,5.4,225f56282b82 -18.127,201,6.6,225f56282b82 -18.238,201,4.9,225f56282b82 -18.348,201,4.8,225f56282b82 -18.454,201,4.4,c84bddf582a8 -18.562,201,4.5,c84bddf582a8 -18.671,201,5.9,c84bddf582a8 -18.781,201,4.5,c84bddf582a8 -18.891,201,4.1,c84bddf582a8 -18.999,201,3.5,c84bddf582a8 -19.108,201,3.8,c84bddf582a8 -19.216,201,2.8,c84bddf582a8 -19.32,201,4.7,225f56282b82 -19.425,201,7.1,225f56282b82 -19.534,201,2.8,c84bddf582a8 -19.641,201,2.7,c84bddf582a8 -19.748,201,4.3,c84bddf582a8 -19.857,201,2.8,c84bddf582a8 -19.964,201,4.1,c84bddf582a8 -20.073,201,4.2,225f56282b82 -20.182,201,7.1,225f56282b82 -20.29,201,3.5,225f56282b82 -20.395,201,6.1,225f56282b82 -20.506,201,6.0,225f56282b82 -20.616,201,4.8,225f56282b82 -20.721,201,4.6,c84bddf582a8 -20.828,201,8.0,c84bddf582a8 -20.937,201,3.7,c84bddf582a8 -21.045,201,4.8,c84bddf582a8 -21.15,201,3.5,225f56282b82 -21.257,201,3.8,225f56282b82 -21.362,201,6.5,c84bddf582a8 -21.471,201,4.1,c84bddf582a8 -21.581,201,5.1,c84bddf582a8 -21.691,201,7.2,c84bddf582a8 -21.802,201,5.7,c84bddf582a8 -21.909,201,7.8,c84bddf582a8 -22.021,201,7.3,c84bddf582a8 -22.129,201,4.3,c84bddf582a8 -22.236,201,3.6,c84bddf582a8 -22.344,201,6.8,c84bddf582a8 -22.453,201,3.7,225f56282b82 -22.562,201,6.0,c84bddf582a8 -22.671,201,10.5,c84bddf582a8 -22.782,201,4.2,225f56282b82 -22.891,201,5.0,225f56282b82 -23.001,201,5.1,225f56282b82 -23.11,201,7.3,225f56282b82 -23.221,201,6.1,225f56282b82 -23.332,201,4.1,225f56282b82 -23.441,201,4.1,225f56282b82 -23.549,201,3.8,225f56282b82 -23.655,201,3.8,225f56282b82 -23.764,201,4.1,c84bddf582a8 -23.869,201,3.5,c84bddf582a8 -23.977,201,5.2,c84bddf582a8 -24.087,201,5.8,c84bddf582a8 -24.196,201,7.2,c84bddf582a8 -24.308,201,22.3,225f56282b82 -24.432,201,3.8,225f56282b82 -24.537,201,7.6,225f56282b82 -24.647,201,5.3,225f56282b82 -24.753,201,6.5,225f56282b82 -24.86,201,9.4,c84bddf582a8 -24.972,201,5.8,c84bddf582a8 -25.078,201,9.4,c84bddf582a8 -25.191,201,4.1,c84bddf582a8 -25.3,201,3.5,c84bddf582a8 -25.408,201,13.2,c84bddf582a8 -25.527,201,4.8,225f56282b82 -25.634,201,5.6,225f56282b82 -25.742,201,5.3,c84bddf582a8 -25.848,201,6.7,c84bddf582a8 -25.956,201,5.0,c84bddf582a8 -26.065,201,6.4,c84bddf582a8 -26.176,201,8.2,c84bddf582a8 -26.285,201,5.8,225f56282b82 -26.394,201,6.9,c84bddf582a8 -26.504,201,4.6,c84bddf582a8 -26.612,201,5.2,225f56282b82 -26.72,201,6.1,225f56282b82 -26.826,201,5.7,225f56282b82 -26.933,201,4.7,c84bddf582a8 -27.042,201,6.7,c84bddf582a8 -27.154,201,7.3,225f56282b82 -27.266,201,5.0,225f56282b82 -27.374,201,4.1,225f56282b82 -27.48,201,5.5,c84bddf582a8 -27.59,201,4.6,c84bddf582a8 -27.698,201,5.0,c84bddf582a8 -27.808,201,6.7,c84bddf582a8 -27.916,201,7.2,c84bddf582a8 -28.028,201,6.7,c84bddf582a8 -28.136,201,4.0,c84bddf582a8 -28.24,201,4.6,225f56282b82 -28.347,201,5.2,225f56282b82 -28.453,201,3.8,c84bddf582a8 -28.559,201,7.7,c84bddf582a8 -28.671,201,4.8,c84bddf582a8 -28.78,201,5.1,c84bddf582a8 -28.888,201,3.5,c84bddf582a8 -28.995,201,4.8,c84bddf582a8 -29.104,201,4.0,c84bddf582a8 -29.208,201,3.8,225f56282b82 -29.317,201,4.1,225f56282b82 -29.426,201,7.7,225f56282b82 -29.537,201,3.6,225f56282b82 -29.642,201,7.8,c84bddf582a8 -29.755,201,10.9,225f56282b82 -29.87,201,10.3,c84bddf582a8 -29.984,201,4.3,c84bddf582a8 -30.094,201,6.8,c84bddf582a8 -30.206,201,9.4,c84bddf582a8 -30.319,201,4.9,c84bddf582a8 -30.428,201,8.0,c84bddf582a8 -30.541,201,9.4,c84bddf582a8 -30.655,201,5.5,225f56282b82 -30.763,201,5.2,c84bddf582a8 -30.869,201,4.1,c84bddf582a8 -30.978,201,6.0,c84bddf582a8 -31.085,201,3.9,225f56282b82 -31.192,201,6.2,225f56282b82 -31.299,201,4.3,225f56282b82 -31.408,201,3.1,225f56282b82 -31.515,201,3.6,225f56282b82 -31.622,201,4.4,c84bddf582a8 -31.731,201,4.3,c84bddf582a8 -31.839,201,4.8,c84bddf582a8 -31.945,201,7.7,c84bddf582a8 -32.055,201,4.4,c84bddf582a8 -32.161,201,4.3,225f56282b82 -32.27,201,4.6,225f56282b82 -32.375,201,4.4,c84bddf582a8 -32.482,201,4.4,c84bddf582a8 -32.587,201,10.7,c84bddf582a8 -32.701,201,4.3,c84bddf582a8 -32.808,201,4.1,c84bddf582a8 -32.916,201,4.5,c84bddf582a8 -33.021,201,3.0,225f56282b82 -33.127,201,5.1,225f56282b82 -33.235,201,3.7,225f56282b82 -33.342,201,4.5,c84bddf582a8 -33.452,201,2.9,c84bddf582a8 -33.557,201,4.4,c84bddf582a8 -33.666,201,3.5,c84bddf582a8 -33.774,201,4.1,c84bddf582a8 -33.883,201,3.2,225f56282b82 -33.988,201,4.4,225f56282b82 -34.094,201,4.1,c84bddf582a8 -34.203,201,3.9,c84bddf582a8 -34.312,201,4.0,c84bddf582a8 -34.417,201,3.7,c84bddf582a8 -34.521,201,3.9,225f56282b82 -34.629,201,3.4,225f56282b82 -34.734,201,3.8,c84bddf582a8 -34.838,201,4.2,c84bddf582a8 -34.946,201,4.2,c84bddf582a8 -35.055,201,3.3,c84bddf582a8 -35.159,201,3.0,225f56282b82 -35.262,201,4.4,c84bddf582a8 -35.371,201,4.3,c84bddf582a8 -35.476,201,3.9,c84bddf582a8 -35.581,201,9.5,225f56282b82 -35.692,201,6.0,225f56282b82 -35.8,201,4.5,225f56282b82 -35.908,201,4.1,225f56282b82 -36.013,201,5.1,c84bddf582a8 -36.12,201,2.6,c84bddf582a8 -36.224,201,4.0,225f56282b82 -36.33,201,4.5,225f56282b82 -36.437,201,4.0,225f56282b82 -36.546,201,6.1,225f56282b82 -36.654,201,3.1,c84bddf582a8 -36.759,201,10.6,c84bddf582a8 -36.87,201,4.4,c84bddf582a8 -36.979,201,7.8,c84bddf582a8 -37.089,201,4.4,c84bddf582a8 -37.196,201,4.2,c84bddf582a8 -37.305,201,5.6,c84bddf582a8 -37.413,201,5.3,225f56282b82 -37.521,201,3.9,225f56282b82 -37.627,201,6.7,225f56282b82 -37.735,201,5.6,225f56282b82 -37.841,201,9.5,225f56282b82 -37.952,201,5.2,c84bddf582a8 -38.062,201,4.6,c84bddf582a8 -38.17,201,5.2,c84bddf582a8 -38.28,201,4.0,c84bddf582a8 -38.386,201,4.8,c84bddf582a8 -38.493,201,7.4,c84bddf582a8 -38.601,201,5.3,225f56282b82 -38.712,201,5.0,225f56282b82 -38.82,201,5.6,225f56282b82 -38.931,201,3.6,225f56282b82 -39.039,201,4.4,225f56282b82 -39.148,201,6.3,225f56282b82 -39.255,201,5.8,225f56282b82 -39.363,201,4.7,c84bddf582a8 -39.469,201,4.3,c84bddf582a8 -39.577,201,7.1,c84bddf582a8 -39.689,201,4.5,c84bddf582a8 -39.796,201,4.7,c84bddf582a8 -39.905,201,4.3,c84bddf582a8 -40.014,201,4.6,c84bddf582a8 -40.12,201,4.6,225f56282b82 -40.225,201,6.3,225f56282b82 -40.334,201,4.3,c84bddf582a8 -40.442,201,8.2,225f56282b82 -40.551,201,9.3,c84bddf582a8 -40.661,201,5.7,c84bddf582a8 -40.769,201,3.6,c84bddf582a8 -40.877,201,5.9,c84bddf582a8 -40.988,201,3.5,c84bddf582a8 -41.096,201,4.9,c84bddf582a8 -41.201,201,4.7,225f56282b82 -41.31,201,4.8,225f56282b82 -41.42,201,4.7,225f56282b82 -41.527,201,5.9,225f56282b82 -41.638,201,5.6,225f56282b82 -41.748,201,4.5,225f56282b82 -41.857,201,4.3,225f56282b82 -41.962,201,6.6,c84bddf582a8 -42.069,201,7.3,c84bddf582a8 -42.178,201,7.0,c84bddf582a8 -42.287,201,4.5,c84bddf582a8 -42.391,201,8.2,225f56282b82 -42.501,201,11.0,c84bddf582a8 -42.616,201,4.0,c84bddf582a8 -42.72,201,3.7,225f56282b82 -42.826,201,4.6,225f56282b82 -42.933,201,4.2,c84bddf582a8 -43.039,201,3.1,c84bddf582a8 -43.147,201,4.5,c84bddf582a8 -43.256,201,3.2,c84bddf582a8 -43.36,201,4.6,225f56282b82 -43.468,201,3.6,225f56282b82 -43.576,201,6.7,225f56282b82 -43.684,201,4.8,225f56282b82 -43.792,201,6.8,c84bddf582a8 -43.9,201,4.5,c84bddf582a8 -44.01,201,7.4,c84bddf582a8 -44.119,201,4.5,c84bddf582a8 -44.225,201,7.8,c84bddf582a8 -44.338,201,4.8,c84bddf582a8 -44.448,201,3.6,c84bddf582a8 -44.556,201,7.3,c84bddf582a8 -44.664,201,4.3,225f56282b82 -44.773,201,10.1,225f56282b82 -44.884,201,4.7,225f56282b82 -44.993,201,15.3,c84bddf582a8 -45.11,201,7.1,c84bddf582a8 -45.218,201,5.3,c84bddf582a8 -45.325,201,14.8,225f56282b82 -45.445,201,10.3,225f56282b82 -45.559,201,17.9,225f56282b82 -45.68,201,6.3,c84bddf582a8 -45.787,201,4.4,c84bddf582a8 -45.896,201,5.8,c84bddf582a8 -46.007,201,10.2,c84bddf582a8 -46.12,201,4.1,c84bddf582a8 -46.227,201,8.3,c84bddf582a8 -46.336,201,5.2,c84bddf582a8 -46.445,201,6.8,c84bddf582a8 -46.556,201,4.6,c84bddf582a8 -46.664,201,6.0,c84bddf582a8 -46.774,201,4.1,225f56282b82 -46.883,201,4.7,225f56282b82 -46.992,201,4.1,225f56282b82 -47.1,201,4.3,225f56282b82 -47.208,201,6.1,225f56282b82 -47.314,201,4.1,c84bddf582a8 -47.419,201,2.9,c84bddf582a8 -47.524,201,11.4,c84bddf582a8 -47.638,201,15.9,c84bddf582a8 -47.758,201,9.3,225f56282b82 -47.869,201,7.7,225f56282b82 -47.977,201,26.9,225f56282b82 -48.107,201,11.2,225f56282b82 -48.222,201,27.8,c84bddf582a8 -48.355,201,4.3,225f56282b82 -48.464,201,4.3,c84bddf582a8 -48.573,201,5.0,225f56282b82 -48.683,201,4.5,225f56282b82 -48.792,201,7.6,225f56282b82 -48.904,201,3.3,c84bddf582a8 -49.01,201,4.9,225f56282b82 -49.117,201,3.9,225f56282b82 -49.226,201,7.5,225f56282b82 -49.338,201,4.0,225f56282b82 -49.446,201,6.0,225f56282b82 -49.556,201,4.3,225f56282b82 -49.664,201,4.1,c84bddf582a8 -49.771,201,4.6,c84bddf582a8 -49.877,201,8.3,c84bddf582a8 -49.985,201,9.9,c84bddf582a8 -50.097,201,21.3,225f56282b82 -50.22,201,3.8,225f56282b82 -50.325,201,8.1,c84bddf582a8 -50.438,201,4.5,225f56282b82 -50.547,201,4.4,225f56282b82 -50.652,201,4.0,c84bddf582a8 -50.758,201,7.2,c84bddf582a8 -50.868,201,4.5,c84bddf582a8 -50.975,201,8.0,c84bddf582a8 -51.089,201,5.0,c84bddf582a8 -51.195,201,6.1,c84bddf582a8 -51.306,201,4.1,c84bddf582a8 -51.412,201,5.8,225f56282b82 -51.523,201,4.2,225f56282b82 -51.629,201,5.5,225f56282b82 -51.736,201,4.8,225f56282b82 -51.844,201,5.9,225f56282b82 -51.953,201,4.2,c84bddf582a8 -52.061,201,13.5,225f56282b82 -52.179,201,4.6,225f56282b82 -52.287,201,7.7,225f56282b82 -52.399,201,5.2,225f56282b82 -52.509,201,7.9,225f56282b82 -52.622,201,5.0,225f56282b82 -52.731,201,7.5,225f56282b82 -52.842,201,7.4,225f56282b82 -52.952,201,4.8,225f56282b82 -53.062,201,6.1,225f56282b82 -53.173,201,4.0,225f56282b82 -53.282,201,5.5,225f56282b82 -53.391,201,5.9,225f56282b82 -53.501,201,4.7,225f56282b82 -53.607,201,3.9,225f56282b82 -53.716,201,4.0,225f56282b82 -53.824,201,6.0,225f56282b82 -53.934,201,4.5,c84bddf582a8 -54.041,201,5.8,c84bddf582a8 -54.149,201,4.0,c84bddf582a8 -54.258,201,4.9,c84bddf582a8 -54.364,201,4.4,c84bddf582a8 -54.472,201,4.7,225f56282b82 -54.582,201,4.2,225f56282b82 -54.688,201,4.2,225f56282b82 -54.795,201,4.1,225f56282b82 -54.904,201,4.0,225f56282b82 -55.01,201,5.4,c84bddf582a8 -55.12,201,5.5,c84bddf582a8 -55.23,201,3.6,c84bddf582a8 -55.335,201,3.7,c84bddf582a8 -55.443,201,5.4,225f56282b82 -55.552,201,6.0,225f56282b82 -55.662,201,5.8,c84bddf582a8 -55.773,201,11.6,225f56282b82 -55.885,201,4.1,225f56282b82 -55.994,201,5.3,225f56282b82 -56.1,201,4.2,225f56282b82 -56.205,201,3.5,c84bddf582a8 -56.309,201,6.5,c84bddf582a8 -56.416,201,3.7,c84bddf582a8 -56.521,201,4.1,225f56282b82 -56.626,201,6.7,225f56282b82 -56.734,201,3.9,225f56282b82 -56.844,201,6.9,225f56282b82 -56.951,201,3.4,c84bddf582a8 -57.055,201,3.5,c84bddf582a8 -57.162,201,6.4,225f56282b82 -57.273,201,3.6,225f56282b82 -57.382,201,4.0,225f56282b82 -57.486,201,3.7,225f56282b82 -57.593,201,6.8,c84bddf582a8 -57.705,201,4.2,225f56282b82 -57.81,201,6.2,c84bddf582a8 -57.917,201,3.7,c84bddf582a8 -58.025,201,8.7,c84bddf582a8 -58.137,201,5.8,c84bddf582a8 -58.248,201,4.9,c84bddf582a8 -58.356,201,4.0,c84bddf582a8 -58.464,201,4.7,225f56282b82 -58.571,201,5.9,225f56282b82 -58.681,201,7.5,c84bddf582a8 -58.792,201,7.4,225f56282b82 -58.9,201,3.9,225f56282b82 -59.008,201,8.1,225f56282b82 -59.12,201,6.3,225f56282b82 -59.227,201,6.6,225f56282b82 -59.334,201,4.6,c84bddf582a8 -59.443,201,6.2,225f56282b82 -59.552,201,6.6,225f56282b82 -59.662,201,5.1,c84bddf582a8 -59.773,201,4.5,c84bddf582a8 -59.881,201,5.0,c84bddf582a8 -59.991,201,7.7,c84bddf582a8 -60.099,201,5.4,c84bddf582a8 -60.207,201,8.9,c84bddf582a8 -60.317,201,3.6,c84bddf582a8 -60.424,201,5.9,225f56282b82 -60.532,201,3.8,225f56282b82 -60.641,201,5.8,225f56282b82 -60.747,201,3.9,225f56282b82 -60.851,201,6.9,c84bddf582a8 -60.961,201,5.3,c84bddf582a8 -61.071,201,5.4,c84bddf582a8 -61.181,201,3.9,c84bddf582a8 -61.287,201,4.5,c84bddf582a8 -61.396,201,3.6,c84bddf582a8 -61.504,201,6.0,c84bddf582a8 -61.614,201,4.6,c84bddf582a8 -61.723,201,7.5,c84bddf582a8 -61.834,201,5.4,c84bddf582a8 -61.941,201,7.5,225f56282b82 -62.054,201,5.0,c84bddf582a8 -62.162,201,5.2,225f56282b82 -62.273,201,6.9,c84bddf582a8 -62.383,201,6.1,c84bddf582a8 -62.491,201,7.4,225f56282b82 -62.601,201,5.1,225f56282b82 -62.711,201,5.0,225f56282b82 -62.817,201,4.7,225f56282b82 -62.927,201,5.7,225f56282b82 -63.034,201,5.0,225f56282b82 -63.144,201,8.0,225f56282b82 -63.257,201,4.3,225f56282b82 -63.366,201,3.9,225f56282b82 -63.474,201,5.2,c84bddf582a8 -63.581,201,4.1,c84bddf582a8 -63.687,201,4.0,c84bddf582a8 -63.795,201,5.1,c84bddf582a8 -63.904,201,5.3,c84bddf582a8 -64.01,201,6.0,225f56282b82 -64.117,201,4.8,225f56282b82 -64.226,201,5.5,225f56282b82 -64.334,201,4.5,c84bddf582a8 -64.443,201,5.9,c84bddf582a8 -64.554,201,4.0,c84bddf582a8 -64.659,201,6.2,c84bddf582a8 -64.769,201,4.5,c84bddf582a8 -64.877,201,7.3,c84bddf582a8 -64.985,201,4.1,c84bddf582a8 -65.092,201,7.4,225f56282b82 -65.205,201,4.7,c84bddf582a8 -65.311,201,7.0,225f56282b82 -65.419,201,4.2,225f56282b82 -65.526,201,10.2,225f56282b82 -65.641,201,8.4,225f56282b82 -65.754,201,6.5,c84bddf582a8 -65.864,201,4.8,c84bddf582a8 -65.97,201,10.3,225f56282b82 -66.083,201,4.7,225f56282b82 -66.191,201,6.0,225f56282b82 -66.298,201,4.0,225f56282b82 -66.406,201,4.5,225f56282b82 -66.514,201,4.4,c84bddf582a8 -66.623,201,7.7,c84bddf582a8 -66.733,201,5.2,c84bddf582a8 -66.839,201,5.1,c84bddf582a8 -66.95,201,13.4,225f56282b82 -67.064,201,4.9,225f56282b82 -67.17,201,5.8,c84bddf582a8 -67.279,201,3.8,c84bddf582a8 -67.387,201,5.6,c84bddf582a8 -67.496,201,3.5,c84bddf582a8 -67.604,201,4.8,c84bddf582a8 -67.714,201,4.3,225f56282b82 -67.819,201,4.9,225f56282b82 -67.928,201,4.6,225f56282b82 -68.034,201,7.7,225f56282b82 -68.143,201,6.3,c84bddf582a8 -68.25,201,5.3,c84bddf582a8 -68.358,201,6.0,c84bddf582a8 -68.466,201,3.8,c84bddf582a8 -68.57,201,4.6,225f56282b82 -68.68,201,3.9,225f56282b82 -68.787,201,3.5,225f56282b82 -68.896,201,4.0,225f56282b82 -69.005,201,5.1,225f56282b82 -69.115,201,6.4,225f56282b82 -69.223,201,7.1,225f56282b82 -69.334,201,5.2,225f56282b82 -69.444,201,5.2,c84bddf582a8 -69.555,201,4.3,225f56282b82 -69.659,201,5.5,c84bddf582a8 -69.766,201,5.6,c84bddf582a8 -69.874,201,4.4,225f56282b82 -69.982,201,23.4,c84bddf582a8 -70.108,201,11.4,c84bddf582a8 -70.224,201,26.4,c84bddf582a8 -70.356,201,3.3,c84bddf582a8 -70.459,201,5.9,225f56282b82 -70.565,201,4.5,225f56282b82 -70.673,201,3.7,c84bddf582a8 -70.777,201,5.8,c84bddf582a8 -70.884,201,3.4,225f56282b82 -70.989,201,3.8,225f56282b82 -71.098,201,4.1,225f56282b82 -71.207,201,5.5,225f56282b82 -71.316,201,4.7,225f56282b82 -71.426,201,3.0,225f56282b82 -71.534,201,6.8,225f56282b82 -71.645,201,10.6,225f56282b82 -71.756,201,3.0,225f56282b82 -71.862,201,12.1,c84bddf582a8 -71.974,201,4.6,225f56282b82 -72.084,201,5.5,225f56282b82 -72.191,201,4.1,c84bddf582a8 -72.3,201,4.6,c84bddf582a8 -72.409,201,4.2,c84bddf582a8 -72.514,201,4.1,c84bddf582a8 -72.62,201,4.9,225f56282b82 -72.729,201,4.0,225f56282b82 -72.838,201,5.6,225f56282b82 -72.945,201,5.0,c84bddf582a8 -73.051,201,4.1,c84bddf582a8 -73.158,201,4.9,c84bddf582a8 -73.267,201,4.4,c84bddf582a8 -73.374,201,5.9,225f56282b82 -73.483,201,5.4,225f56282b82 -73.589,201,6.9,225f56282b82 -73.701,201,5.7,225f56282b82 -73.808,201,5.0,225f56282b82 -73.914,201,5.3,225f56282b82 -74.024,201,4.6,225f56282b82 -74.133,201,5.9,225f56282b82 -74.241,201,3.9,c84bddf582a8 -74.35,201,4.9,c84bddf582a8 -74.46,201,3.7,c84bddf582a8 -74.568,201,4.4,c84bddf582a8 -74.676,201,5.0,c84bddf582a8 -74.782,201,4.0,225f56282b82 -74.887,201,3.4,225f56282b82 -74.993,201,5.2,225f56282b82 -75.102,201,5.3,c84bddf582a8 -75.209,201,5.8,225f56282b82 -75.318,201,4.6,c84bddf582a8 -75.423,201,4.6,225f56282b82 +-25.945,201,19.9,3e62ff0322c6 +-25.824,201,8.2,3e741644dba4 +-25.714,201,20.9,3e62ff0322c6 +-25.591,201,5.5,3e741644dba4 +-25.482,201,6.4,3e62ff0322c6 +-25.374,201,20.4,3e741644dba4 +-25.244,201,5.6,3e62ff0322c6 +-25.132,201,4.4,3e741644dba4 +-25.026,201,5.0,3e62ff0322c6 +-24.917,201,4.5,3e741644dba4 +-24.803,201,5.9,3e741644dba4 +-24.688,201,5.2,3e741644dba4 +-24.582,201,3.7,3e741644dba4 +-24.471,201,3.4,3e741644dba4 +-24.366,201,4.8,3e741644dba4 +-24.257,201,4.7,3e741644dba4 +-24.15,201,11.9,3e62ff0322c6 +-24.038,201,13.9,3e741644dba4 +-23.919,201,4.8,3e741644dba4 +-23.807,201,6.6,3e62ff0322c6 +-23.692,201,5.2,3e62ff0322c6 +-23.582,201,11.6,3e62ff0322c6 +-23.461,201,4.5,3e741644dba4 +-23.355,201,3.5,3e741644dba4 +-23.244,201,3.7,3e741644dba4 +-23.134,201,5.0,3e741644dba4 +-23.019,201,3.3,3e741644dba4 +-22.913,201,3.5,3e741644dba4 +-22.803,201,5.1,3e741644dba4 +-22.692,201,6.2,3e741644dba4 +-22.585,201,3.7,3e741644dba4 +-22.479,201,4.0,3e62ff0322c6 +-22.369,201,4.9,3e62ff0322c6 +-22.257,201,5.3,3e741644dba4 +-22.142,201,5.4,3e741644dba4 +-22.032,201,5.5,3e741644dba4 +-21.923,201,4.7,3e741644dba4 +-21.812,201,5.3,3e741644dba4 +-21.702,201,3.3,3e741644dba4 +-21.591,201,5.7,3e741644dba4 +-21.475,201,6.0,3e62ff0322c6 +-21.367,201,5.6,3e741644dba4 +-21.252,201,5.3,3e62ff0322c6 +-21.142,201,4.5,3e62ff0322c6 +-21.029,201,4.1,3e62ff0322c6 +-20.924,201,4.0,3e62ff0322c6 +-20.814,201,3.3,3e62ff0322c6 +-20.71,201,9.2,3e62ff0322c6 +-20.592,201,7.9,3e62ff0322c6 +-20.479,201,23.7,3e62ff0322c6 +-20.352,201,6.3,3e62ff0322c6 +-20.236,201,7.7,3e741644dba4 +-20.118,201,5.2,3e62ff0322c6 +-20.007,201,5.0,3e62ff0322c6 +-19.899,201,3.6,3e741644dba4 +-19.786,201,3.0,3e62ff0322c6 +-19.674,201,4.1,3e62ff0322c6 +-19.56,201,5.0,3e62ff0322c6 +-19.445,201,4.6,3e741644dba4 +-19.334,201,3.9,3e741644dba4 +-19.228,201,6.3,3e741644dba4 +-19.119,201,5.3,3e62ff0322c6 +-19.01,201,3.5,3e62ff0322c6 +-18.901,201,3.1,3e62ff0322c6 +-18.792,201,3.9,3e62ff0322c6 +-18.678,201,4.5,3e741644dba4 +-18.567,201,5.4,3e741644dba4 +-18.454,201,6.1,3e741644dba4 +-18.339,201,5.6,3e741644dba4 +-18.228,201,4.0,3e741644dba4 +-18.115,201,3.7,3e62ff0322c6 +-18.01,201,3.0,3e741644dba4 +-17.903,201,5.3,3e741644dba4 +-17.788,201,4.9,3e62ff0322c6 +-17.675,201,4.6,3e62ff0322c6 +-17.568,201,9.1,3e62ff0322c6 +-17.45,201,4.6,3e62ff0322c6 +-17.336,201,4.8,3e741644dba4 +-17.221,201,3.9,3e741644dba4 +-17.109,201,3.2,3e741644dba4 +-16.996,201,5.4,3e62ff0322c6 +-16.881,201,5.9,3e62ff0322c6 +-16.774,201,5.8,3e62ff0322c6 +-16.663,201,4.6,3e62ff0322c6 +-16.553,201,4.2,3e62ff0322c6 +-16.439,201,3.2,3e62ff0322c6 +-16.33,201,4.5,3e62ff0322c6 +-16.217,201,4.1,3e741644dba4 +-16.106,201,4.9,3e741644dba4 +-15.996,201,5.4,3e741644dba4 +-15.882,201,4.8,3e741644dba4 +-15.774,201,6.2,3e741644dba4 +-15.66,201,3.8,3e741644dba4 +-15.55,201,3.8,3e741644dba4 +-15.439,201,3.4,3e741644dba4 +-15.327,201,3.9,3e62ff0322c6 +-15.214,201,5.3,3e62ff0322c6 +-15.101,201,4.1,3e62ff0322c6 +-14.993,201,4.1,3e741644dba4 +-14.884,201,4.9,3e741644dba4 +-14.771,201,5.5,3e741644dba4 +-14.659,201,5.1,3e741644dba4 +-14.549,201,6.0,3e741644dba4 +-14.434,201,4.0,3e62ff0322c6 +-14.325,201,4.3,3e62ff0322c6 +-14.213,201,4.0,3e62ff0322c6 +-14.104,201,4.8,3e62ff0322c6 +-13.994,201,4.8,3e62ff0322c6 +-13.882,201,8.7,3e62ff0322c6 +-13.772,201,3.4,3e62ff0322c6 +-13.661,201,2.9,3e62ff0322c6 +-13.55,201,3.2,3e62ff0322c6 +-13.445,201,4.1,3e62ff0322c6 +-13.331,201,4.8,3e62ff0322c6 +-13.219,201,4.7,3e62ff0322c6 +-13.104,201,4.0,3e741644dba4 +-12.993,201,4.0,3e741644dba4 +-12.882,201,3.8,3e741644dba4 +-12.771,201,3.3,3e741644dba4 +-12.662,201,4.0,3e741644dba4 +-12.551,201,5.9,3e741644dba4 +-12.438,201,4.9,3e741644dba4 +-12.323,201,5.1,3e62ff0322c6 +-12.213,201,5.2,3e62ff0322c6 +-12.1,201,4.1,3e62ff0322c6 +-11.986,201,4.2,3e741644dba4 +-11.875,201,3.8,3e741644dba4 +-11.768,201,2.8,3e62ff0322c6 +-11.66,201,3.1,3e62ff0322c6 +-11.547,201,4.6,3e62ff0322c6 +-11.438,201,3.9,3e62ff0322c6 +-11.324,201,5.1,3e741644dba4 +-11.216,201,4.4,3e741644dba4 +-11.109,201,4.8,3e62ff0322c6 +-11.002,201,3.5,3e62ff0322c6 +-10.895,201,3.6,3e62ff0322c6 +-10.787,201,5.9,3e62ff0322c6 +-10.675,201,5.0,3e62ff0322c6 +-10.562,201,4.7,3e62ff0322c6 +-10.454,201,3.6,3e62ff0322c6 +-10.34,201,4.2,3e62ff0322c6 +-10.229,201,3.5,3e62ff0322c6 +-10.115,201,3.3,3e741644dba4 +-10.002,201,3.6,3e741644dba4 +-9.893,201,5.2,3e741644dba4 +-9.78,201,5.0,3e741644dba4 +-9.665,201,4.7,3e62ff0322c6 +-9.559,201,3.5,3e741644dba4 +-9.452,201,4.3,3e741644dba4 +-9.337,201,4.5,3e741644dba4 +-9.231,201,3.0,3e741644dba4 +-9.124,201,3.4,3e62ff0322c6 +-9.011,201,6.3,3e741644dba4 +-8.9,201,4.7,3e741644dba4 +-8.786,201,5.2,3e62ff0322c6 +-8.676,201,5.1,3e62ff0322c6 +-8.57,201,6.9,3e741644dba4 +-8.46,201,4.6,3e741644dba4 +-8.355,201,5.1,3e741644dba4 +-8.248,201,7.0,3e62ff0322c6 +-8.134,201,5.4,3e741644dba4 +-8.024,201,4.9,3e741644dba4 +-7.909,201,4.6,3e741644dba4 +-7.802,201,4.1,3e741644dba4 +-7.691,201,5.5,3e741644dba4 +-7.58,201,5.6,3e741644dba4 +-7.469,201,5.1,3e741644dba4 +-7.354,201,3.8,3e62ff0322c6 +-7.24,201,3.7,3e62ff0322c6 +-7.129,201,6.2,3e62ff0322c6 +-7.016,201,5.1,3e741644dba4 +-6.905,201,5.2,3e741644dba4 +-6.797,201,5.4,3e62ff0322c6 +-6.683,201,4.5,3e741644dba4 +-6.572,201,4.7,3e741644dba4 +-6.461,201,4.9,3e741644dba4 +-6.35,201,4.1,3e741644dba4 +-6.244,201,3.9,3e741644dba4 +-6.13,201,5.0,3e741644dba4 +-6.023,201,4.8,3e741644dba4 +-5.911,201,4.4,3e741644dba4 +-5.805,201,5.1,3e741644dba4 +-5.69,201,4.7,3e741644dba4 +-5.576,201,4.6,3e62ff0322c6 +-5.466,201,4.3,3e62ff0322c6 +-5.354,201,3.5,3e62ff0322c6 +-5.241,201,5.2,3e62ff0322c6 +-5.132,201,4.1,3e62ff0322c6 +-5.02,201,4.8,3e62ff0322c6 +-4.905,201,4.9,3e741644dba4 +-4.791,201,5.9,3e741644dba4 +-4.677,201,5.0,3e741644dba4 +-4.562,201,3.3,3e62ff0322c6 +-4.449,201,4.8,3e62ff0322c6 +-4.344,201,4.7,3e62ff0322c6 +-4.232,201,4.8,3e62ff0322c6 +-4.119,201,4.5,3e62ff0322c6 +-4.006,201,4.6,3e741644dba4 +-3.895,201,4.4,3e741644dba4 +-3.79,201,3.4,3e62ff0322c6 +-3.677,201,4.3,3e62ff0322c6 +-3.568,201,5.8,3e741644dba4 +-3.459,201,6.4,3e62ff0322c6 +-3.343,201,3.2,3e741644dba4 +-3.23,201,4.2,3e741644dba4 +-3.115,201,4.4,3e62ff0322c6 +-3.008,201,3.2,3e741644dba4 +-2.895,201,3.4,3e62ff0322c6 +-2.785,201,3.5,3e62ff0322c6 +-2.68,201,4.7,3e741644dba4 +-2.566,201,4.9,3e62ff0322c6 +-2.459,201,4.6,3e741644dba4 +-2.348,201,5.7,3e741644dba4 +-2.24,201,5.1,3e741644dba4 +-2.131,201,8.5,3e741644dba4 +-2.017,201,4.2,3e741644dba4 +-1.903,201,4.1,3e62ff0322c6 +-1.798,201,5.8,3e741644dba4 +-1.686,201,6.2,3e62ff0322c6 +-1.57,201,6.2,3e62ff0322c6 +-1.462,201,4.3,3e62ff0322c6 +-1.35,201,5.0,3e62ff0322c6 +-1.239,201,5.8,3e62ff0322c6 +-1.13,201,5.2,3e62ff0322c6 +-1.021,201,4.3,3e62ff0322c6 +-0.911,201,7.2,3e62ff0322c6 +-0.8,201,5.5,3e62ff0322c6 +-0.688,201,6.6,3e741644dba4 +-0.573,201,4.9,3e741644dba4 +-0.46,201,4.6,3e741644dba4 +-0.345,201,5.1,3e62ff0322c6 +-0.231,201,3.9,3e62ff0322c6 +-0.126,201,3.7,3e62ff0322c6 +-0.014,201,19.7,3e741644dba4 +0.107,201,7.3,3e741644dba4 +0.215,201,32.2,3e741644dba4 +0.353,201,4.7,3e741644dba4 +0.46,201,4.1,3e741644dba4 +0.565,201,5.1,3e741644dba4 +0.68,201,5.1,3e741644dba4 +0.791,201,6.8,3e741644dba4 +0.898,201,9.9,3e741644dba4 +1.012,201,4.3,3e741644dba4 +1.123,201,4.3,3e741644dba4 +1.231,201,4.2,3e741644dba4 +1.339,201,4.0,3e741644dba4 +1.446,201,3.9,3e741644dba4 +1.56,201,5.6,3e741644dba4 +1.673,201,4.1,3e741644dba4 +1.785,201,6.7,3e62ff0322c6 +1.9,201,7.2,3e62ff0322c6 +2.018,201,5.3,3e741644dba4 +2.129,201,4.3,3e741644dba4 +2.241,201,6.5,3e741644dba4 +2.352,201,5.6,3e741644dba4 +2.459,201,3.4,3e741644dba4 +2.564,201,12.1,3e741644dba4 +2.676,201,3.1,3e741644dba4 +2.787,201,4.4,3e62ff0322c6 +2.895,201,5.3,3e62ff0322c6 +3.011,201,3.9,3e62ff0322c6 +3.12,201,7.5,3e62ff0322c6 +3.234,201,5.5,6c2a02267340 +3.347,201,4.1,6c2a02267340 +3.452,201,6.4,3e62ff0322c6 +3.567,201,4.3,6c2a02267340 +3.673,201,3.9,6c2a02267340 +3.778,201,3.4,6c2a02267340 +3.886,201,6.1,3e62ff0322c6 +3.996,201,4.5,3e62ff0322c6 +4.11,201,6.3,3e62ff0322c6 +4.226,201,5.3,6c2a02267340 +4.337,201,5.4,6c2a02267340 +4.452,201,3.5,3e62ff0322c6 +4.561,201,4.9,3e62ff0322c6 +4.67,201,7.8,3e62ff0322c6 +4.784,201,4.7,6c2a02267340 +4.893,201,4.7,3e62ff0322c6 +5.0,201,7.9,3e62ff0322c6 +5.112,201,4.4,3e62ff0322c6 +5.217,201,11.6,3e62ff0322c6 +5.329,201,3.7,3e62ff0322c6 +5.441,201,4.2,3e62ff0322c6 +5.546,201,3.2,3e62ff0322c6 +5.655,201,3.8,3e62ff0322c6 +5.759,201,6.2,6c2a02267340 +5.874,201,5.1,3e62ff0322c6 +5.989,201,4.3,3e62ff0322c6 +6.103,201,5.7,3e62ff0322c6 +6.218,201,5.3,6c2a02267340 +6.328,201,3.2,6c2a02267340 +6.434,201,5.9,6c2a02267340 +6.548,201,4.1,3e62ff0322c6 +6.655,201,3.8,3e62ff0322c6 +6.766,201,5.4,3e62ff0322c6 +6.877,201,3.6,3e62ff0322c6 +6.988,201,4.0,158dfc1bd95d +7.093,201,4.0,6c2a02267340 +7.204,201,5.2,158dfc1bd95d +7.31,201,504.8,6c2a02267340 +7.921,201,4.3,158dfc1bd95d +8.027,201,5.6,6c2a02267340 +8.139,201,4.0,6c2a02267340 +8.253,201,5.2,158dfc1bd95d +8.363,201,4.3,6c2a02267340 +8.474,201,3.4,6c2a02267340 +8.585,201,6.7,6c2a02267340 +8.698,201,4.0,158dfc1bd95d +8.809,201,6.3,158dfc1bd95d +8.923,201,5.1,158dfc1bd95d +9.03,201,4.6,158dfc1bd95d +9.144,201,5.1,6c2a02267340 +9.257,201,4.8,6c2a02267340 +9.366,201,3.4,6c2a02267340 +9.47,201,4.8,158dfc1bd95d +9.583,201,5.7,6c2a02267340 +9.697,201,3.5,6c2a02267340 +9.807,201,4.5,6c2a02267340 +9.921,201,4.0,6c2a02267340 +10.032,201,4.7,6c2a02267340 +10.145,201,3.3,158dfc1bd95d +10.256,201,2.9,158dfc1bd95d +10.368,201,4.4,158dfc1bd95d +10.473,201,4.0,6c2a02267340 +10.579,201,5.5,6c2a02267340 +10.695,201,5.0,158dfc1bd95d +10.806,201,6.2,158dfc1bd95d +10.913,201,4.9,158dfc1bd95d +11.028,201,3.7,158dfc1bd95d +11.136,201,4.4,158dfc1bd95d +11.247,201,5.2,158dfc1bd95d +11.352,201,5.8,158dfc1bd95d +11.464,201,5.4,158dfc1bd95d +11.578,201,5.0,158dfc1bd95d +11.688,201,3.4,158dfc1bd95d +11.802,201,3.8,158dfc1bd95d +11.914,201,3.2,6c2a02267340 +12.019,201,2.7,158dfc1bd95d +12.123,201,5.9,158dfc1bd95d +12.238,201,4.3,158dfc1bd95d +12.352,201,4.5,158dfc1bd95d +12.461,201,4.4,158dfc1bd95d +12.575,201,4.4,6c2a02267340 +12.682,201,4.2,158dfc1bd95d +12.796,201,4.8,6c2a02267340 +12.907,201,3.3,6c2a02267340 +13.012,201,3.5,158dfc1bd95d +13.124,201,4.2,6c2a02267340 +13.235,201,4.7,6c2a02267340 +13.344,201,4.9,6c2a02267340 +13.458,201,4.5,6c2a02267340 +13.573,201,5.5,6c2a02267340 +13.684,201,3.5,6c2a02267340 +13.79,201,3.1,6c2a02267340 +13.897,201,5.7,6c2a02267340 +14.013,201,3.7,6c2a02267340 +14.122,201,4.3,6c2a02267340 +14.229,201,5.1,6c2a02267340 +14.34,201,6.1,6c2a02267340 +14.453,201,4.5,6c2a02267340 +14.565,201,3.4,158dfc1bd95d +14.676,201,3.2,158dfc1bd95d +14.789,201,5.2,158dfc1bd95d +14.902,201,5.6,158dfc1bd95d +15.016,201,4.2,6c2a02267340 +15.124,201,4.4,158dfc1bd95d +15.233,201,4.6,6c2a02267340 +15.344,201,4.4,6c2a02267340 +15.458,201,3.3,6c2a02267340 +15.566,201,4.2,6c2a02267340 +15.679,201,3.6,6c2a02267340 +15.791,201,3.6,6c2a02267340 +15.9,201,4.3,6c2a02267340 +16.006,201,3.8,6c2a02267340 +16.118,201,5.4,6c2a02267340 +16.232,201,5.0,6c2a02267340 +16.347,201,3.9,158dfc1bd95d +16.456,201,3.3,158dfc1bd95d +16.566,201,4.9,158dfc1bd95d +16.674,201,4.6,158dfc1bd95d +16.789,201,4.9,158dfc1bd95d +16.895,201,4.5,158dfc1bd95d +17.008,201,6.2,158dfc1bd95d +17.12,201,5.5,158dfc1bd95d +17.231,201,3.2,158dfc1bd95d +17.344,201,4.8,6c2a02267340 +17.453,201,7.7,6c2a02267340 +17.567,201,6.1,6c2a02267340 +17.683,201,6.9,6c2a02267340 +17.791,201,3.3,6c2a02267340 +17.899,201,3.7,6c2a02267340 +18.004,201,4.2,6c2a02267340 +18.112,201,3.4,158dfc1bd95d +18.223,201,4.3,158dfc1bd95d +18.338,201,4.6,6c2a02267340 +18.453,201,5.4,158dfc1bd95d +18.562,201,3.9,6c2a02267340 +18.671,201,5.7,6c2a02267340 +18.783,201,5.7,6c2a02267340 +18.897,201,3.5,158dfc1bd95d +19.005,201,4.5,158dfc1bd95d +19.12,201,4.3,158dfc1bd95d +19.232,201,4.3,158dfc1bd95d +19.34,201,3.0,158dfc1bd95d +19.452,201,4.0,158dfc1bd95d +19.566,201,4.6,158dfc1bd95d +19.678,201,4.4,6c2a02267340 +19.793,201,3.1,6c2a02267340 +19.904,201,5.4,158dfc1bd95d +20.015,201,3.2,158dfc1bd95d +20.126,201,4.1,158dfc1bd95d +20.236,201,5.5,158dfc1bd95d +20.343,201,4.6,6c2a02267340 +20.455,201,4.3,6c2a02267340 +20.561,201,3.6,6c2a02267340 +20.672,201,3.7,6c2a02267340 +20.781,201,4.7,6c2a02267340 +20.89,201,3.9,6c2a02267340 +20.997,201,3.7,6c2a02267340 +21.106,201,5.0,6c2a02267340 +21.216,201,3.3,6c2a02267340 +21.322,201,5.6,6c2a02267340 +21.436,201,3.2,6c2a02267340 +21.548,201,3.4,6c2a02267340 +21.656,201,3.9,6c2a02267340 +21.768,201,4.3,6c2a02267340 +21.88,201,3.7,6c2a02267340 +21.992,201,3.6,6c2a02267340 +22.102,201,5.4,6c2a02267340 +22.209,201,3.5,6c2a02267340 +22.313,201,3.4,158dfc1bd95d +22.426,201,4.5,6c2a02267340 +22.538,201,5.5,6c2a02267340 +22.648,201,2.6,6c2a02267340 +22.759,201,3.8,6c2a02267340 +22.871,201,3.2,6c2a02267340 +22.98,201,5.2,6c2a02267340 +23.094,201,3.1,6c2a02267340 +23.198,201,4.2,6c2a02267340 +23.311,201,2.8,6c2a02267340 +23.419,201,5.6,6c2a02267340 +23.531,201,5.3,6c2a02267340 +23.645,201,3.2,158dfc1bd95d +23.757,201,5.9,158dfc1bd95d +23.871,201,2.8,158dfc1bd95d +23.981,201,2.9,158dfc1bd95d +24.088,201,3.0,158dfc1bd95d +24.199,201,3.5,158dfc1bd95d +24.313,201,4.9,158dfc1bd95d +24.425,201,4.5,6c2a02267340 +24.538,201,3.6,6c2a02267340 +24.652,201,5.1,6c2a02267340 +24.766,201,3.2,158dfc1bd95d +24.874,201,3.3,6c2a02267340 +24.983,201,3.0,6c2a02267340 +25.089,201,3.1,6c2a02267340 +25.193,201,4.0,158dfc1bd95d +25.3,201,4.7,158dfc1bd95d +25.407,201,5.9,158dfc1bd95d +25.517,201,5.9,158dfc1bd95d +25.628,201,5.1,158dfc1bd95d +25.739,201,3.5,158dfc1bd95d +25.851,201,4.0,158dfc1bd95d +25.963,201,3.2,158dfc1bd95d +26.073,201,4.1,158dfc1bd95d +26.186,201,6.6,6c2a02267340 +26.3,201,5.9,6c2a02267340 +26.406,201,4.1,6c2a02267340 +26.516,201,7.1,6c2a02267340 +26.63,201,2.9,6c2a02267340 +26.74,201,2.9,6c2a02267340 +26.852,201,4.6,6c2a02267340 +26.966,201,4.8,158dfc1bd95d +27.078,201,3.5,158dfc1bd95d +27.189,201,5.1,158dfc1bd95d +27.296,201,3.8,158dfc1bd95d +27.404,201,3.9,158dfc1bd95d +27.515,201,3.0,158dfc1bd95d +27.626,201,2.8,158dfc1bd95d +27.735,201,2.8,158dfc1bd95d +27.84,201,4.0,6c2a02267340 +27.955,201,5.0,158dfc1bd95d +28.061,201,4.6,6c2a02267340 +28.17,201,4.5,6c2a02267340 +28.285,201,8.6,158dfc1bd95d +28.399,201,3.6,158dfc1bd95d +28.504,201,4.1,6c2a02267340 +28.618,201,4.3,158dfc1bd95d +28.727,201,4.8,158dfc1bd95d +28.838,201,5.5,158dfc1bd95d +28.954,201,4.2,158dfc1bd95d +29.068,201,5.5,6c2a02267340 +29.183,201,4.6,6c2a02267340 +29.297,201,3.4,158dfc1bd95d +29.407,201,3.2,158dfc1bd95d +29.518,201,5.1,158dfc1bd95d +29.628,201,5.2,158dfc1bd95d +29.734,201,5.8,158dfc1bd95d +29.846,201,6.8,158dfc1bd95d +29.953,201,4.3,6c2a02267340 +30.058,201,3.5,6c2a02267340 +30.167,201,4.0,6c2a02267340 +30.281,201,3.0,6c2a02267340 +30.388,201,3.7,6c2a02267340 +30.498,201,3.5,6c2a02267340 +30.608,201,4.2,6c2a02267340 +30.713,201,4.3,158dfc1bd95d +30.822,201,4.1,158dfc1bd95d +30.936,201,3.6,6c2a02267340 +31.045,201,3.8,6c2a02267340 +31.149,201,3.4,158dfc1bd95d +31.258,201,2.9,158dfc1bd95d +31.368,201,3.9,158dfc1bd95d +31.481,201,4.2,158dfc1bd95d +31.59,201,8.9,158dfc1bd95d +31.706,201,4.3,6c2a02267340 +31.819,201,4.1,6c2a02267340 +31.933,201,3.1,6c2a02267340 +32.042,201,3.3,6c2a02267340 +32.155,201,3.3,6c2a02267340 +32.267,201,4.4,158dfc1bd95d +32.377,201,3.8,158dfc1bd95d +32.486,201,4.0,158dfc1bd95d +32.597,201,3.8,158dfc1bd95d +32.701,201,5.0,6c2a02267340 +32.816,201,4.8,158dfc1bd95d +32.924,201,4.8,158dfc1bd95d +33.033,201,3.6,6c2a02267340 +33.14,201,5.2,6c2a02267340 +33.255,201,6.5,158dfc1bd95d +33.368,201,4.3,158dfc1bd95d +33.474,201,5.1,158dfc1bd95d +33.589,201,3.6,158dfc1bd95d +33.698,201,3.7,158dfc1bd95d +33.807,201,5.5,158dfc1bd95d +33.922,201,4.2,158dfc1bd95d +34.027,201,3.4,158dfc1bd95d +34.134,201,5.8,158dfc1bd95d +34.246,201,5.4,158dfc1bd95d +34.358,201,4.2,158dfc1bd95d +34.463,201,3.9,6c2a02267340 +34.567,201,4.0,6c2a02267340 +34.675,201,4.8,6c2a02267340 +34.786,201,4.5,6c2a02267340 +34.9,201,3.9,6c2a02267340 +35.009,201,4.2,6c2a02267340 +35.116,201,4.5,6c2a02267340 +35.226,201,3.1,6c2a02267340 +35.338,201,3.1,6c2a02267340 +35.45,201,5.1,6c2a02267340 +35.561,201,7.4,158dfc1bd95d +35.679,201,4.5,158dfc1bd95d +35.79,201,4.7,158dfc1bd95d +35.897,201,5.5,158dfc1bd95d +36.009,201,4.5,158dfc1bd95d +36.12,201,3.2,158dfc1bd95d +36.225,201,4.2,158dfc1bd95d +36.333,201,4.0,6c2a02267340 +36.446,201,4.9,158dfc1bd95d +36.552,201,5.0,6c2a02267340 +36.663,201,4.7,6c2a02267340 +36.771,201,4.4,6c2a02267340 +36.884,201,5.6,158dfc1bd95d +36.996,201,3.1,158dfc1bd95d +37.103,201,4.5,6c2a02267340 +37.214,201,3.7,6c2a02267340 +37.323,201,5.1,158dfc1bd95d +37.438,201,5.6,158dfc1bd95d +37.551,201,4.9,158dfc1bd95d +37.664,201,4.8,6c2a02267340 +37.769,201,4.7,158dfc1bd95d +37.882,201,5.0,158dfc1bd95d +37.991,201,3.2,158dfc1bd95d +38.102,201,4.2,158dfc1bd95d +38.207,201,4.8,158dfc1bd95d +38.321,201,4.9,158dfc1bd95d +38.436,201,4.2,6c2a02267340 +38.551,201,4.7,6c2a02267340 +38.664,201,4.3,6c2a02267340 +38.776,201,4.1,158dfc1bd95d +38.888,201,3.7,158dfc1bd95d +38.993,201,3.9,6c2a02267340 +39.105,201,4.7,158dfc1bd95d +39.217,201,5.8,158dfc1bd95d +39.326,201,5.9,158dfc1bd95d +39.44,201,4.9,158dfc1bd95d +39.548,201,5.8,158dfc1bd95d +39.655,201,4.3,158dfc1bd95d +39.763,201,3.7,6c2a02267340 +39.87,201,5.3,6c2a02267340 +39.984,201,3.5,6c2a02267340 +40.088,201,6.0,6c2a02267340 +40.203,201,5.4,6c2a02267340 +40.312,201,4.3,6c2a02267340 +40.417,201,9.8,6c2a02267340 +40.534,201,5.0,158dfc1bd95d +40.64,201,2.7,6c2a02267340 +40.745,201,2.6,6c2a02267340 +40.858,201,4.9,6c2a02267340 +40.969,201,4.9,6c2a02267340 +41.075,201,4.5,6c2a02267340 +41.181,201,4.5,158dfc1bd95d +41.287,201,4.4,158dfc1bd95d +41.392,201,3.1,6c2a02267340 +41.501,201,4.8,6c2a02267340 +41.607,201,3.5,6c2a02267340 +41.719,201,2.9,6c2a02267340 +41.831,201,3.1,6c2a02267340 +41.943,201,2.6,6c2a02267340 +42.047,201,2.8,6c2a02267340 +42.156,201,3.7,6c2a02267340 +42.265,201,3.6,6c2a02267340 +42.379,201,3.2,6c2a02267340 +42.491,201,3.2,6c2a02267340 +42.598,201,3.6,6c2a02267340 +42.703,201,4.4,158dfc1bd95d +42.816,201,5.1,6c2a02267340 +42.922,201,3.2,158dfc1bd95d +43.028,201,3.3,158dfc1bd95d +43.133,201,3.5,6c2a02267340 +43.242,201,3.6,6c2a02267340 +43.346,201,3.1,6c2a02267340 +43.457,201,4.8,6c2a02267340 +43.565,201,4.9,6c2a02267340 +43.675,201,2.7,6c2a02267340 +43.781,201,2.5,158dfc1bd95d +43.892,201,2.5,158dfc1bd95d +44.002,201,3.5,158dfc1bd95d +44.115,201,2.7,6c2a02267340 +44.227,201,4.1,6c2a02267340 +44.336,201,8.3,6c2a02267340 +44.452,201,3.3,6c2a02267340 +44.561,201,2.8,6c2a02267340 +44.672,201,2.9,6c2a02267340 +44.775,201,2.7,6c2a02267340 +44.884,201,3.5,158dfc1bd95d +44.993,201,3.0,158dfc1bd95d +45.102,201,4.1,158dfc1bd95d +45.206,201,3.7,158dfc1bd95d +45.314,201,3.3,6c2a02267340 +45.419,201,3.4,6c2a02267340 +45.531,201,3.3,6c2a02267340 +45.636,201,3.0,6c2a02267340 +45.743,201,3.0,158dfc1bd95d +45.848,201,3.7,158dfc1bd95d +45.959,201,3.3,158dfc1bd95d +46.069,201,2.7,158dfc1bd95d +46.179,201,2.7,158dfc1bd95d +46.291,201,3.3,158dfc1bd95d +46.396,201,3.1,158dfc1bd95d +46.507,201,3.2,158dfc1bd95d +46.613,201,4.5,6c2a02267340 +46.726,201,2.8,158dfc1bd95d +46.834,201,3.7,6c2a02267340 +46.945,201,4.2,158dfc1bd95d +47.052,201,4.8,6c2a02267340 +47.164,201,3.5,6c2a02267340 +47.275,201,4.4,158dfc1bd95d +47.382,201,3.8,6c2a02267340 +47.496,201,3.0,158dfc1bd95d +47.607,201,3.0,158dfc1bd95d +47.712,201,6.1,6c2a02267340 +47.82,201,7.1,6c2a02267340 +47.932,201,4.0,6c2a02267340 +48.041,201,8.2,6c2a02267340 +48.158,201,3.8,158dfc1bd95d +48.267,201,3.9,158dfc1bd95d +48.378,201,3.2,158dfc1bd95d +48.485,201,3.7,158dfc1bd95d +48.591,201,2.7,6c2a02267340 +48.701,201,3.1,6c2a02267340 +48.81,201,3.8,6c2a02267340 +48.921,201,3.6,6c2a02267340 +49.034,201,4.1,158dfc1bd95d +49.141,201,6.0,6c2a02267340 +49.252,201,4.9,6c2a02267340 +49.365,201,4.0,158dfc1bd95d +49.477,201,2.7,158dfc1bd95d +49.586,201,4.9,158dfc1bd95d +49.7,201,4.1,158dfc1bd95d +49.81,201,4.8,158dfc1bd95d +49.921,201,4.2,158dfc1bd95d +50.032,201,5.6,6c2a02267340 +50.144,201,5.6,6c2a02267340 +50.26,201,2.8,6c2a02267340 +50.372,201,2.5,6c2a02267340 +50.475,201,3.8,6c2a02267340 +50.586,201,4.6,6c2a02267340 +50.698,201,5.2,6c2a02267340 +50.81,201,4.3,6c2a02267340 +50.921,201,4.1,6c2a02267340 +51.033,201,3.5,6c2a02267340 +51.14,201,3.5,6c2a02267340 +51.253,201,4.5,6c2a02267340 +51.367,201,5.2,158dfc1bd95d +51.474,201,5.3,158dfc1bd95d +51.589,201,4.4,158dfc1bd95d +51.701,201,4.9,158dfc1bd95d +51.815,201,5.5,6c2a02267340 +51.928,201,4.8,6c2a02267340 +52.039,201,3.7,6c2a02267340 +52.146,201,3.5,6c2a02267340 +52.256,201,6.3,6c2a02267340 +52.369,201,5.0,6c2a02267340 +52.479,201,5.1,6c2a02267340 +52.588,201,4.3,6c2a02267340 +52.699,201,5.6,6c2a02267340 +52.812,201,4.2,6c2a02267340 +52.918,201,5.1,6c2a02267340 +53.033,201,4.4,6c2a02267340 +53.14,201,3.1,6c2a02267340 +53.251,201,5.2,6c2a02267340 +53.365,201,4.3,158dfc1bd95d +53.475,201,4.0,158dfc1bd95d +53.583,201,5.2,158dfc1bd95d +53.698,201,4.5,158dfc1bd95d +53.803,201,3.7,6c2a02267340 +53.908,201,3.0,6c2a02267340 +54.015,201,4.8,6c2a02267340 +54.13,201,5.2,6c2a02267340 +54.243,201,4.2,6c2a02267340 +54.354,201,4.3,158dfc1bd95d +54.46,201,5.3,6c2a02267340 +54.57,201,4.2,6c2a02267340 +54.684,201,3.5,6c2a02267340 +54.793,201,3.0,6c2a02267340 +54.904,201,2.8,6c2a02267340 +55.013,201,5.3,158dfc1bd95d +55.125,201,4.0,158dfc1bd95d +55.235,201,4.5,158dfc1bd95d +55.346,201,4.1,158dfc1bd95d +55.455,201,6.1,158dfc1bd95d +55.57,201,4.9,158dfc1bd95d +55.685,201,4.1,158dfc1bd95d +55.794,201,4.1,158dfc1bd95d +55.908,201,5.5,6c2a02267340 +56.023,201,6.1,158dfc1bd95d +56.132,201,5.4,6c2a02267340 +56.245,201,4.3,158dfc1bd95d +56.35,201,3.4,6c2a02267340 +56.455,201,4.7,6c2a02267340 +56.566,201,3.2,6c2a02267340 +56.676,201,3.4,6c2a02267340 +56.78,201,5.2,158dfc1bd95d +56.891,201,4.6,158dfc1bd95d +57.002,201,8.8,6c2a02267340 +57.118,201,4.7,6c2a02267340 +57.23,201,5.0,6c2a02267340 +57.345,201,3.3,158dfc1bd95d +57.454,201,3.0,6c2a02267340 +57.567,201,5.2,158dfc1bd95d +57.681,201,5.7,158dfc1bd95d +57.797,201,8.8,6c2a02267340 +57.91,201,4.7,6c2a02267340 +58.021,201,4.0,6c2a02267340 +58.133,201,4.6,6c2a02267340 +58.245,201,4.0,158dfc1bd95d +58.36,201,3.0,158dfc1bd95d +58.463,201,5.2,158dfc1bd95d +58.571,201,4.7,6c2a02267340 +58.676,201,5.1,6c2a02267340 +58.785,201,4.2,6c2a02267340 +58.897,201,5.3,6c2a02267340 +59.011,201,4.9,6c2a02267340 +59.125,201,3.9,158dfc1bd95d +59.23,201,4.2,6c2a02267340 +59.343,201,4.5,6c2a02267340 +59.457,201,5.9,158dfc1bd95d +59.571,201,5.6,158dfc1bd95d +59.678,201,3.9,158dfc1bd95d +59.788,201,5.2,158dfc1bd95d +59.903,201,5.6,6c2a02267340 +60.016,201,4.8,6c2a02267340 +60.13,201,3.8,6c2a02267340 +60.243,201,3.0,6c2a02267340 +60.346,201,3.3,6c2a02267340 +60.458,201,3.8,6c2a02267340 +60.566,201,5.2,6c2a02267340 +60.68,201,4.2,6c2a02267340 +60.793,201,5.1,158dfc1bd95d +60.904,201,2.8,6c2a02267340 +61.013,201,4.5,6c2a02267340 +61.118,201,5.9,6c2a02267340 +61.229,201,5.0,6c2a02267340 +61.339,201,5.7,6c2a02267340 +61.453,201,5.3,158dfc1bd95d +61.564,201,5.1,158dfc1bd95d +61.67,201,5.4,6c2a02267340 +61.786,201,4.5,158dfc1bd95d +61.899,201,5.8,158dfc1bd95d +62.013,201,6.6,6c2a02267340 +62.122,201,8.3,6c2a02267340 +62.232,201,3.3,158dfc1bd95d +62.339,201,6.3,158dfc1bd95d +62.455,201,6.0,6c2a02267340 +62.569,201,4.0,6c2a02267340 +62.679,201,4.1,6c2a02267340 +62.793,201,3.1,6c2a02267340 +62.903,201,2.8,6c2a02267340 +63.01,201,3.1,6c2a02267340 +63.115,201,3.7,6c2a02267340 +63.227,201,3.8,6c2a02267340 +63.337,201,4.2,6c2a02267340 +63.449,201,4.9,6c2a02267340 +63.562,201,3.0,6c2a02267340 +63.675,201,2.8,158dfc1bd95d +63.779,201,3.0,6c2a02267340 +63.888,201,4.0,6c2a02267340 +63.996,201,4.1,6c2a02267340 +64.105,201,4.3,6c2a02267340 +64.217,201,6.1,6c2a02267340 +64.327,201,4.4,6c2a02267340 +64.441,201,3.9,6c2a02267340 +64.555,201,3.7,158dfc1bd95d +64.665,201,2.6,158dfc1bd95d +64.777,201,4.7,158dfc1bd95d +64.888,201,4.8,158dfc1bd95d +64.995,201,3.4,158dfc1bd95d +65.106,201,3.3,158dfc1bd95d +65.219,201,4.0,158dfc1bd95d +65.329,201,3.3,158dfc1bd95d +65.442,201,3.0,158dfc1bd95d +65.555,201,3.2,6c2a02267340 +65.665,201,3.9,6c2a02267340 +65.774,201,5.2,6c2a02267340 +65.888,201,4.8,6c2a02267340 +65.994,201,5.5,6c2a02267340 +66.104,201,3.7,6c2a02267340 +66.216,201,4.7,6c2a02267340 +66.328,201,3.1,6c2a02267340 +66.432,201,2.8,158dfc1bd95d +66.544,201,4.2,158dfc1bd95d +66.652,201,3.7,158dfc1bd95d +66.761,201,3.9,158dfc1bd95d +66.872,201,4.3,158dfc1bd95d +66.985,201,4.3,6c2a02267340 +67.095,201,3.8,6c2a02267340 +67.207,201,4.5,6c2a02267340 +67.322,201,4.8,6c2a02267340 +67.434,201,4.4,158dfc1bd95d +67.547,201,6.3,158dfc1bd95d +67.661,201,4.7,158dfc1bd95d +67.773,201,5.2,158dfc1bd95d +67.882,201,5.5,158dfc1bd95d +67.995,201,4.7,6c2a02267340 +68.108,201,3.6,6c2a02267340 +68.222,201,3.2,6c2a02267340 +68.325,201,4.7,6c2a02267340 +68.434,201,3.7,6c2a02267340 +68.546,201,4.5,6c2a02267340 +68.658,201,3.3,6c2a02267340 +68.769,201,4.4,6c2a02267340 +68.884,201,4.1,158dfc1bd95d +68.994,201,3.2,6c2a02267340 +69.107,201,3.3,158dfc1bd95d +69.219,201,4.0,158dfc1bd95d +69.326,201,5.7,158dfc1bd95d +69.433,201,4.9,158dfc1bd95d +69.546,201,4.5,158dfc1bd95d +69.661,201,4.1,158dfc1bd95d +69.772,201,4.1,158dfc1bd95d +69.886,201,3.5,6c2a02267340 +69.996,201,7.9,6c2a02267340 +70.114,201,4.4,6c2a02267340 +70.227,201,4.5,158dfc1bd95d +70.336,201,5.9,158dfc1bd95d +70.45,201,4.5,158dfc1bd95d +70.555,201,5.9,158dfc1bd95d +70.67,201,5.1,158dfc1bd95d +70.786,201,3.1,6c2a02267340 +70.889,201,3.2,158dfc1bd95d +70.996,201,4.2,158dfc1bd95d +71.104,201,4.3,158dfc1bd95d +71.213,201,6.4,158dfc1bd95d +71.328,201,4.5,158dfc1bd95d +71.437,201,5.2,158dfc1bd95d +71.552,201,7.4,6c2a02267340 +71.666,201,3.5,6c2a02267340 +71.777,201,3.9,6c2a02267340 +71.888,201,4.4,6c2a02267340 +72.003,201,3.8,6c2a02267340 +72.116,201,4.9,158dfc1bd95d +72.228,201,4.0,158dfc1bd95d +72.338,201,4.6,158dfc1bd95d +72.449,201,3.1,158dfc1bd95d +72.56,201,3.1,158dfc1bd95d +72.673,201,3.4,158dfc1bd95d +72.778,201,3.9,158dfc1bd95d +72.889,201,5.7,158dfc1bd95d +72.997,201,4.8,158dfc1bd95d +73.103,201,5.8,158dfc1bd95d +73.212,201,10.9,158dfc1bd95d +73.325,201,3.3,6c2a02267340 +73.43,201,2.9,6c2a02267340 +73.535,201,4.2,6c2a02267340 +73.64,201,4.4,158dfc1bd95d +73.745,201,3.6,158dfc1bd95d +73.854,201,3.4,158dfc1bd95d +73.959,201,3.9,6c2a02267340 +74.066,201,4.4,6c2a02267340 +74.18,201,4.1,6c2a02267340 +74.289,201,3.6,6c2a02267340 +74.403,201,3.8,6c2a02267340 +74.509,201,3.3,6c2a02267340 +74.617,201,3.0,6c2a02267340 +74.727,201,3.6,6c2a02267340 +74.834,201,3.0,158dfc1bd95d +74.939,201,3.0,158dfc1bd95d +75.049,201,3.7,6c2a02267340 +75.157,201,3.9,158dfc1bd95d +75.265,201,4.1,6c2a02267340 +75.376,201,3.2,158dfc1bd95d +75.487,201,3.9,6c2a02267340 diff --git a/evidence/rolling-from-8d28d45/result.json b/evidence/rolling-from-8d28d45/result.json index 70c38f9c..578ac944 100644 --- a/evidence/rolling-from-8d28d45/result.json +++ b/evidence/rolling-from-8d28d45/result.json @@ -4,30 +4,30 @@ "scripts/rolling-update.sh" ], "action_exit": 0, - "action_seconds": 7.062, + "action_seconds": 7.451, "action_finished_before_load_end": true, "lb_up_before": 2, "lb_up_min": 2, "detection_seconds": null, "rejoin_seconds": null, "probe": { - "attempts": 934, + "attempts": 913, "failed_attempts": 0, "first_failure_s": null, "recovery_s": 0.0, "instances_before": { - "e2d392075b96": 127, - "bc58bf60e518": 113 + "3e62ff0322c6": 113, + "3e741644dba4": 121 }, "instances_during_outage": {}, "instances_after": { - "c84bddf582a8": 328, - "225f56282b82": 301 + "158dfc1bd95d": 279, + "6c2a02267340": 334 } }, "lb_counters": { "wretr": 0, - "wredis": 55, + "wredis": 56, "econ": 0, "eresp": 0, "hrsp_5xx": 0 @@ -38,9 +38,9 @@ "ok_rps": 99.96, "failed_ratio": 0, "dropped_iterations": 5, - "p50_ms": 2.18, - "p95_ms": 6.89, - "p99_ms": 15.41, + "p50_ms": 1.47, + "p95_ms": 2.78, + "p99_ms": 5.99, "exit": 0, "rate": 100 }, diff --git a/evidence/rolling/action.txt b/evidence/rolling/action.txt index cd26cb46..f66d569e 100644 --- a/evidence/rolling/action.txt +++ b/evidence/rolling/action.txt @@ -1,5 +1,6 @@ -23:51:28 migrate once before the first replacement -{"reason":"up to date","event":"migration.completed","level":"info","ts":"2026-10-29T23:51:29.300225Z"} +02:52:53 migrate once before the first replacement +02:52:53 database bytes,messages: 20534963,24025 +{"reason":"up to date","event":"migration.completed","level":"info","ts":"2026-10-30T02:52:54.219740Z"} Container mtusi2026lab3-api-3 Running Container mtusi2026lab3-api-4 Running Container mtusi2026lab3-api-5 Creating @@ -12,7 +13,12 @@ Container mtusi2026lab3-api-5 Healthy Container mtusi2026lab3-api-4 Healthy Container mtusi2026lab3-api-3 Healthy -23:51:31 replace c84bddf582a8 image=cb0dac56ff0b -> 89953d9764bd image=c23101d9a13d +mtusi2026lab3-api-3 cpu=18.37% mem=160.3MiB / 512MiB +mtusi2026lab3-api-4 cpu=5.61% mem=160.3MiB / 512MiB +mtusi2026lab3-lb-1 cpu=2.95% mem=21.96MiB / 128MiB +mtusi2026lab3-postgres-1 cpu=5.48% mem=68.1MiB / 1GiB +mtusi2026lab3-valkey-1 cpu=0.42% mem=13.11MiB / 128MiB +02:52:56 replace 6c2a02267340 image=mtusi-messenger:mtusi2026lab3@c69a721bc974 -> c2f5d82dee7c image=mtusi-messenger:mtusi2026lab3@021faac1e94a Container mtusi2026lab3-api-4 Running Container mtusi2026lab3-api-5 Running Container mtusi2026lab3-api-6 Creating @@ -25,5 +31,5 @@ Container mtusi2026lab3-api-6 Healthy Container mtusi2026lab3-api-5 Healthy Container mtusi2026lab3-api-4 Healthy -23:51:37 replace 225f56282b82 image=cb0dac56ff0b -> 1f35898d8b4e image=c23101d9a13d -23:51:40 done: 2 replicas replaced +02:53:03 replace 158dfc1bd95d image=mtusi-messenger:mtusi2026lab3@c69a721bc974 -> 65d10d346f4e image=mtusi-messenger:mtusi2026lab3@021faac1e94a +02:53:05 done: 2 replicas replaced diff --git a/evidence/rolling/k6/k6.txt b/evidence/rolling/k6/k6.txt index 473f863f..5da226ff 100644 --- a/evidence/rolling/k6/k6.txt +++ b/evidence/rolling/k6/k6.txt @@ -1,2 +1,2 @@ -time="2026-10-29T23:51:03Z" level=info msg=LOAD-START source=console +time="2026-10-30T02:52:28Z" level=info msg=LOAD-START source=console measure: 9001 requests, failed ratio 0 diff --git a/evidence/rolling/k6/summary.json b/evidence/rolling/k6/summary.json index 3aaa3e33..829cdf05 100644 --- a/evidence/rolling/k6/summary.json +++ b/evidence/rolling/k6/summary.json @@ -1,4 +1,26 @@ { + "root_group": { + "checks": [ + { + "path": "::message 201", + "id": "6445aff337e1ade0bc10402fbac79882", + "passes": 8049, + "fails": 0, + "name": "message 201" + }, + { + "fails": 0, + "name": "history 200", + "path": "::history 200", + "id": "fe27b3b8edd292c7f2170a6357b087d0", + "passes": 1953 + } + ], + "name": "", + "path": "", + "id": "d41d8cd98f00b204e9800998ecf8427e", + "groups": [] + }, "options": { "summaryTrendStats": [ "avg", @@ -15,33 +37,145 @@ "state": { "isStdOutTTY": false, "isStdErrTTY": false, - "testRunDurationMs": 100634.875366 + "testRunDurationMs": 100562.669839 }, "metrics": { - "http_req_duration{expected_response:true}": { + "iteration_duration": { + "values": { + "p(99)": 6.5293851699999985, + "max": 59.366542, + "avg": 1.6908107441511713, + "min": 0.937167, + "med": 1.4179995, + "p(90)": 2.0306586, + "p(95)": 2.3185982499999986 + }, + "type": "trend", + "contains": "time" + }, + "http_reqs{scenario:measure}": { + "contains": "default", + "values": { + "rate": 89.50637462599717, + "count": 9001 + }, + "type": "counter" + }, + "iterations{scenario:measure}": { + "type": "counter", + "contains": "default", + "values": { + "count": 9001, + "rate": 89.50637462599717 + } + }, + "http_req_connecting": { "type": "trend", "contains": "time", "values": { - "med": 1.91925, - "p(90)": 2.909917, - "p(95)": 3.3839584999999985, - "p(99)": 6.050853999999995, - "max": 38.408167, - "avg": 2.1417379187145684, - "min": 0.987541 + "avg": 0.0003895038798249105, + "min": 0, + "med": 0, + "p(90)": 0, + "p(95)": 0, + "p(99)": 0, + "max": 0.258041 + } + }, + "http_req_waiting": { + "type": "trend", + "contains": "time", + "values": { + "min": 0.846458, + "med": 1.3211455, + "p(90)": 1.8879506, + "p(95)": 2.198289799999999, + "p(99)": 8.954823409999985, + "max": 59.019459, + "avg": 1.626115160067644 + } + }, + "http_req_receiving": { + "type": "trend", + "contains": "time", + "values": { + "max": 1.462209, + "avg": 0.022929372463191405, + "min": 0.006291, + "med": 0.018792, + "p(90)": 0.03475, + "p(95)": 0.042537799999999966, + "p(99)": 0.07347857999999999 + } + }, + "http_req_sending": { + "contains": "time", + "values": { + "max": 0.1985, + "avg": 0.011436388778352617, + "min": 0.002708, + "med": 0.009791, + "p(90)": 0.0155, + "p(95)": 0.018227449999999982, + "p(99)": 0.04276641999999996 + }, + "type": "trend" + }, + "http_req_failed{scenario:measure}": { + "type": "rate", + "contains": "default", + "values": { + "rate": 0, + "passes": 0, + "fails": 9001 + } + }, + "vus_max": { + "type": "gauge", + "contains": "default", + "values": { + "value": 20, + "min": 20, + "max": 20 } }, "http_req_tls_handshaking": { "type": "trend", "contains": "time", "values": { - "p(99)": 0, "max": 0, "avg": 0, "min": 0, "med": 0, "p(90)": 0, - "p(95)": 0 + "p(95)": 0, + "p(99)": 0 + } + }, + "http_req_duration": { + "type": "trend", + "contains": "time", + "values": { + "max": 59.161333, + "avg": 1.6604809213091847, + "min": 0.86925, + "med": 1.35175, + "p(90)": 1.9341542000000003, + "p(95)": 2.2528895499999995, + "p(99)": 9.063710669999981 + } + }, + "http_req_duration{scenario:measure}": { + "type": "trend", + "contains": "time", + "values": { + "p(90)": 1.926416, + "p(95)": 2.214041, + "p(99)": 6.86125, + "max": 59.161333, + "avg": 1.6267745729363383, + "min": 0.897667, + "med": 1.343125 } }, "dropped_iterations{scenario:measure}": { @@ -53,40 +187,55 @@ } }, "http_reqs": { - "type": "counter", - "contains": "default", "values": { - "count": 10051, - "rate": 99.87591243538004 - } + "count": 10052, + "rate": 99.95756890795728 + }, + "type": "counter", + "contains": "default" }, - "http_req_receiving": { + "http_req_duration{scenario:measure,name:post_message}": { + "type": "trend", "contains": "time", "values": { - "p(95)": 0.0607085, - "p(99)": 0.09464599999999997, - "max": 1.598709, - "avg": 0.03376226345637239, - "min": 0.01025, - "med": 0.03, - "p(90)": 0.049792 - }, - "type": "trend" - }, - "iterations": { - "type": "counter", - "contains": "default", - "values": { - "count": 10001, - "rate": 99.3790667860149 + "p(99)": 6.405855369999998, + "max": 59.161333, + "avg": 1.6004440261635895, + "min": 0.897667, + "med": 1.3235204999999999, + "p(90)": 1.9068081000000001, + "p(95)": 2.1840693499999997 } }, - "http_reqs{scenario:measure}": { - "type": "counter", + "checks": { + "type": "rate", "contains": "default", "values": { - "rate": 89.44215379871214, - "count": 9001 + "rate": 1, + "passes": 10002, + "fails": 0 + } + }, + "vus": { + "type": "gauge", + "contains": "default", + "values": { + "value": 0, + "min": 0, + "max": 1 + } + }, + "http_req_duration{expected_response:true}": { + "type": "trend", + "contains": "time", + "values": { + "p(99)": 9.063710669999981, + "max": 59.161333, + "avg": 1.6604809213091847, + "min": 0.86925, + "med": 1.35175, + "p(90)": 1.9341542000000003, + "p(95)": 2.2528895499999995 } }, "http_req_failed": { @@ -95,158 +244,44 @@ "values": { "rate": 0, "passes": 0, - "fails": 10051 - } - }, - "http_req_waiting": { - "values": { - "p(90)": 2.841791, - "p(95)": 3.312916499999999, - "p(99)": 5.971687499999999, - "max": 38.337625, - "avg": 2.090384783703111, - "min": 0.961333, - "med": 1.86825 - }, - "type": "trend", - "contains": "time" - }, - "vus": { - "type": "gauge", - "contains": "default", - "values": { - "value": 1, - "min": 0, - "max": 1 - } - }, - "http_req_duration{scenario:measure,name:get_history}": { - "type": "trend", - "contains": "time", - "values": { - "avg": 2.174970813688212, - "min": 1.103042, - "med": 1.970833, - "p(90)": 2.957042, - "p(95)": 3.34025, - "p(99)": 5.460608, - "max": 38.408167 + "fails": 10052 } }, "data_sent": { "type": "counter", "contains": "data", "values": { - "count": 2922755, - "rate": 29043.162118204076 + "count": 2934144, + "rate": 29177.26831136783 } }, - "http_req_blocked": { - "contains": "time", + "iterations": { + "type": "counter", + "contains": "default", "values": { - "max": 0.844375, - "avg": 0.003448670779026882, - "min": 0.000833, - "med": 0.002584, - "p(90)": 0.004125, - "p(95)": 0.004958, - "p(99)": 0.008041 - }, - "type": "trend" + "rate": 99.46036651585642, + "count": 10002 + } }, - "iteration_duration": { + "http_req_duration{scenario:measure,name:get_history}": { "type": "trend", "contains": "time", "values": { - "p(99)": 5.120458, - "max": 38.544417, - "avg": 2.213861171482851, - "min": 1.044125, - "med": 2.037458, - "p(90)": 3.030125, - "p(95)": 3.503292 + "med": 1.416209, + "p(90)": 2.0131584, + "p(95)": 2.3368326999999995, + "p(99)": 7.265594039999997, + "max": 35.494666, + "avg": 1.7367299672225458, + "min": 1.044291 } }, - "http_req_connecting": { - "type": "trend", - "contains": "time", - "values": { - "max": 0.322167, - "avg": 0.00039240742214705006, - "min": 0, - "med": 0, - "p(90)": 0, - "p(95)": 0, - "p(99)": 0 - } - }, - "http_req_sending": { - "contains": "time", - "values": { - "min": 0.003334, - "med": 0.015875, - "p(90)": 0.023417, - "p(95)": 0.028667, - "p(99)": 0.05558349999999993, - "max": 0.310083, - "avg": 0.017590871555069176 - }, - "type": "trend" - }, "data_received": { "type": "counter", "contains": "data", "values": { - "count": 25309203, - "rate": 251495.34798898196 - } - }, - "http_req_duration": { - "type": "trend", - "contains": "time", - "values": { - "p(99)": 6.050853999999995, - "max": 38.408167, - "avg": 2.1417379187145684, - "min": 0.987541, - "med": 1.91925, - "p(90)": 2.909917, - "p(95)": 3.3839584999999985 - } - }, - "checks": { - "type": "rate", - "contains": "default", - "values": { - "fails": 0, - "rate": 1, - "passes": 10001 - } - }, - "vus_max": { - "contains": "default", - "values": { - "value": 20, - "min": 20, - "max": 20 - }, - "type": "gauge" - }, - "http_req_failed{scenario:measure}": { - "type": "rate", - "contains": "default", - "values": { - "rate": 0, - "passes": 0, - "fails": 9001 - } - }, - "iterations{scenario:measure}": { - "type": "counter", - "contains": "default", - "values": { - "count": 9001, - "rate": 89.44215379871214 + "count": 24412221, + "rate": 242756.29355389794 } }, "dropped_iterations": { @@ -257,53 +292,18 @@ "rate": 0 } }, - "http_req_duration{scenario:measure}": { - "values": { - "p(99)": 4.497875, - "max": 38.408167, - "avg": 2.0711908151316614, - "min": 0.987541, - "med": 1.914375, - "p(90)": 2.832917, - "p(95)": 3.232084 - }, + "http_req_blocked": { "type": "trend", - "contains": "time" - }, - "http_req_duration{scenario:measure,name:post_message}": { "contains": "time", "values": { - "p(90)": 2.7975375, - "p(95)": 3.2080624999999996, - "p(99)": 4.3749014699999975, - "max": 12.926959, - "avg": 2.0445066004189947, - "min": 0.987541, - "med": 1.8989165 - }, - "type": "trend" + "min": 0.000708, + "med": 0.0015, + "p(90)": 0.002625, + "p(95)": 0.003125, + "p(99)": 0.005603579999999996, + "max": 0.456417, + "avg": 0.002264599283724603 + } } - }, - "root_group": { - "name": "", - "path": "", - "id": "d41d8cd98f00b204e9800998ecf8427e", - "groups": [], - "checks": [ - { - "fails": 0, - "name": "message 201", - "path": "::message 201", - "id": "6445aff337e1ade0bc10402fbac79882", - "passes": 7955 - }, - { - "name": "history 200", - "path": "::history 200", - "id": "fe27b3b8edd292c7f2170a6357b087d0", - "passes": 2046, - "fails": 0 - } - ] } } \ No newline at end of file diff --git a/evidence/rolling/lb_up.csv b/evidence/rolling/lb_up.csv index 0fb44c35..203eed26 100644 --- a/evidence/rolling/lb_up.csv +++ b/evidence/rolling/lb_up.csv @@ -1,953 +1,928 @@ t_rel_s,up --25.981,2 --25.874,2 --25.771,2 --25.665,2 --25.56,2 --25.454,2 --25.345,2 --25.243,2 --25.135,2 --25.028,2 --24.924,2 --24.812,2 --24.706,2 --24.598,2 --24.489,2 --24.382,2 --24.273,2 --24.168,2 --24.064,2 --23.954,2 --23.846,2 --23.74,2 --23.631,2 --23.521,2 --23.411,2 --23.304,2 --23.192,2 --23.086,2 --22.982,2 --22.874,2 --22.769,2 --22.659,2 --22.55,2 --22.442,2 --22.337,2 --22.233,2 --22.129,2 --22.021,2 --21.915,2 --21.811,2 --21.704,2 --21.595,2 --21.492,2 --21.388,2 --21.284,2 --21.179,2 --21.076,2 --20.973,2 --20.871,2 --20.765,2 --20.659,2 --20.551,2 --20.443,2 --20.336,2 --20.23,2 --20.121,2 +-25.84,2 +-25.737,2 +-25.634,2 +-25.525,2 +-25.419,2 +-25.315,2 +-25.205,2 +-25.091,2 +-24.987,2 +-24.879,2 +-24.771,2 +-24.66,2 +-24.547,2 +-24.44,2 +-24.331,2 +-24.217,2 +-24.106,2 +-23.994,2 +-23.884,2 +-23.777,2 +-23.666,2 +-23.56,2 +-23.445,2 +-23.333,2 +-23.22,2 +-23.107,2 +-22.995,2 +-22.882,2 +-22.767,2 +-22.663,2 +-22.551,2 +-22.447,2 +-22.336,2 +-22.234,2 +-22.124,2 +-22.012,2 +-21.898,2 +-21.788,2 +-21.681,2 +-21.569,2 +-21.462,2 +-21.352,2 +-21.243,2 +-21.129,2 +-21.024,2 +-20.913,2 +-20.802,2 +-20.688,2 +-20.574,2 +-20.461,2 +-20.349,2 +-20.241,2 +-20.132,2 -20.016,2 --19.912,2 --19.807,2 --19.699,2 --19.592,2 --19.484,2 --19.376,2 --19.27,2 --19.165,2 --19.061,2 --18.951,2 --18.844,2 --18.736,2 --18.626,2 --18.523,2 --18.418,2 --18.313,2 --18.205,2 --18.096,2 --17.993,2 --17.883,2 --17.776,2 --17.668,2 --17.561,2 --17.452,2 --17.343,2 --17.235,2 --17.13,2 --17.023,2 --16.917,2 --16.81,2 --16.703,2 --16.594,2 --16.485,2 --16.382,2 --16.274,2 --16.169,2 --16.063,2 --15.955,2 --15.847,2 --15.744,2 --15.636,2 --15.528,2 --15.418,2 --15.312,2 --15.209,2 --15.1,2 --14.991,2 --14.884,2 --14.777,2 --14.67,2 --14.564,2 --14.458,2 --14.354,2 --14.245,2 --14.14,2 --14.036,2 --13.928,2 --13.821,2 --13.713,2 --13.61,2 --13.504,2 --13.401,2 --13.296,2 --13.189,2 --13.084,2 --12.976,2 --12.868,2 --12.763,2 --12.657,2 --12.55,2 --12.446,2 --12.336,2 --12.229,2 --12.121,2 --12.018,2 --11.914,2 --11.81,2 --11.704,2 --11.598,2 --11.489,2 --11.381,2 --11.275,2 --11.162,2 --11.054,2 --10.946,2 --10.842,2 --10.734,2 --10.631,2 --10.523,2 --10.408,2 --10.301,2 --10.191,2 --10.087,2 --9.975,2 --9.87,2 --9.763,2 --9.653,2 --9.545,2 --9.435,2 --9.329,2 --9.223,2 --9.114,2 --9.008,2 --8.905,2 --8.796,2 --8.688,2 --8.578,2 --8.473,2 --8.366,2 --8.261,2 --8.154,2 --8.046,2 --7.94,2 --7.83,2 --7.726,2 --7.621,2 --7.511,2 --7.408,2 --7.302,2 --7.195,2 --7.087,2 --6.981,2 --6.877,2 --6.77,2 --6.663,2 --6.555,2 --6.447,2 --6.342,2 --6.236,2 --6.127,2 --6.021,2 --5.911,2 --5.808,2 --5.702,2 --5.594,2 --5.489,2 --5.381,2 --5.274,2 --5.171,2 --5.065,2 --4.96,2 --4.853,2 --4.744,2 --4.638,2 --4.53,2 --4.423,2 --4.321,2 --4.213,2 --4.105,2 --3.998,2 --3.893,2 --3.79,2 --3.682,2 --3.574,2 --3.471,2 --3.362,2 --3.255,2 --3.15,2 --3.042,2 --2.936,2 --2.83,2 --2.725,2 --2.621,2 --2.514,2 --2.411,2 --2.304,2 --2.198,2 --2.092,2 --1.986,2 --1.883,2 --1.778,2 --1.67,2 --1.563,2 --1.456,2 --1.351,2 --1.242,2 --1.136,2 --1.029,2 --0.923,2 --0.816,2 --0.713,2 --0.607,2 --0.5,2 --0.391,2 --0.282,2 --0.174,2 --0.063,2 -0.042,2 -0.15,2 -0.254,2 -0.358,2 -0.465,2 -0.569,2 -0.677,2 -0.783,2 -0.888,2 -0.991,2 -1.094,2 -1.198,2 -1.304,2 -1.411,2 -1.516,2 -1.624,2 -1.731,2 -1.838,2 -1.945,2 -2.052,2 -2.158,2 -2.266,2 -2.373,2 -2.481,2 -2.584,2 -2.69,3 -2.795,3 -2.903,3 -3.009,3 -3.121,3 -3.228,3 -3.331,3 -3.439,3 -3.544,3 -3.653,3 -3.757,2 -3.867,2 -3.978,2 -4.087,2 -4.197,2 -4.307,2 -4.411,2 -4.519,2 -4.627,2 -4.737,2 -4.842,2 -4.947,2 -5.057,2 -5.165,2 -5.272,2 -5.379,2 -5.487,2 -5.6,2 -5.702,2 -5.807,2 -5.91,2 -6.014,2 -6.121,2 -6.228,2 -6.336,2 -6.445,2 -6.553,2 -6.662,2 -6.768,2 -6.873,2 -6.975,2 -7.08,2 -7.188,2 -7.29,2 -7.398,2 -7.502,2 -7.608,2 -7.716,2 -7.824,2 -7.929,2 -8.037,2 -8.147,2 -8.254,2 -8.361,2 -8.469,2 -8.573,2 -8.682,2 -8.79,3 -8.896,3 -9.003,3 -9.11,3 -9.217,3 -9.324,3 -9.429,3 -9.536,3 -9.643,3 -9.751,3 -9.859,3 -9.966,3 -10.074,3 -10.183,2 -10.292,2 -10.402,2 -10.511,2 -10.617,2 -10.722,2 -10.83,2 -10.936,2 -11.04,2 -11.144,2 -11.248,2 -11.354,2 -11.457,2 -11.56,2 -11.667,2 -11.771,2 -11.875,2 -11.981,2 -12.086,2 -12.189,2 -12.294,2 -12.398,2 -12.5,2 -12.612,2 -12.722,2 -12.831,2 -12.939,2 -13.048,2 -13.157,2 -13.267,2 -13.371,2 -13.483,2 -13.588,2 -13.696,2 -13.8,2 -13.908,2 -14.011,2 -14.118,2 -14.222,2 -14.327,2 -14.437,2 -14.54,2 -14.647,2 -14.751,2 -14.861,2 -14.97,2 -15.075,2 -15.184,2 -15.29,2 -15.399,2 -15.507,2 -15.616,2 -15.723,2 -15.829,2 -15.938,2 -16.045,2 -16.151,2 -16.259,2 -16.366,2 -16.477,2 -16.582,2 -16.691,2 +-19.909,2 +-19.802,2 +-19.688,2 +-19.574,2 +-19.47,2 +-19.359,2 +-19.248,2 +-19.137,2 +-19.029,2 +-18.919,2 +-18.812,2 +-18.697,2 +-18.585,2 +-18.474,2 +-18.367,2 +-18.256,2 +-18.142,2 +-18.03,2 +-17.92,2 +-17.812,2 +-17.706,2 +-17.602,2 +-17.498,2 +-17.391,2 +-17.285,2 +-17.173,2 +-17.063,2 +-16.952,2 +-16.848,2 +-16.741,2 +-16.628,2 +-16.524,2 +-16.409,2 +-16.301,2 +-16.19,2 +-16.077,2 +-15.964,2 +-15.855,2 +-15.749,2 +-15.641,2 +-15.53,2 +-15.417,2 +-15.304,2 +-15.192,2 +-15.083,2 +-14.969,2 +-14.864,2 +-14.754,2 +-14.647,2 +-14.543,2 +-14.437,2 +-14.324,2 +-14.211,2 +-14.104,2 +-13.995,2 +-13.885,2 +-13.778,2 +-13.67,2 +-13.562,2 +-13.452,2 +-13.34,2 +-13.226,2 +-13.12,2 +-13.015,2 +-12.906,2 +-12.803,2 +-12.693,2 +-12.582,2 +-12.477,2 +-12.373,2 +-12.269,2 +-12.158,2 +-12.053,2 +-11.945,2 +-11.835,2 +-11.724,2 +-11.613,2 +-11.501,2 +-11.392,2 +-11.283,2 +-11.174,2 +-11.067,2 +-10.954,2 +-10.844,2 +-10.731,2 +-10.621,2 +-10.515,2 +-10.407,2 +-10.298,2 +-10.185,2 +-10.078,2 +-9.964,2 +-9.858,2 +-9.751,2 +-9.645,2 +-9.538,2 +-9.426,2 +-9.311,2 +-9.203,2 +-9.093,2 +-8.979,2 +-8.868,2 +-8.764,2 +-8.656,2 +-8.545,2 +-8.439,2 +-8.327,2 +-8.215,2 +-8.103,2 +-7.999,2 +-7.888,2 +-7.778,2 +-7.671,2 +-7.56,2 +-7.448,2 +-7.337,2 +-7.228,2 +-7.125,2 +-7.012,2 +-6.908,2 +-6.795,2 +-6.685,2 +-6.577,2 +-6.472,2 +-6.37,2 +-6.261,2 +-6.148,2 +-6.036,2 +-5.927,2 +-5.813,2 +-5.707,2 +-5.599,2 +-5.487,2 +-5.376,2 +-5.269,2 +-5.162,2 +-5.051,2 +-4.945,2 +-4.838,2 +-4.727,2 +-4.618,2 +-4.507,2 +-4.398,2 +-4.292,2 +-4.178,2 +-4.071,2 +-3.96,2 +-3.847,2 +-3.742,2 +-3.63,2 +-3.519,2 +-3.408,2 +-3.297,2 +-3.191,2 +-3.076,2 +-2.963,2 +-2.855,2 +-2.745,2 +-2.634,2 +-2.525,2 +-2.414,2 +-2.301,2 +-2.194,2 +-2.079,2 +-1.965,2 +-1.856,2 +-1.747,2 +-1.639,2 +-1.533,2 +-1.42,2 +-1.309,2 +-1.196,2 +-1.085,2 +-0.982,2 +-0.869,2 +-0.757,2 +-0.641,2 +-0.528,2 +-0.421,2 +-0.31,2 +-0.208,2 +-0.104,2 +-0.0,2 +0.105,2 +0.212,2 +0.323,2 +0.426,2 +0.54,2 +0.647,2 +0.759,2 +0.863,2 +0.976,2 +1.086,2 +1.195,2 +1.303,2 +1.409,2 +1.512,2 +1.616,2 +1.724,2 +1.836,2 +1.947,2 +2.055,2 +2.163,2 +2.267,2 +2.371,2 +2.486,2 +2.599,2 +2.705,2 +2.809,2 +2.919,2 +3.033,2 +3.14,2 +3.246,2 +3.356,2 +3.468,2 +3.58,3 +3.693,3 +3.797,3 +3.906,3 +4.01,3 +4.12,3 +4.226,3 +4.338,3 +4.45,3 +4.556,3 +4.665,3 +4.78,3 +4.893,2 +5.003,2 +5.114,2 +5.221,2 +5.328,2 +5.441,2 +5.553,2 +5.663,2 +5.768,2 +5.879,2 +5.984,2 +6.096,2 +6.205,2 +6.309,2 +6.412,2 +6.515,2 +6.618,2 +6.722,2 +6.833,2 +6.937,2 +7.049,2 +7.161,2 +7.269,2 +7.382,2 +7.489,2 +7.6,2 +7.703,2 +7.809,2 +7.915,2 +8.023,2 +8.135,2 +8.243,2 +8.347,2 +8.458,2 +8.569,2 +8.683,2 +8.792,2 +8.903,2 +9.016,2 +9.13,2 +9.238,2 +9.345,2 +9.447,3 +9.559,3 +9.671,3 +9.785,3 +9.894,3 +9.999,3 +10.108,3 +10.218,3 +10.326,3 +10.438,3 +10.551,3 +10.663,2 +10.77,2 +10.882,2 +10.986,2 +11.094,2 +11.203,2 +11.307,2 +11.417,2 +11.525,2 +11.629,2 +11.743,2 +11.855,2 +11.963,2 +12.07,2 +12.185,2 +12.291,2 +12.404,2 +12.511,2 +12.614,2 +12.724,2 +12.834,2 +12.946,2 +13.056,2 +13.165,2 +13.277,2 +13.385,2 +13.498,2 +13.606,2 +13.717,2 +13.821,2 +13.933,2 +14.041,2 +14.147,2 +14.259,2 +14.364,2 +14.477,2 +14.591,2 +14.698,2 +14.803,2 +14.915,2 +15.028,2 +15.141,2 +15.253,2 +15.362,2 +15.467,2 +15.571,2 +15.684,2 +15.791,2 +15.903,2 +16.018,2 +16.131,2 +16.244,2 +16.357,2 +16.46,2 +16.571,2 +16.684,2 16.798,2 -16.901,2 -17.004,2 -17.112,2 -17.216,2 -17.324,2 -17.431,2 -17.535,2 -17.643,2 -17.748,2 -17.85,2 -17.958,2 -18.066,2 -18.174,2 -18.278,2 -18.381,2 -18.485,2 -18.591,2 -18.696,2 -18.805,2 -18.909,2 -19.017,2 -19.122,2 -19.236,2 -19.346,2 -19.455,2 -19.564,2 -19.668,2 -19.772,2 -19.878,2 -19.983,2 -20.086,2 -20.194,2 -20.298,2 -20.404,2 -20.509,2 -20.616,2 -20.724,2 -20.832,2 -20.941,2 -21.044,2 -21.153,2 -21.257,2 -21.366,2 -21.475,2 -21.583,2 -21.692,2 -21.795,2 -21.898,2 -22.007,2 -22.112,2 -22.219,2 -22.326,2 -22.433,2 -22.539,2 -22.645,2 -22.75,2 -22.858,2 -22.961,2 -23.065,2 -23.173,2 -23.275,2 -23.378,2 -23.481,2 -23.587,2 -23.695,2 -23.798,2 -23.904,2 -24.011,2 -24.117,2 -24.222,2 -24.329,2 -24.436,2 -24.541,2 -24.649,2 -24.758,2 -24.866,2 -24.972,2 -25.079,2 -25.182,2 -25.292,2 -25.399,2 -25.507,2 -25.616,2 -25.722,2 +16.904,2 +17.018,2 +17.129,2 +17.234,2 +17.341,2 +17.447,2 +17.557,2 +17.666,2 +17.774,2 +17.886,2 +17.999,2 +18.109,2 +18.215,2 +18.329,2 +18.438,2 +18.542,2 +18.65,2 +18.755,2 +18.864,2 +18.968,2 +19.079,2 +19.188,2 +19.3,2 +19.404,2 +19.517,2 +19.632,2 +19.746,2 +19.855,2 +19.976,2 +20.115,2 +20.234,2 +20.361,2 +20.478,2 +20.605,2 +20.725,2 +20.87,2 +20.984,2 +21.101,2 +21.213,2 +21.317,2 +21.426,2 +21.54,2 +21.651,2 +21.755,2 +21.865,2 +21.97,2 +22.083,2 +22.195,2 +22.304,2 +22.416,2 +22.527,2 +22.64,2 +22.751,2 +22.864,2 +22.977,2 +23.085,2 +23.197,2 +23.308,2 +23.42,2 +23.531,2 +23.641,2 +23.752,2 +23.861,2 +23.971,2 +24.083,2 +24.195,2 +24.309,2 +24.417,2 +24.527,2 +24.634,2 +24.748,2 +24.86,2 +24.968,2 +25.077,2 +25.187,2 +25.294,2 +25.397,2 +25.506,2 +25.618,2 +25.724,2 25.828,2 -25.934,2 -26.036,2 -26.144,2 -26.247,2 -26.352,2 -26.458,2 -26.56,2 -26.668,2 -26.772,2 -26.876,2 -26.982,2 -27.089,2 -27.192,2 -27.298,2 -27.407,2 -27.516,2 -27.62,2 -27.728,2 -27.832,2 -27.941,2 -28.045,2 -28.153,2 -28.263,2 -28.373,2 -28.479,2 -28.585,2 -28.691,2 -28.795,2 -28.903,2 -29.01,2 -29.115,2 -29.219,2 -29.327,2 -29.436,2 -29.539,2 -29.648,2 +25.936,2 +26.048,2 +26.156,2 +26.264,2 +26.369,2 +26.479,2 +26.585,2 +26.698,2 +26.81,2 +26.925,2 +27.036,2 +27.141,2 +27.248,2 +27.36,2 +27.465,2 +27.578,2 +27.68,2 +27.788,2 +27.9,2 +28.01,2 +28.125,2 +28.232,2 +28.339,2 +28.449,2 +28.562,2 +28.669,2 +28.78,2 +28.883,2 +28.994,2 +29.101,2 +29.214,2 +29.324,2 +29.439,2 +29.546,2 +29.651,2 29.755,2 -29.862,2 -29.968,2 -30.076,2 -30.184,2 -30.29,2 -30.396,2 -30.503,2 -30.614,2 -30.723,2 -30.832,2 -30.939,2 -31.043,2 -31.151,2 -31.258,2 -31.367,2 -31.474,2 -31.582,2 -31.688,2 -31.797,2 -31.903,2 -32.009,2 -32.114,2 -32.22,2 -32.325,2 -32.435,2 -32.541,2 -32.649,2 -32.753,2 -32.86,2 -32.967,2 -33.073,2 -33.179,2 -33.281,2 -33.385,2 -33.491,2 -33.601,2 -33.705,2 -33.809,2 -33.912,2 -34.019,2 -34.125,2 -34.235,2 -34.344,2 -34.451,2 -34.558,2 -34.667,2 -34.772,2 -34.878,2 -34.981,2 -35.088,2 -35.193,2 -35.298,2 -35.407,2 -35.511,2 -35.613,2 -35.718,2 -35.826,2 -35.933,2 -36.036,2 -36.138,2 -36.245,2 -36.349,2 -36.458,2 -36.561,2 -36.667,2 -36.773,2 -36.878,2 -36.987,2 -37.09,2 -37.195,2 -37.302,2 -37.409,2 -37.512,2 -37.614,2 -37.718,2 -37.822,2 -37.929,2 -38.033,2 -38.143,2 -38.25,2 -38.358,2 -38.466,2 -38.571,2 -38.682,2 -38.786,2 -38.89,2 -38.996,2 -39.1,2 -39.207,2 -39.316,2 -39.427,2 -39.534,2 -39.638,2 -39.741,2 -39.847,2 -39.95,2 -40.056,2 -40.159,2 -40.265,2 -40.371,2 -40.478,2 -40.581,2 -40.688,2 -40.793,2 -40.896,2 -41.001,2 -41.107,2 -41.211,2 -41.316,2 -41.422,2 -41.529,2 -41.636,2 -41.741,2 -41.848,2 -41.951,2 -42.058,2 -42.163,2 -42.273,2 -42.379,2 -42.488,2 -42.593,2 -42.703,2 -42.812,2 -42.919,2 -43.024,2 -43.131,2 -43.239,2 -43.348,2 -43.456,2 -43.561,2 -43.668,2 -43.775,2 -43.883,2 -43.994,2 -44.104,2 -44.21,2 -44.32,2 -44.427,2 -44.533,2 -44.637,2 -44.742,2 -44.85,2 -44.959,2 -45.066,2 -45.178,2 -45.284,2 -45.388,2 -45.496,2 -45.6,2 -45.707,2 -45.816,2 -45.924,2 -46.034,2 -46.143,2 -46.25,2 -46.357,2 -46.466,2 -46.575,2 -46.682,2 -46.788,2 -46.896,2 -47.003,2 -47.108,2 -47.211,2 -47.317,2 -47.422,2 -47.529,2 -47.634,2 -47.736,2 -47.842,2 -47.949,2 -48.056,2 -48.163,2 -48.27,2 -48.376,2 -48.48,2 -48.588,2 -48.692,2 -48.797,2 -48.904,2 -49.008,2 -49.113,2 -49.216,2 -49.323,2 -49.429,2 -49.537,2 -49.645,2 -49.748,2 -49.856,2 -49.96,2 -50.066,2 -50.175,2 -50.28,2 -50.388,2 -50.497,2 -50.608,2 -50.715,2 -50.819,2 -50.929,2 -51.037,2 -51.143,2 -51.249,2 -51.357,2 +29.866,2 +29.987,2 +30.098,2 +30.207,2 +30.32,2 +30.433,2 +30.545,2 +30.656,2 +30.763,2 +30.873,2 +30.985,2 +31.09,2 +31.205,2 +31.309,2 +31.423,2 +31.532,2 +31.638,2 +31.75,2 +31.861,2 +31.969,2 +32.08,2 +32.194,2 +32.304,2 +32.415,2 +32.527,2 +32.632,2 +32.743,2 +32.856,2 +32.963,2 +33.075,2 +33.184,2 +33.288,2 +33.399,2 +33.511,2 +33.625,2 +33.731,2 +33.84,2 +33.947,2 +34.058,2 +34.162,2 +34.266,2 +34.379,2 +34.487,2 +34.591,2 +34.697,2 +34.802,2 +34.913,2 +35.025,2 +35.137,2 +35.241,2 +35.352,2 +35.462,2 +35.569,2 +35.675,2 +35.778,2 +35.891,2 +36.0,2 +36.113,2 +36.226,2 +36.336,2 +36.448,2 +36.562,2 +36.674,2 +36.778,2 +36.888,2 +37.0,2 +37.114,2 +37.22,2 +37.334,2 +37.446,2 +37.55,2 +37.654,2 +37.758,2 +37.864,2 +37.97,2 +38.083,2 +38.191,2 +38.294,2 +38.401,2 +38.51,2 +38.615,2 +38.717,2 +38.829,2 +38.932,2 +39.036,2 +39.144,2 +39.255,2 +39.367,2 +39.478,2 +39.585,2 +39.697,2 +39.805,2 +39.91,2 +40.016,2 +40.124,2 +40.237,2 +40.343,2 +40.447,2 +40.554,2 +40.664,2 +40.767,2 +40.875,2 +40.976,2 +41.086,2 +41.189,2 +41.292,2 +41.401,2 +41.514,2 +41.62,2 +41.731,2 +41.844,2 +41.953,2 +42.066,2 +42.173,2 +42.28,2 +42.393,2 +42.5,2 +42.612,2 +42.726,2 +42.835,2 +42.95,2 +43.057,2 +43.165,2 +43.269,2 +43.375,2 +43.488,2 +43.595,2 +43.699,2 +43.81,2 +43.924,2 +44.035,2 +44.141,2 +44.248,2 +44.358,2 +44.472,2 +44.586,2 +44.696,2 +44.806,2 +44.913,2 +45.022,2 +45.127,2 +45.24,2 +45.348,2 +45.463,2 +45.578,2 +45.692,2 +45.799,2 +45.906,2 +46.01,2 +46.123,2 +46.236,2 +46.347,2 +46.452,2 +46.558,2 +46.666,2 +46.779,2 +46.883,2 +46.994,2 +47.103,2 +47.217,2 +47.331,2 +47.444,2 +47.555,2 +47.664,2 +47.776,2 +47.878,2 +47.989,2 +48.101,2 +48.215,2 +48.319,2 +48.426,2 +48.531,2 +48.641,2 +48.755,2 +48.866,2 +48.979,2 +49.088,2 +49.2,2 +49.31,2 +49.421,2 +49.53,2 +49.641,2 +49.749,2 +49.859,2 +49.966,2 +50.074,2 +50.178,2 +50.285,2 +50.389,2 +50.493,2 +50.603,2 +50.716,2 +50.822,2 +50.925,2 +51.038,2 +51.142,2 +51.247,2 +51.362,2 51.466,2 -51.573,2 -51.679,2 -51.784,2 -51.887,2 -51.991,2 -52.099,2 -52.206,2 -52.311,2 -52.419,2 -52.526,2 -52.634,2 -52.742,2 -52.848,2 -52.957,2 -53.062,2 -53.167,2 -53.27,2 -53.377,2 -53.482,2 -53.592,2 -53.699,2 -53.81,2 -53.917,2 -54.02,2 -54.125,2 -54.233,2 -54.341,2 -54.451,2 -54.561,2 -54.669,2 -54.772,2 -54.876,2 -54.986,2 -55.092,2 -55.201,2 -55.308,2 -55.417,2 -55.522,2 -55.629,2 -55.737,2 -55.843,2 -55.95,2 -56.058,2 -56.166,2 -56.271,2 -56.378,2 -56.486,2 -56.59,2 -56.697,2 -56.802,2 -56.909,2 -57.017,2 -57.126,2 -57.233,2 -57.339,2 -57.446,2 -57.555,2 -57.658,2 -57.762,2 -57.867,2 -57.974,2 -58.084,2 -58.192,2 -58.298,2 -58.403,2 -58.512,2 -58.617,2 -58.728,2 -58.832,2 -58.94,2 -59.044,2 -59.149,2 -59.258,2 -59.367,2 -59.475,2 -59.585,2 -59.689,2 -59.793,2 -59.899,2 -60.005,2 -60.116,2 -60.226,2 -60.329,2 -60.436,2 -60.539,2 -60.645,2 -60.752,2 -60.856,2 -60.964,2 -61.068,2 -61.176,2 -61.282,2 -61.387,2 -61.495,2 -61.601,2 -61.708,2 -61.816,2 -61.919,2 -62.026,2 -62.131,2 -62.24,2 -62.345,2 -62.449,2 -62.553,2 -62.659,2 -62.767,2 -62.872,2 -62.976,2 -63.084,2 -63.192,2 -63.298,2 -63.406,2 -63.514,2 -63.622,2 -63.732,2 -63.84,2 -63.948,2 -64.056,2 -64.161,2 -64.266,2 -64.374,2 -64.48,2 -64.587,2 -64.693,2 -64.797,2 -64.904,2 -65.008,2 -65.113,2 -65.219,2 -65.328,2 -65.434,2 -65.543,2 -65.654,2 -65.763,2 -65.874,2 -65.984,2 -66.093,2 -66.198,2 -66.307,2 -66.412,2 -66.52,2 -66.63,2 -66.737,2 +51.576,2 +51.69,2 +51.797,2 +51.905,2 +52.011,2 +52.123,2 +52.234,2 +52.347,2 +52.454,2 +52.566,2 +52.68,2 +52.785,2 +52.891,2 +52.998,2 +53.108,2 +53.223,2 +53.329,2 +53.441,2 +53.554,2 +53.666,2 +53.77,2 +53.879,2 +53.987,2 +54.098,2 +54.209,2 +54.318,2 +54.428,2 +54.543,2 +54.656,2 +54.768,2 +54.881,2 +54.993,2 +55.105,2 +55.215,2 +55.322,2 +55.435,2 +55.537,2 +55.646,2 +55.753,2 +55.861,2 +55.975,2 +56.08,2 +56.189,2 +56.295,2 +56.408,2 +56.516,2 +56.627,2 +56.74,2 +56.85,2 +56.956,2 +57.069,2 +57.179,2 +57.293,2 +57.404,2 +57.513,2 +57.621,2 +57.732,2 +57.834,2 +57.947,2 +58.058,2 +58.169,2 +58.274,2 +58.38,2 +58.492,2 +58.599,2 +58.705,2 +58.812,2 +58.921,2 +59.034,2 +59.138,2 +59.244,2 +59.352,2 +59.465,2 +59.577,2 +59.685,2 +59.792,2 +59.903,2 +60.01,2 +60.117,2 +60.228,2 +60.332,2 +60.438,2 +60.552,2 +60.661,2 +60.77,2 +60.881,2 +60.986,2 +61.092,2 +61.2,2 +61.311,2 +61.417,2 +61.525,2 +61.638,2 +61.744,2 +61.856,2 +61.964,2 +62.071,2 +62.178,2 +62.283,2 +62.39,2 +62.501,2 +62.609,2 +62.714,2 +62.824,2 +62.93,2 +63.034,2 +63.145,2 +63.248,2 +63.363,2 +63.473,2 +63.576,2 +63.688,2 +63.796,2 +63.902,2 +64.014,2 +64.125,2 +64.236,2 +64.341,2 +64.448,2 +64.559,2 +64.664,2 +64.774,2 +64.882,2 +64.986,2 +65.096,2 +65.203,2 +65.311,2 +65.423,2 +65.53,2 +65.642,2 +65.754,2 +65.864,2 +65.97,2 +66.082,2 +66.193,2 +66.304,2 +66.409,2 +66.521,2 +66.634,2 +66.739,2 66.846,2 -66.952,2 -67.061,2 -67.166,2 -67.275,2 -67.383,2 -67.491,2 -67.599,2 -67.702,2 -67.807,2 -67.913,2 -68.019,2 -68.128,2 -68.235,2 -68.342,2 -68.448,2 -68.558,2 -68.662,2 -68.769,2 -68.877,2 -68.984,2 -69.091,2 -69.2,2 -69.309,2 -69.417,2 -69.525,2 -69.635,2 -69.743,2 -69.852,2 -69.962,2 -70.068,2 -70.175,2 -70.283,2 -70.392,2 -70.5,2 -70.607,2 -70.712,2 -70.816,2 -70.923,2 -71.027,2 -71.132,2 -71.241,2 -71.346,2 -71.456,2 -71.565,2 -71.671,2 -71.779,2 -71.887,2 -71.991,2 -72.095,2 -72.199,2 -72.302,2 -72.405,2 -72.512,2 -72.617,2 -72.724,2 -72.83,2 -72.938,2 -73.045,2 -73.149,2 -73.253,2 -73.36,2 -73.469,2 -73.575,2 -73.68,2 -73.789,2 -73.893,2 -73.999,2 -74.107,2 -74.215,2 -74.317,2 -74.426,2 -74.534,2 -74.641,2 -74.749,2 -74.852,2 -74.959,2 -75.071,2 -75.174,2 -75.285,2 -75.399,2 +66.959,2 +67.067,2 +67.171,2 +67.276,2 +67.39,2 +67.497,2 +67.604,2 +67.718,2 +67.825,2 +67.935,2 +68.047,2 +68.158,2 +68.27,2 +68.375,2 +68.483,2 +68.597,2 +68.706,2 +68.816,2 +68.919,2 +69.025,2 +69.128,2 +69.237,2 +69.352,2 +69.459,2 +69.572,2 +69.682,2 +69.789,2 +69.895,2 +70.007,2 +70.12,2 +70.232,2 +70.346,2 +70.461,2 +70.571,2 +70.684,2 +70.789,2 +70.894,2 +71.001,2 +71.115,2 +71.225,2 +71.338,2 +71.448,2 +71.557,2 +71.663,2 +71.772,2 +71.876,2 +71.988,2 +72.093,2 +72.205,2 +72.309,2 +72.416,2 +72.522,2 +72.634,2 +72.745,2 +72.858,2 +72.962,2 +73.073,2 +73.186,2 +73.298,2 +73.409,2 +73.516,2 +73.626,2 +73.737,2 +73.844,2 +73.947,2 +74.057,2 +74.16,2 +74.271,2 +74.375,2 +74.484,2 +74.597,2 +74.704,2 +74.81,2 +74.923,2 +75.028,2 +75.136,2 +75.249,2 +75.359,2 +75.463,2 diff --git a/evidence/rolling/probe.csv b/evidence/rolling/probe.csv index 8e76d110..44bb9223 100644 --- a/evidence/rolling/probe.csv +++ b/evidence/rolling/probe.csv @@ -1,943 +1,920 @@ t_rel_s,status,latency_ms,instance --25.981,201,4.8,225f56282b82 --25.871,201,8.2,c84bddf582a8 --25.763,201,4.9,225f56282b82 --25.658,201,5.2,c84bddf582a8 --25.547,201,6.9,c84bddf582a8 --25.437,201,7.5,225f56282b82 --25.325,201,3.7,225f56282b82 --25.22,201,6.1,c84bddf582a8 --25.113,201,4.1,c84bddf582a8 --25.009,201,3.4,c84bddf582a8 --24.901,201,4.2,c84bddf582a8 --24.794,201,4.3,c84bddf582a8 --24.686,201,5.3,225f56282b82 --24.575,201,10.3,c84bddf582a8 --24.461,201,4.6,c84bddf582a8 --24.352,201,4.1,c84bddf582a8 --24.243,201,3.9,c84bddf582a8 --24.139,201,7.1,c84bddf582a8 --24.029,201,4.4,225f56282b82 --23.923,201,7.6,225f56282b82 --23.811,201,5.4,225f56282b82 --23.704,201,4.8,225f56282b82 --23.599,201,4.4,c84bddf582a8 --23.49,201,12.0,c84bddf582a8 --23.377,201,3.4,c84bddf582a8 --23.268,201,4.5,c84bddf582a8 --23.159,201,5.2,c84bddf582a8 --23.049,201,3.8,c84bddf582a8 --22.941,201,8.5,c84bddf582a8 --22.829,201,4.7,c84bddf582a8 --22.721,201,6.9,c84bddf582a8 --22.612,201,4.7,c84bddf582a8 --22.504,201,6.4,c84bddf582a8 --22.393,201,4.2,c84bddf582a8 --22.286,201,5.9,c84bddf582a8 --22.176,201,5.0,c84bddf582a8 --22.066,201,4.6,c84bddf582a8 --21.96,201,3.9,225f56282b82 --21.852,201,5.6,225f56282b82 --21.743,201,4.5,225f56282b82 --21.635,201,5.4,225f56282b82 --21.526,201,4.4,c84bddf582a8 --21.417,201,3.8,c84bddf582a8 --21.308,201,6.2,c84bddf582a8 --21.201,201,5.5,c84bddf582a8 --21.091,201,3.4,c84bddf582a8 --20.984,201,4.2,c84bddf582a8 --20.877,201,3.5,225f56282b82 --20.769,201,5.8,225f56282b82 --20.661,201,4.4,225f56282b82 --20.554,201,7.7,225f56282b82 --20.442,201,3.2,225f56282b82 --20.338,201,5.1,c84bddf582a8 --20.229,201,4.9,c84bddf582a8 --20.122,201,8.8,c84bddf582a8 --20.008,201,5.1,c84bddf582a8 --19.903,201,7.9,c84bddf582a8 --19.794,201,3.6,c84bddf582a8 --19.686,201,5.4,225f56282b82 --19.578,201,4.0,225f56282b82 --19.472,201,4.7,225f56282b82 --19.366,201,3.7,225f56282b82 --19.26,201,4.0,c84bddf582a8 --19.151,201,6.8,c84bddf582a8 --19.039,201,7.1,c84bddf582a8 --18.928,201,4.9,c84bddf582a8 --18.818,201,6.2,c84bddf582a8 --18.707,201,4.0,c84bddf582a8 --18.603,201,4.1,c84bddf582a8 --18.497,201,4.4,c84bddf582a8 --18.387,201,8.5,225f56282b82 --18.278,201,3.9,225f56282b82 --18.171,201,6.2,225f56282b82 --18.064,201,3.8,225f56282b82 --17.955,201,6.0,225f56282b82 --17.847,201,5.1,c84bddf582a8 --17.737,201,7.0,225f56282b82 --17.63,201,4.2,c84bddf582a8 --17.525,201,4.5,225f56282b82 --17.416,201,9.4,c84bddf582a8 --17.304,201,5.1,c84bddf582a8 --17.196,201,9.0,c84bddf582a8 --17.082,201,3.8,c84bddf582a8 --16.975,201,5.1,c84bddf582a8 --16.869,201,5.4,225f56282b82 --16.759,201,5.1,225f56282b82 --16.652,201,5.8,225f56282b82 --16.541,201,9.2,225f56282b82 --16.428,201,5.9,225f56282b82 --16.319,201,6.0,225f56282b82 --16.212,201,6.2,225f56282b82 --16.104,201,5.3,225f56282b82 --15.997,201,6.2,225f56282b82 --15.889,201,3.9,c84bddf582a8 --15.785,201,4.5,225f56282b82 --15.675,201,4.6,225f56282b82 --15.569,201,4.3,225f56282b82 --15.46,201,4.1,225f56282b82 --15.356,201,4.1,c84bddf582a8 --15.247,201,6.0,c84bddf582a8 --15.138,201,4.5,c84bddf582a8 --15.03,201,6.3,c84bddf582a8 --14.921,201,3.8,c84bddf582a8 --14.817,201,11.5,c84bddf582a8 --14.703,201,3.8,c84bddf582a8 --14.596,201,6.9,225f56282b82 --14.487,201,5.8,225f56282b82 --14.376,201,4.0,225f56282b82 --14.267,201,5.5,225f56282b82 --14.158,201,5.0,225f56282b82 --14.048,201,5.4,225f56282b82 --13.939,201,3.9,225f56282b82 --13.83,201,6.0,225f56282b82 --13.724,201,3.6,225f56282b82 --13.615,201,5.8,225f56282b82 --13.507,201,3.5,c84bddf582a8 --13.401,201,4.8,c84bddf582a8 --13.296,201,4.7,225f56282b82 --13.188,201,3.3,225f56282b82 --13.08,201,3.6,225f56282b82 --12.972,201,3.0,225f56282b82 --12.868,201,3.7,c84bddf582a8 --12.761,201,3.3,c84bddf582a8 --12.654,201,4.9,c84bddf582a8 --12.546,201,3.8,225f56282b82 --12.439,201,4.5,225f56282b82 --12.334,201,3.6,c84bddf582a8 --12.229,201,5.1,c84bddf582a8 --12.12,201,3.1,c84bddf582a8 --12.016,201,4.2,225f56282b82 --11.91,201,3.4,225f56282b82 --11.803,201,3.2,225f56282b82 --11.695,201,3.7,c84bddf582a8 --11.59,201,5.0,c84bddf582a8 --11.48,201,4.0,c84bddf582a8 --11.374,201,2.9,225f56282b82 --11.268,201,6.4,225f56282b82 --11.157,201,3.3,225f56282b82 --11.051,201,5.5,225f56282b82 --10.945,201,3.3,c84bddf582a8 --10.841,201,3.5,c84bddf582a8 --10.732,201,4.9,c84bddf582a8 --10.623,201,4.3,c84bddf582a8 --10.514,201,5.9,c84bddf582a8 --10.404,201,3.9,c84bddf582a8 --10.295,201,4.4,c84bddf582a8 --10.186,201,5.1,225f56282b82 --10.08,201,3.5,225f56282b82 --9.972,201,3.4,225f56282b82 --9.864,201,3.5,225f56282b82 --9.756,201,7.2,c84bddf582a8 --9.645,201,4.6,225f56282b82 --9.54,201,5.5,c84bddf582a8 --9.433,201,4.2,c84bddf582a8 --9.326,201,4.2,225f56282b82 --9.221,201,4.2,225f56282b82 --9.112,201,3.2,225f56282b82 --9.006,201,3.5,c84bddf582a8 --8.901,201,3.1,c84bddf582a8 --8.796,201,4.8,225f56282b82 --8.688,201,7.6,c84bddf582a8 --8.575,201,3.2,225f56282b82 --8.47,201,3.8,225f56282b82 --8.365,201,3.4,c84bddf582a8 --8.257,201,7.1,c84bddf582a8 --8.145,201,3.7,c84bddf582a8 --8.036,201,3.8,c84bddf582a8 --7.929,201,4.4,c84bddf582a8 --7.822,201,4.4,c84bddf582a8 --7.712,201,3.5,c84bddf582a8 --7.604,201,4.6,c84bddf582a8 --7.498,201,5.4,225f56282b82 --7.392,201,3.8,225f56282b82 --7.286,201,4.1,c84bddf582a8 --7.181,201,4.0,c84bddf582a8 --7.076,201,3.3,225f56282b82 --6.969,201,3.5,225f56282b82 --6.862,201,4.0,225f56282b82 --6.758,201,4.1,c84bddf582a8 --6.653,201,5.1,c84bddf582a8 --6.547,201,3.7,225f56282b82 --6.443,201,5.7,225f56282b82 --6.336,201,3.7,c84bddf582a8 --6.227,201,3.7,c84bddf582a8 --6.121,201,3.5,c84bddf582a8 --6.017,201,3.6,225f56282b82 --5.91,201,3.2,225f56282b82 --5.806,201,3.1,c84bddf582a8 --5.702,201,4.3,c84bddf582a8 --5.593,201,3.8,c84bddf582a8 --5.486,201,3.6,225f56282b82 --5.382,201,4.9,225f56282b82 --5.275,201,6.7,225f56282b82 --5.164,201,3.6,c84bddf582a8 --5.06,201,3.2,c84bddf582a8 --4.953,201,3.7,225f56282b82 --4.849,201,3.1,225f56282b82 --4.742,201,2.9,225f56282b82 --4.636,201,5.2,c84bddf582a8 --4.531,201,3.6,c84bddf582a8 --4.427,201,3.9,225f56282b82 --4.318,201,3.3,225f56282b82 --4.213,201,3.7,225f56282b82 --4.105,201,5.8,c84bddf582a8 --3.998,201,3.9,c84bddf582a8 --3.891,201,3.0,c84bddf582a8 --3.783,201,3.6,c84bddf582a8 --3.68,201,3.6,225f56282b82 --3.574,201,4.0,225f56282b82 --3.468,201,3.6,c84bddf582a8 --3.361,201,3.2,c84bddf582a8 --3.253,201,4.4,c84bddf582a8 --3.147,201,4.0,225f56282b82 --3.041,201,2.9,225f56282b82 --2.936,201,4.8,c84bddf582a8 --2.828,201,2.7,c84bddf582a8 --2.722,201,4.7,c84bddf582a8 --2.612,201,3.4,c84bddf582a8 --2.503,201,4.1,c84bddf582a8 --2.394,201,4.3,225f56282b82 --2.286,201,8.6,225f56282b82 --2.176,201,3.5,225f56282b82 --2.071,201,4.5,225f56282b82 --1.964,201,4.3,225f56282b82 --1.859,201,4.2,c84bddf582a8 --1.751,201,4.8,c84bddf582a8 --1.641,201,5.0,c84bddf582a8 --1.533,201,5.2,c84bddf582a8 --1.423,201,5.7,c84bddf582a8 --1.313,201,4.1,c84bddf582a8 --1.204,201,5.1,c84bddf582a8 --1.096,201,5.5,225f56282b82 --0.99,201,5.3,225f56282b82 --0.882,201,3.5,225f56282b82 --0.774,201,6.1,225f56282b82 --0.662,201,4.7,225f56282b82 --0.556,201,6.3,c84bddf582a8 --0.445,201,10.8,225f56282b82 --0.332,201,4.5,225f56282b82 --0.223,201,5.1,225f56282b82 --0.114,201,7.0,225f56282b82 --0.002,201,4.8,225f56282b82 -0.105,201,5.2,225f56282b82 -0.211,201,6.1,c84bddf582a8 -0.319,201,4.3,c84bddf582a8 -0.428,201,5.1,c84bddf582a8 -0.535,201,4.1,c84bddf582a8 -0.644,201,3.6,225f56282b82 -0.753,201,4.5,225f56282b82 -0.861,201,5.8,225f56282b82 -0.967,201,4.0,225f56282b82 -1.072,201,4.8,c84bddf582a8 -1.182,201,3.9,c84bddf582a8 -1.286,201,4.1,225f56282b82 -1.39,201,3.9,225f56282b82 -1.498,201,4.4,225f56282b82 -1.606,201,4.4,225f56282b82 -1.716,201,5.1,225f56282b82 -1.826,201,4.0,c84bddf582a8 -1.935,201,3.6,c84bddf582a8 -2.039,201,10.6,c84bddf582a8 -2.155,201,7.0,c84bddf582a8 -2.265,201,5.9,225f56282b82 -2.373,201,12.8,225f56282b82 -2.487,201,3.1,225f56282b82 -2.591,201,3.4,c84bddf582a8 -2.697,201,4.1,225f56282b82 -2.803,201,4.2,89953d9764bd -2.907,201,4.5,89953d9764bd -3.017,201,5.6,89953d9764bd -3.123,201,2.8,c84bddf582a8 -3.231,201,3.1,c84bddf582a8 -3.334,201,2.5,225f56282b82 -3.439,201,4.3,225f56282b82 -3.549,201,3.2,225f56282b82 -3.655,201,4.7,89953d9764bd -3.76,201,3.4,225f56282b82 -3.867,201,7.8,225f56282b82 -3.978,201,4.3,225f56282b82 -4.086,201,7.2,225f56282b82 -4.197,201,6.4,225f56282b82 -4.308,201,5.1,225f56282b82 -4.413,201,4.9,89953d9764bd -4.521,201,2.7,89953d9764bd -4.627,201,6.7,89953d9764bd -4.739,201,3.5,89953d9764bd -4.845,201,4.0,225f56282b82 -4.95,201,4.4,225f56282b82 -5.06,201,5.7,225f56282b82 -5.169,201,3.9,225f56282b82 -5.278,201,4.0,225f56282b82 -5.384,201,10.4,225f56282b82 -5.499,201,6.7,225f56282b82 -5.608,201,4.2,225f56282b82 -5.717,201,4.3,225f56282b82 -5.823,201,3.9,89953d9764bd -5.928,201,3.5,89953d9764bd -6.032,201,4.3,225f56282b82 -6.137,201,5.7,225f56282b82 -6.245,201,3.9,225f56282b82 -6.353,201,6.3,89953d9764bd -6.462,201,4.8,89953d9764bd -6.57,201,4.8,89953d9764bd -6.68,201,4.8,89953d9764bd -6.789,201,4.2,89953d9764bd -6.895,201,3.9,89953d9764bd -7.003,201,3.7,225f56282b82 -7.111,201,4.4,225f56282b82 -7.217,201,4.1,225f56282b82 -7.323,201,5.1,89953d9764bd -7.431,201,4.4,89953d9764bd -7.538,201,4.2,89953d9764bd -7.647,201,3.8,89953d9764bd -7.754,201,6.1,89953d9764bd -7.861,201,5.5,225f56282b82 -7.971,201,5.7,225f56282b82 -8.08,201,6.8,225f56282b82 -8.189,201,4.2,225f56282b82 -8.297,201,4.2,225f56282b82 -8.403,201,4.0,89953d9764bd -8.508,201,5.4,89953d9764bd -8.618,201,6.9,89953d9764bd -8.729,201,12.9,1f35898d8b4e -8.847,201,4.3,89953d9764bd -8.956,201,8.1,89953d9764bd -9.065,201,4.1,1f35898d8b4e -9.172,201,6.3,1f35898d8b4e -9.278,201,11.0,1f35898d8b4e -9.392,201,3.9,1f35898d8b4e -9.5,201,3.7,1f35898d8b4e -9.607,201,5.3,1f35898d8b4e -9.717,201,4.4,1f35898d8b4e -9.822,201,5.4,225f56282b82 -9.933,201,4.4,225f56282b82 -10.041,201,8.1,225f56282b82 -10.152,201,5.0,225f56282b82 -10.261,201,5.4,89953d9764bd -10.369,201,7.4,89953d9764bd -10.479,201,4.7,89953d9764bd -10.586,201,5.9,89953d9764bd -10.695,201,5.5,89953d9764bd -10.805,201,4.5,89953d9764bd -10.91,201,5.8,1f35898d8b4e -11.017,201,3.4,1f35898d8b4e -11.126,201,3.6,1f35898d8b4e -11.233,201,3.9,89953d9764bd -11.339,201,3.6,89953d9764bd -11.448,201,3.3,89953d9764bd -11.556,201,3.8,89953d9764bd -11.663,201,7.1,1f35898d8b4e -11.774,201,3.6,1f35898d8b4e -11.879,201,4.2,1f35898d8b4e -11.984,201,4.0,89953d9764bd -12.088,201,2.8,89953d9764bd -12.191,201,2.9,1f35898d8b4e -12.297,201,4.3,1f35898d8b4e -12.406,201,4.1,1f35898d8b4e -12.511,201,4.8,89953d9764bd -12.621,201,3.7,89953d9764bd -12.729,201,4.0,89953d9764bd -12.837,201,4.8,89953d9764bd -12.947,201,8.3,1f35898d8b4e -13.058,201,5.3,89953d9764bd -13.164,201,2.7,1f35898d8b4e -13.271,201,4.8,1f35898d8b4e -13.378,201,4.6,1f35898d8b4e -13.484,201,3.6,89953d9764bd -13.593,201,4.7,89953d9764bd -13.698,201,3.2,89953d9764bd -13.802,201,3.9,1f35898d8b4e -13.908,201,4.8,1f35898d8b4e -14.014,201,3.2,89953d9764bd -14.12,201,3.4,89953d9764bd -14.225,201,3.3,1f35898d8b4e -14.333,201,3.9,1f35898d8b4e -14.441,201,3.1,1f35898d8b4e -14.548,201,2.9,1f35898d8b4e -14.654,201,3.9,89953d9764bd -14.763,201,3.6,89953d9764bd -14.872,201,3.6,89953d9764bd -14.979,201,4.4,89953d9764bd -15.088,201,4.0,89953d9764bd -15.196,201,3.4,89953d9764bd -15.302,201,3.9,1f35898d8b4e -15.409,201,5.1,1f35898d8b4e -15.518,201,4.0,1f35898d8b4e -15.624,201,3.5,89953d9764bd -15.729,201,3.1,89953d9764bd -15.837,201,3.7,89953d9764bd -15.946,201,4.5,1f35898d8b4e -16.054,201,3.5,1f35898d8b4e -16.162,201,4.5,1f35898d8b4e -16.27,201,4.2,1f35898d8b4e -16.379,201,3.3,1f35898d8b4e -16.488,201,3.2,1f35898d8b4e -16.595,201,5.6,1f35898d8b4e -16.702,201,3.8,89953d9764bd -16.811,201,5.3,89953d9764bd -16.918,201,3.7,89953d9764bd -17.026,201,5.4,89953d9764bd -17.134,201,3.7,1f35898d8b4e -17.243,201,6.2,1f35898d8b4e -17.353,201,3.5,1f35898d8b4e -17.461,201,6.1,1f35898d8b4e -17.57,201,5.0,1f35898d8b4e -17.679,201,3.8,1f35898d8b4e -17.785,201,3.4,1f35898d8b4e -17.889,201,4.1,89953d9764bd -17.994,201,4.5,1f35898d8b4e -18.1,201,5.0,1f35898d8b4e -18.211,201,6.6,1f35898d8b4e -18.32,201,3.5,1f35898d8b4e -18.425,201,4.0,89953d9764bd -18.533,201,4.6,89953d9764bd -18.642,201,7.2,89953d9764bd -18.753,201,4.3,89953d9764bd -18.858,201,4.4,89953d9764bd -18.966,201,4.8,89953d9764bd -19.074,201,8.0,89953d9764bd -19.183,201,4.5,1f35898d8b4e -19.291,201,6.9,1f35898d8b4e -19.4,201,3.8,1f35898d8b4e -19.505,201,4.0,89953d9764bd -19.614,201,4.1,89953d9764bd -19.721,201,4.4,89953d9764bd -19.827,201,3.7,89953d9764bd -19.936,201,4.0,89953d9764bd -20.04,201,6.0,1f35898d8b4e -20.15,201,4.3,1f35898d8b4e -20.257,201,4.2,1f35898d8b4e -20.361,201,4.9,89953d9764bd -20.468,201,3.8,89953d9764bd -20.575,201,3.7,1f35898d8b4e -20.683,201,6.6,1f35898d8b4e -20.791,201,4.4,1f35898d8b4e -20.899,201,4.7,1f35898d8b4e -21.009,201,3.7,1f35898d8b4e -21.114,201,5.8,1f35898d8b4e -21.222,201,3.9,89953d9764bd -21.329,201,5.1,89953d9764bd -21.438,201,5.6,89953d9764bd -21.545,201,6.9,89953d9764bd -21.653,201,6.8,1f35898d8b4e -21.765,201,3.7,1f35898d8b4e -21.869,201,4.3,1f35898d8b4e -21.978,201,4.5,1f35898d8b4e -22.088,201,4.1,1f35898d8b4e -22.195,201,3.7,89953d9764bd -22.303,201,4.1,89953d9764bd -22.408,201,3.6,89953d9764bd -22.516,201,4.5,89953d9764bd -22.624,201,3.5,1f35898d8b4e -22.732,201,5.2,1f35898d8b4e -22.842,201,3.6,1f35898d8b4e -22.95,201,5.6,1f35898d8b4e -23.059,201,3.8,1f35898d8b4e -23.167,201,3.9,1f35898d8b4e -23.274,201,4.0,89953d9764bd -23.382,201,3.0,89953d9764bd -23.486,201,4.0,1f35898d8b4e -23.591,201,5.1,1f35898d8b4e -23.701,201,2.6,1f35898d8b4e -23.809,201,3.4,1f35898d8b4e -23.915,201,2.9,89953d9764bd -24.021,201,3.2,89953d9764bd -24.128,201,3.7,89953d9764bd -24.234,201,5.5,1f35898d8b4e -24.341,201,4.5,1f35898d8b4e -24.446,201,5.3,1f35898d8b4e -24.554,201,3.9,89953d9764bd -24.658,201,4.7,89953d9764bd -24.768,201,4.6,89953d9764bd -24.877,201,3.7,89953d9764bd -24.982,201,3.7,1f35898d8b4e -25.09,201,3.7,1f35898d8b4e -25.195,201,4.5,1f35898d8b4e -25.3,201,3.2,89953d9764bd -25.408,201,3.4,89953d9764bd -25.512,201,3.6,1f35898d8b4e -25.615,201,5.5,1f35898d8b4e -25.726,201,3.2,1f35898d8b4e -25.83,201,3.0,89953d9764bd -25.933,201,3.2,1f35898d8b4e -26.036,201,7.3,1f35898d8b4e -26.146,201,4.2,89953d9764bd -26.251,201,3.7,89953d9764bd -26.358,201,4.7,89953d9764bd -26.466,201,3.3,89953d9764bd -26.57,201,2.6,1f35898d8b4e -26.678,201,3.3,1f35898d8b4e -26.783,201,3.4,89953d9764bd -26.889,201,5.3,89953d9764bd -26.997,201,6.7,89953d9764bd -27.108,201,3.3,89953d9764bd -27.214,201,4.9,1f35898d8b4e -27.324,201,4.7,1f35898d8b4e -27.43,201,4.3,1f35898d8b4e -27.537,201,3.6,1f35898d8b4e -27.641,201,4.1,89953d9764bd -27.749,201,3.7,89953d9764bd -27.854,201,5.6,1f35898d8b4e -27.959,201,5.4,1f35898d8b4e -28.066,201,3.5,1f35898d8b4e -28.174,201,4.2,89953d9764bd -28.281,201,3.5,89953d9764bd -28.39,201,4.2,89953d9764bd -28.499,201,5.0,89953d9764bd -28.609,201,4.6,89953d9764bd -28.719,201,3.5,89953d9764bd -28.825,201,5.5,89953d9764bd -28.933,201,5.3,89953d9764bd -29.039,201,4.0,1f35898d8b4e -29.146,201,5.1,1f35898d8b4e -29.256,201,6.6,1f35898d8b4e -29.368,201,3.4,1f35898d8b4e -29.476,201,5.6,1f35898d8b4e -29.586,201,5.7,1f35898d8b4e -29.695,201,3.6,89953d9764bd -29.8,201,5.8,89953d9764bd -29.91,201,5.1,89953d9764bd -30.018,201,3.1,89953d9764bd -30.122,201,4.9,1f35898d8b4e -30.228,201,3.2,1f35898d8b4e -30.334,201,5.4,1f35898d8b4e -30.442,201,6.1,89953d9764bd -30.554,201,7.2,89953d9764bd -30.661,201,5.7,89953d9764bd -30.772,201,6.1,89953d9764bd -30.881,201,4.3,89953d9764bd -30.989,201,5.2,89953d9764bd -31.099,201,5.9,89953d9764bd -31.209,201,5.1,89953d9764bd -31.316,201,5.4,89953d9764bd -31.425,201,6.6,89953d9764bd -31.535,201,6.3,89953d9764bd -31.642,201,5.2,1f35898d8b4e -31.748,201,4.2,1f35898d8b4e -31.854,201,5.6,1f35898d8b4e -31.961,201,4.1,89953d9764bd -32.069,201,4.0,89953d9764bd -32.178,201,5.6,89953d9764bd -32.288,201,6.7,89953d9764bd -32.396,201,3.8,89953d9764bd -32.502,201,3.6,1f35898d8b4e -32.61,201,3.8,1f35898d8b4e -32.718,201,3.7,1f35898d8b4e -32.825,201,6.5,1f35898d8b4e -32.935,201,5.7,89953d9764bd -33.046,201,4.5,1f35898d8b4e -33.155,201,4.4,89953d9764bd -33.261,201,3.6,89953d9764bd -33.369,201,3.9,89953d9764bd -33.475,201,8.7,89953d9764bd -33.585,201,5.2,1f35898d8b4e -33.695,201,4.1,1f35898d8b4e -33.803,201,3.8,1f35898d8b4e -33.912,201,5.8,1f35898d8b4e -34.021,201,3.9,1f35898d8b4e -34.129,201,5.0,1f35898d8b4e -34.239,201,6.0,1f35898d8b4e -34.345,201,3.7,89953d9764bd -34.45,201,3.6,89953d9764bd -34.558,201,6.4,89953d9764bd -34.667,201,5.9,89953d9764bd -34.775,201,6.0,89953d9764bd -34.882,201,4.1,1f35898d8b4e -34.992,201,3.9,1f35898d8b4e -35.1,201,3.6,1f35898d8b4e -35.205,201,3.5,89953d9764bd -35.312,201,3.2,89953d9764bd -35.419,201,3.8,89953d9764bd -35.526,201,3.4,89953d9764bd -35.632,201,3.3,1f35898d8b4e -35.738,201,6.1,1f35898d8b4e -35.846,201,6.9,1f35898d8b4e -35.957,201,4.0,89953d9764bd -36.066,201,4.1,1f35898d8b4e -36.173,201,8.2,89953d9764bd -36.286,201,5.4,1f35898d8b4e -36.393,201,4.4,89953d9764bd -36.498,201,3.7,89953d9764bd -36.606,201,3.9,89953d9764bd -36.711,201,4.1,1f35898d8b4e -36.817,201,4.2,1f35898d8b4e -36.926,201,5.5,1f35898d8b4e -37.034,201,4.2,89953d9764bd -37.138,201,4.0,89953d9764bd -37.247,201,5.5,89953d9764bd -37.358,201,5.0,89953d9764bd -37.463,201,4.7,1f35898d8b4e -37.569,201,4.1,1f35898d8b4e -37.678,201,3.4,1f35898d8b4e -37.787,201,3.5,1f35898d8b4e -37.891,201,3.8,89953d9764bd -37.999,201,3.6,89953d9764bd -38.108,201,4.1,89953d9764bd -38.215,201,3.8,1f35898d8b4e -38.319,201,4.8,1f35898d8b4e -38.426,201,4.0,1f35898d8b4e -38.535,201,4.3,1f35898d8b4e -38.643,201,5.0,89953d9764bd -38.752,201,4.1,89953d9764bd -38.859,201,4.9,89953d9764bd -38.966,201,4.5,89953d9764bd -39.072,201,3.5,1f35898d8b4e -39.178,201,6.6,1f35898d8b4e -39.286,201,4.8,1f35898d8b4e -39.395,201,3.8,89953d9764bd -39.498,201,4.7,89953d9764bd -39.608,201,4.6,89953d9764bd -39.718,201,4.1,89953d9764bd -39.827,201,3.9,89953d9764bd -39.932,201,3.8,1f35898d8b4e -40.041,201,5.4,1f35898d8b4e -40.149,201,3.6,1f35898d8b4e -40.257,201,6.0,1f35898d8b4e -40.368,201,4.1,1f35898d8b4e -40.475,201,5.8,1f35898d8b4e -40.582,201,3.9,89953d9764bd -40.688,201,4.4,89953d9764bd -40.794,201,3.5,1f35898d8b4e -40.898,201,4.2,1f35898d8b4e -41.004,201,3.4,89953d9764bd -41.111,201,2.9,89953d9764bd -41.214,201,3.6,1f35898d8b4e -41.323,201,2.9,1f35898d8b4e -41.429,201,3.3,1f35898d8b4e -41.534,201,4.7,89953d9764bd -41.638,201,3.1,89953d9764bd -41.742,201,3.6,1f35898d8b4e -41.849,201,2.7,1f35898d8b4e -41.952,201,3.0,89953d9764bd -42.058,201,4.1,89953d9764bd -42.163,201,7.2,1f35898d8b4e -42.272,201,4.0,1f35898d8b4e -42.38,201,4.7,1f35898d8b4e -42.486,201,6.0,1f35898d8b4e -42.593,201,7.7,89953d9764bd -42.702,201,6.3,89953d9764bd -42.811,201,4.1,89953d9764bd -42.92,201,3.7,89953d9764bd -43.028,201,2.8,89953d9764bd -43.133,201,4.6,1f35898d8b4e -43.241,201,4.5,1f35898d8b4e -43.346,201,5.9,1f35898d8b4e -43.454,201,5.9,89953d9764bd -43.561,201,3.4,89953d9764bd -43.668,201,6.6,89953d9764bd -43.779,201,8.9,89953d9764bd -43.89,201,3.9,89953d9764bd -43.999,201,4.3,89953d9764bd -44.108,201,4.5,89953d9764bd -44.215,201,4.8,89953d9764bd -44.325,201,4.8,89953d9764bd -44.431,201,2.9,1f35898d8b4e -44.535,201,2.5,89953d9764bd -44.639,201,4.4,89953d9764bd -44.744,201,6.4,1f35898d8b4e -44.853,201,4.7,1f35898d8b4e -44.958,201,5.7,1f35898d8b4e -45.067,201,8.6,1f35898d8b4e -45.177,201,7.6,1f35898d8b4e -45.288,201,6.5,1f35898d8b4e -45.397,201,3.4,1f35898d8b4e -45.501,201,3.6,89953d9764bd -45.609,201,4.7,89953d9764bd -45.715,201,4.5,89953d9764bd -45.822,201,5.7,1f35898d8b4e -45.933,201,3.9,1f35898d8b4e -46.042,201,5.4,1f35898d8b4e -46.152,201,3.6,1f35898d8b4e -46.259,201,5.4,1f35898d8b4e -46.365,201,5.7,89953d9764bd -46.476,201,4.5,1f35898d8b4e -46.585,201,4.6,89953d9764bd -46.691,201,3.8,89953d9764bd -46.8,201,5.3,89953d9764bd -46.908,201,4.7,89953d9764bd -47.018,201,3.0,89953d9764bd -47.126,201,3.8,89953d9764bd -47.235,201,4.0,89953d9764bd -47.343,201,3.6,1f35898d8b4e -47.449,201,3.5,1f35898d8b4e -47.555,201,2.9,89953d9764bd -47.659,201,3.4,89953d9764bd -47.766,201,3.3,89953d9764bd -47.874,201,3.9,1f35898d8b4e -47.98,201,5.0,1f35898d8b4e -48.087,201,3.5,1f35898d8b4e -48.194,201,3.9,89953d9764bd -48.299,201,3.4,89953d9764bd -48.407,201,3.3,89953d9764bd -48.514,201,7.2,89953d9764bd -48.622,201,3.7,1f35898d8b4e -48.729,201,3.8,1f35898d8b4e -48.833,201,4.5,89953d9764bd -48.943,201,4.2,89953d9764bd -49.051,201,6.0,89953d9764bd -49.158,201,3.5,89953d9764bd -49.265,201,4.0,89953d9764bd -49.369,201,3.2,1f35898d8b4e -49.478,201,5.9,1f35898d8b4e -49.589,201,4.8,1f35898d8b4e -49.698,201,4.1,1f35898d8b4e -49.804,201,4.6,89953d9764bd -49.914,201,5.0,89953d9764bd -50.019,201,7.7,89953d9764bd -50.128,201,3.9,89953d9764bd -50.236,201,4.1,89953d9764bd -50.341,201,6.2,1f35898d8b4e -50.452,201,7.5,1f35898d8b4e -50.565,201,7.1,1f35898d8b4e -50.674,201,3.9,1f35898d8b4e -50.781,201,6.3,1f35898d8b4e -50.892,201,5.8,1f35898d8b4e -51.0,201,4.8,1f35898d8b4e -51.11,201,6.7,1f35898d8b4e -51.218,201,5.4,1f35898d8b4e -51.325,201,4.8,89953d9764bd -51.434,201,6.9,89953d9764bd -51.542,201,6.2,89953d9764bd -51.65,201,8.2,89953d9764bd -51.759,201,3.2,89953d9764bd -51.863,201,5.0,1f35898d8b4e -51.969,201,6.5,1f35898d8b4e -52.079,201,3.1,1f35898d8b4e -52.185,201,4.3,89953d9764bd -52.29,201,3.5,89953d9764bd -52.398,201,4.7,89953d9764bd -52.508,201,5.4,89953d9764bd -52.617,201,6.3,89953d9764bd -52.728,201,5.7,89953d9764bd -52.837,201,5.5,89953d9764bd -52.947,201,6.1,89953d9764bd -53.058,201,5.9,89953d9764bd -53.169,201,3.4,89953d9764bd -53.277,201,3.8,89953d9764bd -53.382,201,3.0,1f35898d8b4e -53.488,201,5.7,1f35898d8b4e -53.596,201,5.0,1f35898d8b4e -53.703,201,5.5,89953d9764bd -53.812,201,3.5,89953d9764bd -53.917,201,4.4,89953d9764bd -54.022,201,4.4,1f35898d8b4e -54.128,201,4.9,1f35898d8b4e -54.237,201,5.7,1f35898d8b4e -54.347,201,4.7,1f35898d8b4e -54.454,201,5.3,89953d9764bd -54.562,201,5.7,89953d9764bd -54.672,201,3.6,89953d9764bd -54.777,201,4.1,89953d9764bd -54.886,201,4.8,89953d9764bd -54.993,201,4.3,1f35898d8b4e -55.1,201,3.9,1f35898d8b4e -55.207,201,6.2,1f35898d8b4e -55.315,201,6.1,1f35898d8b4e -55.425,201,3.7,1f35898d8b4e -55.531,201,4.3,89953d9764bd -55.638,201,5.0,89953d9764bd -55.747,201,5.0,89953d9764bd -55.857,201,6.1,89953d9764bd -55.964,201,4.1,1f35898d8b4e -56.069,201,4.9,1f35898d8b4e -56.177,201,4.5,1f35898d8b4e -56.282,201,4.7,89953d9764bd -56.387,201,5.9,89953d9764bd -56.497,201,4.4,89953d9764bd -56.604,201,4.3,1f35898d8b4e -56.713,201,5.9,1f35898d8b4e -56.822,201,4.9,1f35898d8b4e -56.928,201,4.9,1f35898d8b4e -57.037,201,4.2,1f35898d8b4e -57.146,201,3.4,1f35898d8b4e -57.251,201,3.8,89953d9764bd -57.355,201,4.0,1f35898d8b4e -57.461,201,4.4,1f35898d8b4e -57.566,201,4.3,1f35898d8b4e -57.673,201,4.1,89953d9764bd -57.782,201,5.9,89953d9764bd -57.891,201,2.9,89953d9764bd -57.996,201,5.7,89953d9764bd -58.107,201,4.4,89953d9764bd -58.217,201,3.9,89953d9764bd -58.325,201,4.8,89953d9764bd -58.43,201,3.1,1f35898d8b4e -58.537,201,4.7,1f35898d8b4e -58.643,201,6.8,89953d9764bd -58.755,201,5.2,89953d9764bd -58.864,201,6.2,89953d9764bd -58.975,201,4.3,1f35898d8b4e -59.08,201,3.5,89953d9764bd -59.187,201,5.3,89953d9764bd -59.296,201,5.6,89953d9764bd -59.407,201,7.0,89953d9764bd -59.519,201,6.5,89953d9764bd -59.629,201,4.7,89953d9764bd -59.738,201,3.4,89953d9764bd -59.842,201,5.7,1f35898d8b4e -59.95,201,5.9,1f35898d8b4e -60.059,201,4.3,1f35898d8b4e -60.165,201,4.2,89953d9764bd -60.27,201,4.8,89953d9764bd -60.38,201,3.7,89953d9764bd -60.486,201,5.6,89953d9764bd -60.593,201,3.3,1f35898d8b4e -60.701,201,5.7,1f35898d8b4e -60.808,201,5.1,1f35898d8b4e -60.918,201,3.8,1f35898d8b4e -61.027,201,6.1,1f35898d8b4e -61.138,201,3.5,1f35898d8b4e -61.245,201,4.1,89953d9764bd -61.35,201,4.8,89953d9764bd -61.459,201,5.9,89953d9764bd -61.567,201,7.6,89953d9764bd -61.679,201,4.2,89953d9764bd -61.786,201,5.8,89953d9764bd -61.892,201,4.8,1f35898d8b4e -62.0,201,4.4,1f35898d8b4e -62.109,201,5.6,1f35898d8b4e -62.216,201,6.5,1f35898d8b4e -62.324,201,6.0,89953d9764bd -62.431,201,6.5,89953d9764bd -62.538,201,6.9,89953d9764bd -62.649,201,7.1,89953d9764bd -62.758,201,5.0,89953d9764bd -62.866,201,4.6,89953d9764bd -62.976,201,6.5,89953d9764bd -63.087,201,5.5,89953d9764bd -63.198,201,3.9,89953d9764bd -63.303,201,4.7,1f35898d8b4e -63.413,201,3.4,1f35898d8b4e -63.521,201,3.1,1f35898d8b4e -63.628,201,4.3,1f35898d8b4e -63.736,201,3.7,89953d9764bd -63.841,201,5.3,89953d9764bd -63.95,201,6.2,89953d9764bd -64.057,201,4.1,89953d9764bd -64.163,201,4.1,1f35898d8b4e -64.273,201,2.8,1f35898d8b4e -64.378,201,3.0,1f35898d8b4e -64.486,201,3.0,1f35898d8b4e -64.59,201,3.3,89953d9764bd -64.694,201,3.0,1f35898d8b4e -64.798,201,4.4,1f35898d8b4e -64.904,201,4.2,89953d9764bd -65.01,201,4.7,89953d9764bd -65.116,201,6.0,89953d9764bd -65.223,201,4.2,1f35898d8b4e -65.331,201,5.0,1f35898d8b4e -65.44,201,5.4,1f35898d8b4e -65.551,201,6.0,1f35898d8b4e -65.659,201,5.2,1f35898d8b4e -65.767,201,6.3,1f35898d8b4e -65.877,201,6.0,1f35898d8b4e -65.985,201,5.3,89953d9764bd -66.092,201,5.3,89953d9764bd -66.2,201,4.5,89953d9764bd -66.307,201,5.1,89953d9764bd -66.415,201,3.2,1f35898d8b4e -66.519,201,7.7,1f35898d8b4e -66.628,201,5.3,1f35898d8b4e -66.737,201,5.1,1f35898d8b4e -66.844,201,6.7,89953d9764bd -66.951,201,6.8,89953d9764bd -67.059,201,5.8,89953d9764bd -67.17,201,5.6,89953d9764bd -67.277,201,3.6,89953d9764bd -67.386,201,3.9,89953d9764bd -67.493,201,4.2,1f35898d8b4e -67.6,201,2.7,1f35898d8b4e -67.708,201,4.1,1f35898d8b4e -67.816,201,3.5,1f35898d8b4e -67.925,201,4.7,89953d9764bd -68.032,201,4.0,89953d9764bd -68.141,201,3.1,89953d9764bd -68.249,201,4.1,89953d9764bd -68.358,201,6.0,89953d9764bd -68.466,201,7.7,89953d9764bd -68.579,201,4.2,89953d9764bd -68.685,201,4.3,89953d9764bd -68.794,201,4.3,89953d9764bd -68.901,201,5.8,1f35898d8b4e -69.008,201,5.9,1f35898d8b4e -69.116,201,4.8,1f35898d8b4e -69.225,201,4.9,1f35898d8b4e -69.335,201,3.7,89953d9764bd -69.442,201,4.1,89953d9764bd -69.549,201,5.9,89953d9764bd -69.66,201,4.7,89953d9764bd -69.77,201,5.1,89953d9764bd -69.877,201,4.5,89953d9764bd -69.983,201,5.5,1f35898d8b4e -70.092,201,5.0,1f35898d8b4e -70.2,201,6.8,1f35898d8b4e -70.312,201,5.0,1f35898d8b4e -70.422,201,4.0,1f35898d8b4e -70.527,201,5.0,1f35898d8b4e -70.633,201,3.2,89953d9764bd -70.74,201,3.9,89953d9764bd -70.845,201,3.3,1f35898d8b4e -70.95,201,4.5,1f35898d8b4e -71.058,201,5.4,1f35898d8b4e -71.166,201,5.2,1f35898d8b4e -71.271,201,6.2,89953d9764bd -71.378,201,4.8,89953d9764bd -71.484,201,7.2,89953d9764bd -71.592,201,6.0,1f35898d8b4e -71.703,201,7.1,1f35898d8b4e -71.811,201,6.6,1f35898d8b4e -71.921,201,8.3,1f35898d8b4e -72.03,201,3.8,1f35898d8b4e -72.138,201,3.5,1f35898d8b4e -72.243,201,5.0,89953d9764bd -72.352,201,4.7,89953d9764bd -72.458,201,4.1,89953d9764bd -72.568,201,6.3,89953d9764bd -72.678,201,4.9,89953d9764bd -72.787,201,6.6,89953d9764bd -72.897,201,4.0,89953d9764bd -73.002,201,4.5,1f35898d8b4e -73.109,201,3.7,1f35898d8b4e -73.216,201,6.4,1f35898d8b4e -73.325,201,5.7,1f35898d8b4e -73.434,201,5.6,89953d9764bd -73.541,201,7.7,89953d9764bd -73.65,201,4.8,89953d9764bd -73.758,201,5.3,89953d9764bd -73.867,201,4.7,89953d9764bd -73.976,201,6.0,89953d9764bd -74.087,201,6.3,89953d9764bd -74.195,201,5.8,89953d9764bd -74.303,201,6.0,1f35898d8b4e -74.414,201,5.6,89953d9764bd -74.524,201,5.4,1f35898d8b4e -74.635,201,5.7,89953d9764bd -74.741,201,5.3,1f35898d8b4e -74.85,201,6.5,1f35898d8b4e -74.961,201,5.8,1f35898d8b4e -75.069,201,8.2,89953d9764bd -75.181,201,10.1,1f35898d8b4e -75.293,201,11.0,89953d9764bd -75.408,201,5.5,1f35898d8b4e +-25.84,201,4.3,6c2a02267340 +-25.735,201,4.0,158dfc1bd95d +-25.631,201,3.4,6c2a02267340 +-25.525,201,5.8,158dfc1bd95d +-25.413,201,4.1,6c2a02267340 +-25.302,201,4.3,158dfc1bd95d +-25.188,201,5.0,158dfc1bd95d +-25.075,201,6.7,6c2a02267340 +-24.959,201,3.7,158dfc1bd95d +-24.847,201,3.7,6c2a02267340 +-24.733,201,4.4,6c2a02267340 +-24.628,201,5.8,6c2a02267340 +-24.512,201,5.0,6c2a02267340 +-24.405,201,4.1,6c2a02267340 +-24.295,201,5.0,6c2a02267340 +-24.182,201,3.9,6c2a02267340 +-24.07,201,3.0,6c2a02267340 +-23.959,201,4.3,158dfc1bd95d +-23.854,201,3.8,6c2a02267340 +-23.74,201,4.9,6c2a02267340 +-23.627,201,4.3,6c2a02267340 +-23.513,201,5.4,158dfc1bd95d +-23.406,201,4.8,158dfc1bd95d +-23.294,201,4.3,158dfc1bd95d +-23.183,201,3.2,158dfc1bd95d +-23.074,201,2.8,158dfc1bd95d +-22.961,201,3.4,158dfc1bd95d +-22.85,201,4.6,158dfc1bd95d +-22.737,201,3.4,6c2a02267340 +-22.625,201,5.1,6c2a02267340 +-22.513,201,3.8,6c2a02267340 +-22.405,201,4.3,6c2a02267340 +-22.299,201,3.4,6c2a02267340 +-22.186,201,3.5,6c2a02267340 +-22.078,201,4.5,6c2a02267340 +-21.963,201,5.6,6c2a02267340 +-21.851,201,4.4,6c2a02267340 +-21.743,201,5.1,6c2a02267340 +-21.629,201,4.7,158dfc1bd95d +-21.524,201,5.7,6c2a02267340 +-21.416,201,4.2,6c2a02267340 +-21.303,201,3.4,6c2a02267340 +-21.193,201,3.6,6c2a02267340 +-21.084,201,5.6,6c2a02267340 +-20.974,201,5.5,6c2a02267340 +-20.858,201,6.9,158dfc1bd95d +-20.743,201,5.0,158dfc1bd95d +-20.628,201,5.2,6c2a02267340 +-20.517,201,3.8,6c2a02267340 +-20.409,201,3.4,158dfc1bd95d +-20.297,201,4.0,6c2a02267340 +-20.184,201,6.9,6c2a02267340 +-20.071,201,5.3,6c2a02267340 +-19.964,201,4.9,6c2a02267340 +-19.849,201,6.1,158dfc1bd95d +-19.737,201,5.0,158dfc1bd95d +-19.63,201,4.6,6c2a02267340 +-19.523,201,3.6,6c2a02267340 +-19.411,201,3.4,6c2a02267340 +-19.298,201,4.8,158dfc1bd95d +-19.183,201,4.4,158dfc1bd95d +-19.073,201,4.4,158dfc1bd95d +-18.966,201,4.4,158dfc1bd95d +-18.856,201,5.2,158dfc1bd95d +-18.741,201,5.3,158dfc1bd95d +-18.629,201,3.3,158dfc1bd95d +-18.524,201,4.6,158dfc1bd95d +-18.416,201,4.2,158dfc1bd95d +-18.306,201,4.0,158dfc1bd95d +-18.194,201,4.5,158dfc1bd95d +-18.085,201,4.7,158dfc1bd95d +-17.97,201,4.2,158dfc1bd95d +-17.859,201,5.3,6c2a02267340 +-17.743,201,2.9,6c2a02267340 +-17.64,201,4.4,158dfc1bd95d +-17.528,201,4.2,6c2a02267340 +-17.417,201,5.1,6c2a02267340 +-17.307,201,4.1,6c2a02267340 +-17.196,201,4.1,6c2a02267340 +-17.087,201,3.7,6c2a02267340 +-16.976,201,4.8,6c2a02267340 +-16.867,201,3.9,6c2a02267340 +-16.763,201,3.2,158dfc1bd95d +-16.654,201,4.4,158dfc1bd95d +-16.543,201,4.9,158dfc1bd95d +-16.428,201,5.1,6c2a02267340 +-16.313,201,4.9,6c2a02267340 +-16.2,201,5.7,158dfc1bd95d +-16.093,201,3.3,6c2a02267340 +-15.981,201,3.8,6c2a02267340 +-15.874,201,4.5,6c2a02267340 +-15.768,201,4.6,6c2a02267340 +-15.659,201,7.0,6c2a02267340 +-15.552,201,4.8,158dfc1bd95d +-15.446,201,4.8,158dfc1bd95d +-15.336,201,4.9,158dfc1bd95d +-15.231,201,5.8,6c2a02267340 +-15.119,201,5.8,158dfc1bd95d +-15.003,201,6.2,6c2a02267340 +-14.895,201,4.9,6c2a02267340 +-14.783,201,3.7,6c2a02267340 +-14.669,201,6.8,158dfc1bd95d +-14.56,201,4.8,6c2a02267340 +-14.452,201,6.4,6c2a02267340 +-14.34,201,6.0,6c2a02267340 +-14.224,201,4.3,158dfc1bd95d +-14.117,201,5.4,6c2a02267340 +-14.004,201,4.6,158dfc1bd95d +-13.895,201,3.8,158dfc1bd95d +-13.781,201,4.7,158dfc1bd95d +-13.669,201,5.0,6c2a02267340 +-13.564,201,5.6,158dfc1bd95d +-13.453,201,3.9,158dfc1bd95d +-13.339,201,5.0,6c2a02267340 +-13.226,201,3.3,6c2a02267340 +-13.116,201,4.1,6c2a02267340 +-13.006,201,3.9,6c2a02267340 +-12.901,201,2.9,158dfc1bd95d +-12.794,201,3.8,158dfc1bd95d +-12.689,201,4.3,6c2a02267340 +-12.575,201,2.5,158dfc1bd95d +-12.464,201,2.9,158dfc1bd95d +-12.354,201,3.8,158dfc1bd95d +-12.246,201,4.1,158dfc1bd95d +-12.14,201,4.2,6c2a02267340 +-12.033,201,3.3,6c2a02267340 +-11.92,201,4.5,6c2a02267340 +-11.806,201,5.5,158dfc1bd95d +-11.69,201,3.1,158dfc1bd95d +-11.581,201,2.6,158dfc1bd95d +-11.476,201,3.1,158dfc1bd95d +-11.366,201,5.0,158dfc1bd95d +-11.259,201,4.3,158dfc1bd95d +-11.144,201,3.3,158dfc1bd95d +-11.033,201,3.7,158dfc1bd95d +-10.924,201,5.5,158dfc1bd95d +-10.81,201,5.1,158dfc1bd95d +-10.703,201,5.2,158dfc1bd95d +-10.588,201,5.9,158dfc1bd95d +-10.477,201,5.3,6c2a02267340 +-10.367,201,4.6,6c2a02267340 +-10.254,201,6.2,6c2a02267340 +-10.142,201,6.4,6c2a02267340 +-10.03,201,5.9,158dfc1bd95d +-9.914,201,8.2,158dfc1bd95d +-9.803,201,5.0,158dfc1bd95d +-9.693,201,5.0,158dfc1bd95d +-9.581,201,5.8,158dfc1bd95d +-9.472,201,4.8,158dfc1bd95d +-9.359,201,5.0,158dfc1bd95d +-9.251,201,4.6,158dfc1bd95d +-9.143,201,3.3,158dfc1bd95d +-9.038,201,3.3,6c2a02267340 +-8.934,201,4.7,6c2a02267340 +-8.82,201,5.3,158dfc1bd95d +-8.706,201,7.8,158dfc1bd95d +-8.594,201,4.0,158dfc1bd95d +-8.483,201,5.4,158dfc1bd95d +-8.37,201,5.1,158dfc1bd95d +-8.261,201,5.6,158dfc1bd95d +-8.149,201,3.2,158dfc1bd95d +-8.04,201,3.1,158dfc1bd95d +-7.927,201,5.3,6c2a02267340 +-7.82,201,3.9,158dfc1bd95d +-7.713,201,4.7,158dfc1bd95d +-7.608,201,4.7,158dfc1bd95d +-7.503,201,3.8,6c2a02267340 +-7.398,201,3.5,6c2a02267340 +-7.291,201,4.6,158dfc1bd95d +-7.185,201,5.4,158dfc1bd95d +-7.075,201,4.4,158dfc1bd95d +-6.97,201,4.9,158dfc1bd95d +-6.859,201,4.4,158dfc1bd95d +-6.746,201,4.5,158dfc1bd95d +-6.632,201,4.0,158dfc1bd95d +-6.525,201,3.5,158dfc1bd95d +-6.42,201,3.6,6c2a02267340 +-6.313,201,3.5,6c2a02267340 +-6.208,201,5.1,6c2a02267340 +-6.093,201,5.2,6c2a02267340 +-5.979,201,5.2,6c2a02267340 +-5.872,201,5.1,6c2a02267340 +-5.761,201,4.9,6c2a02267340 +-5.651,201,4.3,6c2a02267340 +-5.542,201,3.7,6c2a02267340 +-5.434,201,3.0,6c2a02267340 +-5.33,201,5.4,6c2a02267340 +-5.215,201,5.2,6c2a02267340 +-5.103,201,4.5,6c2a02267340 +-4.996,201,4.4,6c2a02267340 +-4.887,201,4.5,6c2a02267340 +-4.777,201,4.8,6c2a02267340 +-4.668,201,4.0,6c2a02267340 +-4.556,201,3.6,6c2a02267340 +-4.444,201,6.1,6c2a02267340 +-4.335,201,7.3,6c2a02267340 +-4.224,201,5.6,6c2a02267340 +-4.115,201,5.7,6c2a02267340 +-4.006,201,6.2,6c2a02267340 +-3.895,201,5.0,6c2a02267340 +-3.788,201,3.1,158dfc1bd95d +-3.674,201,3.2,6c2a02267340 +-3.567,201,3.6,6c2a02267340 +-3.462,201,4.0,158dfc1bd95d +-3.355,201,4.7,158dfc1bd95d +-3.242,201,5.6,158dfc1bd95d +-3.135,201,3.8,158dfc1bd95d +-3.023,201,4.9,158dfc1bd95d +-2.913,201,4.3,158dfc1bd95d +-2.8,201,3.5,158dfc1bd95d +-2.693,201,3.8,158dfc1bd95d +-2.585,201,5.0,158dfc1bd95d +-2.478,201,4.2,158dfc1bd95d +-2.367,201,4.0,158dfc1bd95d +-2.253,201,5.4,158dfc1bd95d +-2.146,201,4.6,158dfc1bd95d +-2.033,201,4.1,158dfc1bd95d +-1.923,201,3.2,158dfc1bd95d +-1.815,201,3.0,158dfc1bd95d +-1.702,201,4.5,158dfc1bd95d +-1.59,201,4.8,158dfc1bd95d +-1.485,201,3.6,158dfc1bd95d +-1.381,201,4.0,6c2a02267340 +-1.266,201,3.9,158dfc1bd95d +-1.153,201,5.2,158dfc1bd95d +-1.047,201,3.2,158dfc1bd95d +-0.934,201,3.6,158dfc1bd95d +-0.821,201,4.8,158dfc1bd95d +-0.712,201,4.9,158dfc1bd95d +-0.603,201,5.3,158dfc1bd95d +-0.494,201,3.6,158dfc1bd95d +-0.39,201,3.9,6c2a02267340 +-0.276,201,3.7,158dfc1bd95d +-0.165,201,9.0,158dfc1bd95d +-0.053,201,3.4,158dfc1bd95d +0.057,201,4.7,158dfc1bd95d +0.163,201,3.6,158dfc1bd95d +0.276,201,7.2,158dfc1bd95d +0.384,201,3.8,158dfc1bd95d +0.488,201,3.6,6c2a02267340 +0.593,201,4.3,158dfc1bd95d +0.699,201,3.9,158dfc1bd95d +0.804,201,5.1,158dfc1bd95d +0.915,201,8.1,158dfc1bd95d +1.029,201,3.9,158dfc1bd95d +1.139,201,4.1,158dfc1bd95d +1.252,201,4.5,6c2a02267340 +1.359,201,4.0,158dfc1bd95d +1.463,201,4.2,158dfc1bd95d +1.569,201,4.9,6c2a02267340 +1.678,201,4.9,6c2a02267340 +1.792,201,4.4,158dfc1bd95d +1.897,201,7.5,6c2a02267340 +2.012,201,5.3,158dfc1bd95d +2.119,201,4.6,6c2a02267340 +2.226,201,3.6,6c2a02267340 +2.332,201,3.9,158dfc1bd95d +2.441,201,4.4,158dfc1bd95d +2.554,201,4.0,6c2a02267340 +2.668,201,3.7,6c2a02267340 +2.776,201,3.6,6c2a02267340 +2.884,201,5.1,6c2a02267340 +2.993,201,3.4,6c2a02267340 +3.101,201,3.9,6c2a02267340 +3.207,201,4.8,158dfc1bd95d +3.321,201,4.6,6c2a02267340 +3.429,201,9.7,158dfc1bd95d +3.547,201,6.4,6c2a02267340 +3.656,201,5.6,6c2a02267340 +3.766,201,4.0,6c2a02267340 +3.877,201,5.2,6c2a02267340 +3.992,201,4.1,158dfc1bd95d +4.104,201,4.5,158dfc1bd95d +4.218,201,3.8,158dfc1bd95d +4.327,201,4.0,158dfc1bd95d +4.441,201,4.5,158dfc1bd95d +4.553,201,4.9,c2f5d82dee7c +4.665,201,5.9,c2f5d82dee7c +4.78,201,4.1,c2f5d82dee7c +4.892,201,3.5,c2f5d82dee7c +4.999,201,3.0,c2f5d82dee7c +5.11,201,5.6,c2f5d82dee7c +5.217,201,4.3,c2f5d82dee7c +5.324,201,4.7,c2f5d82dee7c +5.436,201,4.5,c2f5d82dee7c +5.545,201,3.9,c2f5d82dee7c +5.654,201,3.8,c2f5d82dee7c +5.765,201,4.8,c2f5d82dee7c +5.88,201,3.3,c2f5d82dee7c +5.986,201,2.4,c2f5d82dee7c +6.096,201,4.8,c2f5d82dee7c +6.21,201,4.4,c2f5d82dee7c +6.32,201,3.9,c2f5d82dee7c +6.425,201,3.4,c2f5d82dee7c +6.528,201,3.5,158dfc1bd95d +6.633,201,3.8,158dfc1bd95d +6.74,201,3.4,c2f5d82dee7c +6.846,201,4.3,c2f5d82dee7c +6.954,201,3.6,c2f5d82dee7c +7.065,201,3.9,c2f5d82dee7c +7.176,201,4.1,c2f5d82dee7c +7.289,201,4.0,c2f5d82dee7c +7.401,201,6.0,158dfc1bd95d +7.517,201,3.6,158dfc1bd95d +7.629,201,2.9,158dfc1bd95d +7.736,201,3.9,158dfc1bd95d +7.845,201,4.2,158dfc1bd95d +7.956,201,5.1,158dfc1bd95d +8.071,201,4.3,c2f5d82dee7c +8.186,201,5.7,c2f5d82dee7c +8.292,201,3.6,c2f5d82dee7c +8.406,201,4.9,c2f5d82dee7c +8.517,201,2.9,c2f5d82dee7c +8.63,201,5.6,c2f5d82dee7c +8.742,201,4.4,158dfc1bd95d +8.857,201,5.4,158dfc1bd95d +8.972,201,4.7,c2f5d82dee7c +9.081,201,4.5,c2f5d82dee7c +9.19,201,4.2,158dfc1bd95d +9.297,201,4.8,158dfc1bd95d +9.405,201,3.5,158dfc1bd95d +9.519,201,5.6,65d10d346f4e +9.627,201,5.4,65d10d346f4e +9.734,201,4.5,65d10d346f4e +9.843,201,6.2,65d10d346f4e +9.959,201,5.1,65d10d346f4e +10.065,201,3.2,65d10d346f4e +10.178,201,3.1,65d10d346f4e +10.288,201,3.5,65d10d346f4e +10.401,201,6.0,c2f5d82dee7c +10.514,201,3.7,c2f5d82dee7c +10.626,201,4.8,c2f5d82dee7c +10.74,201,4.1,c2f5d82dee7c +10.853,201,4.6,65d10d346f4e +10.963,201,3.2,65d10d346f4e +11.072,201,4.3,65d10d346f4e +11.186,201,4.1,65d10d346f4e +11.291,201,7.7,65d10d346f4e +11.406,201,7.2,65d10d346f4e +11.52,201,4.9,65d10d346f4e +11.633,201,2.9,c2f5d82dee7c +11.745,201,3.3,c2f5d82dee7c +11.854,201,3.3,c2f5d82dee7c +11.968,201,3.0,c2f5d82dee7c +12.078,201,4.7,c2f5d82dee7c +12.191,201,4.8,65d10d346f4e +12.3,201,6.5,c2f5d82dee7c +12.416,201,4.8,65d10d346f4e +12.531,201,4.5,65d10d346f4e +12.646,201,4.0,c2f5d82dee7c +12.756,201,3.4,c2f5d82dee7c +12.86,201,3.0,65d10d346f4e +12.97,201,3.1,65d10d346f4e +13.08,201,4.9,c2f5d82dee7c +13.192,201,5.3,c2f5d82dee7c +13.306,201,3.7,c2f5d82dee7c +13.414,201,4.8,c2f5d82dee7c +13.526,201,5.3,c2f5d82dee7c +13.64,201,3.0,c2f5d82dee7c +13.751,201,3.6,c2f5d82dee7c +13.862,201,4.3,65d10d346f4e +13.976,201,4.5,65d10d346f4e +14.085,201,3.8,65d10d346f4e +14.193,201,4.3,65d10d346f4e +14.307,201,4.5,65d10d346f4e +14.415,201,3.9,65d10d346f4e +14.529,201,4.1,65d10d346f4e +14.635,201,3.1,65d10d346f4e +14.748,201,4.8,65d10d346f4e +14.863,201,5.1,c2f5d82dee7c +14.977,201,6.2,c2f5d82dee7c +15.089,201,3.8,c2f5d82dee7c +15.195,201,4.9,c2f5d82dee7c +15.306,201,3.7,c2f5d82dee7c +15.417,201,2.8,c2f5d82dee7c +15.523,201,3.8,c2f5d82dee7c +15.634,201,4.2,c2f5d82dee7c +15.738,201,5.9,65d10d346f4e +15.852,201,4.7,c2f5d82dee7c +15.966,201,5.5,c2f5d82dee7c +16.081,201,3.7,c2f5d82dee7c +16.186,201,3.3,c2f5d82dee7c +16.296,201,3.3,c2f5d82dee7c +16.405,201,2.9,c2f5d82dee7c +16.514,201,4.2,c2f5d82dee7c +16.621,201,4.5,65d10d346f4e +16.729,201,3.9,65d10d346f4e +16.838,201,4.1,65d10d346f4e +16.947,201,4.4,65d10d346f4e +17.054,201,4.1,65d10d346f4e +17.168,201,2.9,65d10d346f4e +17.271,201,4.7,65d10d346f4e +17.383,201,5.2,65d10d346f4e +17.495,201,5.8,65d10d346f4e +17.611,201,5.7,c2f5d82dee7c +17.722,201,4.9,c2f5d82dee7c +17.836,201,4.7,c2f5d82dee7c +17.947,201,5.4,c2f5d82dee7c +18.059,201,4.7,c2f5d82dee7c +18.17,201,5.1,c2f5d82dee7c +18.276,201,3.2,c2f5d82dee7c +18.387,201,3.3,c2f5d82dee7c +18.498,201,4.3,c2f5d82dee7c +18.603,201,4.5,c2f5d82dee7c +18.711,201,4.0,65d10d346f4e +18.819,201,4.4,65d10d346f4e +18.934,201,4.1,c2f5d82dee7c +19.041,201,4.7,65d10d346f4e +19.151,201,3.4,65d10d346f4e +19.262,201,3.6,65d10d346f4e +19.376,201,4.4,c2f5d82dee7c +19.48,201,4.4,65d10d346f4e +19.586,201,6.1,65d10d346f4e +19.702,201,5.3,c2f5d82dee7c +19.812,201,5.8,c2f5d82dee7c +19.922,201,4.5,65d10d346f4e +20.036,201,9.7,c2f5d82dee7c +20.155,201,11.4,65d10d346f4e +20.266,201,41.3,65d10d346f4e +20.415,201,7.7,65d10d346f4e +20.526,201,11.3,65d10d346f4e +20.645,201,126.5,65d10d346f4e +20.881,201,21.0,65d10d346f4e +21.009,201,29.7,c2f5d82dee7c +21.142,201,4.7,65d10d346f4e +21.246,201,3.4,c2f5d82dee7c +21.356,201,4.2,c2f5d82dee7c +21.466,201,3.7,c2f5d82dee7c +21.57,201,4.9,65d10d346f4e +21.676,201,3.5,65d10d346f4e +21.787,201,3.9,65d10d346f4e +21.893,201,3.9,c2f5d82dee7c +22.005,201,4.1,65d10d346f4e +22.111,201,5.0,65d10d346f4e +22.217,201,3.8,c2f5d82dee7c +22.331,201,4.5,65d10d346f4e +22.439,201,4.6,c2f5d82dee7c +22.553,201,2.9,65d10d346f4e +22.666,201,2.8,65d10d346f4e +22.777,201,4.8,65d10d346f4e +22.884,201,7.5,65d10d346f4e +22.994,201,5.6,65d10d346f4e +23.109,201,5.1,65d10d346f4e +23.223,201,5.4,c2f5d82dee7c +23.338,201,4.8,c2f5d82dee7c +23.453,201,5.0,65d10d346f4e +23.563,201,3.6,65d10d346f4e +23.67,201,4.6,c2f5d82dee7c +23.782,201,3.9,65d10d346f4e +23.887,201,4.4,c2f5d82dee7c +24.001,201,4.4,65d10d346f4e +24.105,201,3.9,c2f5d82dee7c +24.215,201,4.1,c2f5d82dee7c +24.321,201,2.7,65d10d346f4e +24.433,201,2.7,c2f5d82dee7c +24.537,201,2.8,65d10d346f4e +24.649,201,3.6,65d10d346f4e +24.757,201,3.9,65d10d346f4e +24.867,201,3.4,65d10d346f4e +24.977,201,2.9,65d10d346f4e +25.086,201,3.7,65d10d346f4e +25.195,201,3.3,65d10d346f4e +25.301,201,2.8,c2f5d82dee7c +25.412,201,4.2,65d10d346f4e +25.521,201,3.1,c2f5d82dee7c +25.626,201,4.5,c2f5d82dee7c +25.739,201,4.9,c2f5d82dee7c +25.844,201,3.3,c2f5d82dee7c +25.957,201,3.6,c2f5d82dee7c +26.061,201,3.4,65d10d346f4e +26.166,201,3.4,65d10d346f4e +26.275,201,2.7,65d10d346f4e +26.385,201,4.5,65d10d346f4e +26.492,201,4.3,c2f5d82dee7c +26.601,201,4.0,65d10d346f4e +26.708,201,3.9,c2f5d82dee7c +26.817,201,3.8,c2f5d82dee7c +26.925,201,5.6,c2f5d82dee7c +27.034,201,4.1,c2f5d82dee7c +27.141,201,3.2,65d10d346f4e +27.251,201,3.1,65d10d346f4e +27.357,201,4.3,65d10d346f4e +27.467,201,2.8,65d10d346f4e +27.576,201,3.3,65d10d346f4e +27.682,201,4.0,c2f5d82dee7c +27.788,201,3.2,c2f5d82dee7c +27.9,201,3.9,c2f5d82dee7c +28.011,201,5.4,c2f5d82dee7c +28.123,201,4.6,65d10d346f4e +28.229,201,4.5,c2f5d82dee7c +28.335,201,3.7,c2f5d82dee7c +28.449,201,3.8,c2f5d82dee7c +28.554,201,4.5,c2f5d82dee7c +28.666,201,3.9,c2f5d82dee7c +28.779,201,3.4,c2f5d82dee7c +28.884,201,2.6,c2f5d82dee7c +28.994,201,4.8,c2f5d82dee7c +29.103,201,3.8,65d10d346f4e +29.214,201,5.0,c2f5d82dee7c +29.324,201,6.4,c2f5d82dee7c +29.438,201,4.1,c2f5d82dee7c +29.552,201,2.6,c2f5d82dee7c +29.664,201,2.5,65d10d346f4e +29.767,201,3.2,c2f5d82dee7c +29.88,201,14.2,c2f5d82dee7c +30.002,201,4.0,c2f5d82dee7c +30.108,201,4.3,65d10d346f4e +30.216,201,4.1,65d10d346f4e +30.328,201,4.2,65d10d346f4e +30.439,201,3.8,65d10d346f4e +30.551,201,2.7,65d10d346f4e +30.661,201,2.6,65d10d346f4e +30.773,201,4.8,c2f5d82dee7c +30.88,201,3.7,65d10d346f4e +30.994,201,3.9,c2f5d82dee7c +31.101,201,3.8,65d10d346f4e +31.208,201,3.9,65d10d346f4e +31.32,201,3.4,65d10d346f4e +31.431,201,2.9,65d10d346f4e +31.538,201,2.9,65d10d346f4e +31.644,201,4.0,65d10d346f4e +31.749,201,5.8,c2f5d82dee7c +31.864,201,4.7,65d10d346f4e +31.979,201,3.9,65d10d346f4e +32.087,201,3.8,65d10d346f4e +32.196,201,3.0,65d10d346f4e +32.304,201,4.2,65d10d346f4e +32.415,201,3.3,65d10d346f4e +32.527,201,4.9,65d10d346f4e +32.634,201,3.6,65d10d346f4e +32.741,201,6.3,65d10d346f4e +32.857,201,5.0,65d10d346f4e +32.965,201,3.0,65d10d346f4e +33.073,201,4.4,65d10d346f4e +33.181,201,3.3,c2f5d82dee7c +33.289,201,2.9,c2f5d82dee7c +33.399,201,4.7,c2f5d82dee7c +33.513,201,4.1,65d10d346f4e +33.622,201,5.1,65d10d346f4e +33.737,201,4.9,65d10d346f4e +33.848,201,3.0,65d10d346f4e +33.957,201,4.5,65d10d346f4e +34.068,201,3.9,65d10d346f4e +34.182,201,3.0,c2f5d82dee7c +34.292,201,2.8,65d10d346f4e +34.403,201,3.9,c2f5d82dee7c +34.515,201,2.9,c2f5d82dee7c +34.62,201,3.3,65d10d346f4e +34.725,201,4.4,65d10d346f4e +34.834,201,2.7,65d10d346f4e +34.946,201,3.9,65d10d346f4e +35.058,201,2.8,65d10d346f4e +35.161,201,3.0,c2f5d82dee7c +35.27,201,3.4,c2f5d82dee7c +35.376,201,4.1,c2f5d82dee7c +35.487,201,3.1,c2f5d82dee7c +35.6,201,3.2,c2f5d82dee7c +35.708,201,2.9,c2f5d82dee7c +35.821,201,3.3,c2f5d82dee7c +35.931,201,4.5,65d10d346f4e +36.045,201,5.2,65d10d346f4e +36.154,201,4.3,65d10d346f4e +36.261,201,4.1,c2f5d82dee7c +36.374,201,4.6,65d10d346f4e +36.489,201,5.7,65d10d346f4e +36.605,201,3.4,c2f5d82dee7c +36.714,201,3.2,c2f5d82dee7c +36.827,201,4.6,c2f5d82dee7c +36.938,201,5.1,c2f5d82dee7c +37.053,201,4.7,65d10d346f4e +37.158,201,4.4,c2f5d82dee7c +37.268,201,3.5,c2f5d82dee7c +37.382,201,4.3,65d10d346f4e +37.496,201,3.7,65d10d346f4e +37.6,201,3.4,c2f5d82dee7c +37.71,201,3.5,c2f5d82dee7c +37.817,201,5.5,c2f5d82dee7c +37.93,201,5.0,c2f5d82dee7c +38.044,201,6.7,65d10d346f4e +38.151,201,6.6,65d10d346f4e +38.259,201,4.2,c2f5d82dee7c +38.37,201,4.1,c2f5d82dee7c +38.475,201,3.6,c2f5d82dee7c +38.585,201,3.2,c2f5d82dee7c +38.694,201,4.9,c2f5d82dee7c +38.808,201,4.2,c2f5d82dee7c +38.915,201,3.2,c2f5d82dee7c +39.024,201,5.7,c2f5d82dee7c +39.135,201,4.5,c2f5d82dee7c +39.24,201,4.9,65d10d346f4e +39.347,201,4.8,65d10d346f4e +39.453,201,3.6,65d10d346f4e +39.559,201,4.4,c2f5d82dee7c +39.674,201,4.0,65d10d346f4e +39.78,201,4.7,c2f5d82dee7c +39.888,201,4.2,c2f5d82dee7c +39.995,201,5.7,c2f5d82dee7c +40.107,201,3.2,c2f5d82dee7c +40.21,201,4.6,65d10d346f4e +40.316,201,4.9,65d10d346f4e +40.431,201,3.6,65d10d346f4e +40.537,201,3.4,65d10d346f4e +40.65,201,3.8,65d10d346f4e +40.763,201,4.7,c2f5d82dee7c +40.873,201,4.0,c2f5d82dee7c +40.979,201,3.9,65d10d346f4e +41.087,201,3.6,65d10d346f4e +41.201,201,4.6,65d10d346f4e +41.313,201,3.0,65d10d346f4e +41.416,201,3.7,65d10d346f4e +41.524,201,3.9,65d10d346f4e +41.63,201,4.7,c2f5d82dee7c +41.74,201,3.9,c2f5d82dee7c +41.851,201,3.9,c2f5d82dee7c +41.962,201,4.2,65d10d346f4e +42.072,201,2.8,c2f5d82dee7c +42.184,201,2.8,65d10d346f4e +42.297,201,2.7,65d10d346f4e +42.41,201,3.3,65d10d346f4e +42.519,201,4.3,65d10d346f4e +42.626,201,3.9,65d10d346f4e +42.734,201,3.8,65d10d346f4e +42.84,201,4.2,c2f5d82dee7c +42.95,201,3.3,c2f5d82dee7c +43.057,201,3.5,c2f5d82dee7c +43.165,201,3.4,c2f5d82dee7c +43.278,201,3.6,c2f5d82dee7c +43.382,201,5.9,65d10d346f4e +43.498,201,4.6,c2f5d82dee7c +43.605,201,4.0,c2f5d82dee7c +43.714,201,4.1,c2f5d82dee7c +43.826,201,4.0,c2f5d82dee7c +43.936,201,2.6,c2f5d82dee7c +44.046,201,3.0,c2f5d82dee7c +44.155,201,3.9,c2f5d82dee7c +44.267,201,4.2,c2f5d82dee7c +44.375,201,3.9,c2f5d82dee7c +44.482,201,9.0,c2f5d82dee7c +44.598,201,4.3,c2f5d82dee7c +44.706,201,3.1,c2f5d82dee7c +44.813,201,2.6,c2f5d82dee7c +44.922,201,2.8,c2f5d82dee7c +45.03,201,3.9,65d10d346f4e +45.144,201,3.7,c2f5d82dee7c +45.255,201,3.5,c2f5d82dee7c +45.368,201,4.0,c2f5d82dee7c +45.475,201,3.6,c2f5d82dee7c +45.584,201,3.6,c2f5d82dee7c +45.693,201,3.1,65d10d346f4e +45.803,201,7.3,c2f5d82dee7c +45.911,201,2.7,65d10d346f4e +46.023,201,4.4,c2f5d82dee7c +46.137,201,4.1,c2f5d82dee7c +46.244,201,3.4,c2f5d82dee7c +46.349,201,4.8,65d10d346f4e +46.462,201,3.0,c2f5d82dee7c +46.575,201,3.6,c2f5d82dee7c +46.682,201,3.8,c2f5d82dee7c +46.793,201,4.3,c2f5d82dee7c +46.905,201,3.5,c2f5d82dee7c +47.017,201,3.9,c2f5d82dee7c +47.13,201,5.4,65d10d346f4e +47.24,201,3.3,c2f5d82dee7c +47.349,201,3.4,c2f5d82dee7c +47.452,201,2.8,c2f5d82dee7c +47.559,201,2.6,65d10d346f4e +47.67,201,3.0,65d10d346f4e +47.775,201,3.1,65d10d346f4e +47.878,201,6.3,c2f5d82dee7c +47.989,201,5.9,c2f5d82dee7c +48.105,201,5.2,65d10d346f4e +48.219,201,4.1,65d10d346f4e +48.333,201,4.8,c2f5d82dee7c +48.437,201,5.5,65d10d346f4e +48.543,201,4.8,c2f5d82dee7c +48.65,201,4.7,c2f5d82dee7c +48.764,201,4.3,65d10d346f4e +48.878,201,3.6,65d10d346f4e +48.983,201,3.8,65d10d346f4e +49.087,201,4.9,c2f5d82dee7c +49.201,201,5.1,c2f5d82dee7c +49.314,201,3.0,65d10d346f4e +49.421,201,3.4,c2f5d82dee7c +49.527,201,3.4,c2f5d82dee7c +49.633,201,5.0,c2f5d82dee7c +49.743,201,4.7,c2f5d82dee7c +49.853,201,4.8,c2f5d82dee7c +49.968,201,4.3,c2f5d82dee7c +50.082,201,3.4,c2f5d82dee7c +50.193,201,2.8,65d10d346f4e +50.298,201,2.8,c2f5d82dee7c +50.407,201,5.2,c2f5d82dee7c +50.514,201,4.1,c2f5d82dee7c +50.621,201,5.9,c2f5d82dee7c +50.729,201,3.7,65d10d346f4e +50.838,201,3.0,65d10d346f4e +50.951,201,3.2,65d10d346f4e +51.06,201,2.8,65d10d346f4e +51.169,201,3.4,65d10d346f4e +51.282,201,5.1,c2f5d82dee7c +51.397,201,4.1,c2f5d82dee7c +51.506,201,4.2,c2f5d82dee7c +51.62,201,4.0,c2f5d82dee7c +51.726,201,3.8,c2f5d82dee7c +51.84,201,3.9,c2f5d82dee7c +51.949,201,4.4,c2f5d82dee7c +52.055,201,3.0,c2f5d82dee7c +52.159,201,4.9,65d10d346f4e +52.273,201,3.8,c2f5d82dee7c +52.386,201,5.2,c2f5d82dee7c +52.499,201,3.7,c2f5d82dee7c +52.602,201,4.2,c2f5d82dee7c +52.716,201,3.5,c2f5d82dee7c +52.827,201,3.4,c2f5d82dee7c +52.936,201,4.1,c2f5d82dee7c +53.047,201,6.5,c2f5d82dee7c +53.159,201,6.6,c2f5d82dee7c +53.272,201,7.8,65d10d346f4e +53.388,201,4.3,65d10d346f4e +53.496,201,5.3,65d10d346f4e +53.605,201,4.0,65d10d346f4e +53.71,201,4.0,c2f5d82dee7c +53.823,201,4.8,65d10d346f4e +53.937,201,4.6,65d10d346f4e +54.05,201,4.2,65d10d346f4e +54.164,201,4.4,c2f5d82dee7c +54.272,201,4.6,c2f5d82dee7c +54.383,201,4.6,c2f5d82dee7c +54.497,201,4.0,c2f5d82dee7c +54.611,201,4.8,65d10d346f4e +54.722,201,3.9,65d10d346f4e +54.827,201,4.9,c2f5d82dee7c +54.937,201,4.1,c2f5d82dee7c +55.046,201,4.6,c2f5d82dee7c +55.153,201,4.6,c2f5d82dee7c +55.265,201,3.7,c2f5d82dee7c +55.378,201,3.4,c2f5d82dee7c +55.483,201,3.3,c2f5d82dee7c +55.587,201,3.0,65d10d346f4e +55.699,201,4.1,65d10d346f4e +55.813,201,4.8,c2f5d82dee7c +55.927,201,4.4,c2f5d82dee7c +56.041,201,4.9,65d10d346f4e +56.156,201,3.8,65d10d346f4e +56.267,201,5.6,65d10d346f4e +56.375,201,4.1,65d10d346f4e +56.481,201,3.2,c2f5d82dee7c +56.588,201,3.3,c2f5d82dee7c +56.699,201,6.7,c2f5d82dee7c +56.815,201,4.7,65d10d346f4e +56.926,201,4.6,65d10d346f4e +57.04,201,4.4,65d10d346f4e +57.144,201,4.6,65d10d346f4e +57.257,201,3.7,65d10d346f4e +57.362,201,3.0,c2f5d82dee7c +57.475,201,3.8,65d10d346f4e +57.589,201,4.3,65d10d346f4e +57.699,201,4.2,65d10d346f4e +57.811,201,5.7,c2f5d82dee7c +57.919,201,5.7,65d10d346f4e +58.033,201,6.8,c2f5d82dee7c +58.144,201,8.0,c2f5d82dee7c +58.252,201,4.6,65d10d346f4e +58.359,201,6.6,65d10d346f4e +58.475,201,4.5,c2f5d82dee7c +58.585,201,4.6,c2f5d82dee7c +58.699,201,5.3,c2f5d82dee7c +58.813,201,5.6,65d10d346f4e +58.922,201,3.5,c2f5d82dee7c +59.036,201,3.3,65d10d346f4e +59.147,201,3.0,65d10d346f4e +59.255,201,3.2,65d10d346f4e +59.362,201,3.3,65d10d346f4e +59.47,201,3.3,c2f5d82dee7c +59.577,201,5.1,c2f5d82dee7c +59.689,201,3.3,c2f5d82dee7c +59.797,201,3.5,c2f5d82dee7c +59.908,201,2.5,c2f5d82dee7c +60.015,201,3.9,c2f5d82dee7c +60.126,201,3.8,c2f5d82dee7c +60.233,201,3.5,c2f5d82dee7c +60.343,201,3.6,c2f5d82dee7c +60.447,201,4.0,65d10d346f4e +60.555,201,4.2,65d10d346f4e +60.668,201,3.9,65d10d346f4e +60.778,201,2.8,65d10d346f4e +60.886,201,2.6,65d10d346f4e +60.997,201,4.1,65d10d346f4e +61.112,201,4.0,c2f5d82dee7c +61.225,201,4.8,c2f5d82dee7c +61.335,201,4.1,c2f5d82dee7c +61.449,201,4.2,c2f5d82dee7c +61.559,201,4.0,c2f5d82dee7c +61.666,201,2.8,c2f5d82dee7c +61.774,201,4.9,c2f5d82dee7c +61.887,201,4.6,c2f5d82dee7c +62.002,201,4.2,65d10d346f4e +62.116,201,3.8,65d10d346f4e +62.224,201,4.5,65d10d346f4e +62.336,201,4.8,65d10d346f4e +62.45,201,3.2,65d10d346f4e +62.559,201,4.3,65d10d346f4e +62.674,201,4.7,c2f5d82dee7c +62.779,201,6.9,65d10d346f4e +62.889,201,5.8,65d10d346f4e +62.997,201,5.6,65d10d346f4e +63.111,201,4.6,c2f5d82dee7c +63.226,201,4.5,c2f5d82dee7c +63.341,201,4.6,65d10d346f4e +63.454,201,3.9,65d10d346f4e +63.56,201,4.3,c2f5d82dee7c +63.669,201,5.7,c2f5d82dee7c +63.78,201,6.2,c2f5d82dee7c +63.894,201,4.3,65d10d346f4e +64.001,201,4.0,65d10d346f4e +64.115,201,8.0,65d10d346f4e +64.233,201,3.7,c2f5d82dee7c +64.341,201,3.9,65d10d346f4e +64.454,201,3.6,c2f5d82dee7c +64.565,201,3.7,c2f5d82dee7c +64.673,201,4.2,c2f5d82dee7c +64.781,201,4.3,c2f5d82dee7c +64.888,201,4.0,65d10d346f4e +64.997,201,3.8,65d10d346f4e +65.104,201,2.8,65d10d346f4e +65.209,201,2.8,c2f5d82dee7c +65.318,201,2.5,c2f5d82dee7c +65.428,201,4.1,c2f5d82dee7c +65.534,201,3.2,c2f5d82dee7c +65.642,201,5.3,c2f5d82dee7c +65.757,201,4.7,c2f5d82dee7c +65.864,201,5.2,c2f5d82dee7c +65.978,201,3.0,c2f5d82dee7c +66.089,201,2.8,c2f5d82dee7c +66.196,201,3.1,c2f5d82dee7c +66.301,201,3.4,65d10d346f4e +66.411,201,3.7,65d10d346f4e +66.521,201,5.3,c2f5d82dee7c +66.635,201,4.7,c2f5d82dee7c +66.744,201,4.1,c2f5d82dee7c +66.849,201,3.0,65d10d346f4e +66.954,201,3.2,65d10d346f4e +67.066,201,3.6,65d10d346f4e +67.172,201,5.1,65d10d346f4e +67.281,201,3.7,c2f5d82dee7c +67.39,201,6.3,65d10d346f4e +67.498,201,6.4,c2f5d82dee7c +67.607,201,4.7,c2f5d82dee7c +67.715,201,6.8,c2f5d82dee7c +67.829,201,3.7,c2f5d82dee7c +67.934,201,4.2,c2f5d82dee7c +68.046,201,4.4,c2f5d82dee7c +68.16,201,2.7,c2f5d82dee7c +68.268,201,5.6,c2f5d82dee7c +68.382,201,4.0,65d10d346f4e +68.489,201,4.2,c2f5d82dee7c +68.598,201,3.8,c2f5d82dee7c +68.706,201,5.8,c2f5d82dee7c +68.819,201,2.9,c2f5d82dee7c +68.931,201,3.2,c2f5d82dee7c +69.044,201,3.2,65d10d346f4e +69.158,201,4.4,65d10d346f4e +69.264,201,5.1,65d10d346f4e +69.376,201,4.1,65d10d346f4e +69.485,201,4.5,65d10d346f4e +69.594,201,4.2,65d10d346f4e +69.704,201,4.5,65d10d346f4e +69.816,201,3.3,65d10d346f4e +69.925,201,2.9,65d10d346f4e +70.035,201,5.1,65d10d346f4e +70.145,201,3.5,65d10d346f4e +70.256,201,3.6,65d10d346f4e +70.37,201,4.0,65d10d346f4e +70.484,201,4.2,c2f5d82dee7c +70.598,201,5.0,c2f5d82dee7c +70.713,201,4.5,65d10d346f4e +70.821,201,2.7,c2f5d82dee7c +70.933,201,4.5,65d10d346f4e +71.042,201,4.1,65d10d346f4e +71.149,201,3.4,c2f5d82dee7c +71.257,201,3.7,c2f5d82dee7c +71.362,201,3.5,c2f5d82dee7c +71.471,201,4.4,65d10d346f4e +71.585,201,2.8,c2f5d82dee7c +71.69,201,2.9,65d10d346f4e +71.803,201,5.1,c2f5d82dee7c +71.917,201,4.4,c2f5d82dee7c +72.027,201,3.9,c2f5d82dee7c +72.136,201,3.7,c2f5d82dee7c +72.248,201,4.8,c2f5d82dee7c +72.362,201,5.1,65d10d346f4e +72.475,201,3.7,65d10d346f4e +72.589,201,4.7,65d10d346f4e +72.697,201,5.0,65d10d346f4e +72.805,201,5.6,65d10d346f4e +72.911,201,5.4,c2f5d82dee7c +73.019,201,4.1,c2f5d82dee7c +73.129,201,5.2,c2f5d82dee7c +73.245,201,4.2,65d10d346f4e +73.355,201,3.2,65d10d346f4e +73.463,201,3.4,65d10d346f4e +73.572,201,3.5,65d10d346f4e +73.681,201,5.3,65d10d346f4e +73.787,201,3.6,c2f5d82dee7c +73.9,201,4.0,c2f5d82dee7c +74.008,201,4.4,c2f5d82dee7c +74.117,201,4.5,c2f5d82dee7c +74.225,201,9.1,c2f5d82dee7c +74.334,201,6.4,c2f5d82dee7c +74.448,201,3.5,c2f5d82dee7c +74.558,201,4.1,c2f5d82dee7c +74.672,201,3.9,65d10d346f4e +74.778,201,5.0,c2f5d82dee7c +74.886,201,3.8,c2f5d82dee7c +74.999,201,4.1,c2f5d82dee7c +75.113,201,5.5,65d10d346f4e +75.226,201,4.4,c2f5d82dee7c +75.337,201,4.2,65d10d346f4e +75.441,201,5.9,c2f5d82dee7c diff --git a/evidence/rolling/result.json b/evidence/rolling/result.json index a52aef32..e3e6b869 100644 --- a/evidence/rolling/result.json +++ b/evidence/rolling/result.json @@ -4,25 +4,25 @@ "scripts/rolling-update.sh" ], "action_exit": 0, - "action_seconds": 12.01, + "action_seconds": 12.62, "action_finished_before_load_end": true, "lb_up_before": 2, "lb_up_min": 2, "detection_seconds": null, "rejoin_seconds": null, "probe": { - "attempts": 942, + "attempts": 919, "failed_attempts": 0, "first_failure_s": null, "recovery_s": 0.0, "instances_before": { - "225f56282b82": 113, - "c84bddf582a8": 129 + "6c2a02267340": 110, + "158dfc1bd95d": 125 }, "instances_during_outage": {}, "instances_after": { - "89953d9764bd": 309, - "1f35898d8b4e": 280 + "c2f5d82dee7c": 310, + "65d10d346f4e": 260 } }, "lb_counters": { @@ -38,9 +38,9 @@ "ok_rps": 100.01, "failed_ratio": 0, "dropped_iterations": 0, - "p50_ms": 1.91, - "p95_ms": 3.23, - "p99_ms": 4.5, + "p50_ms": 1.34, + "p95_ms": 2.21, + "p99_ms": 6.86, "exit": 0, "rate": 100 }, diff --git a/evidence/schema.txt b/evidence/schema.txt index 4d4dd3d8..e995beab 100644 --- a/evidence/schema.txt +++ b/evidence/schema.txt @@ -1,4 +1,4 @@ -date: 2026-10-29T23:43:45Z commit: b1c80ee +date: 2026-10-30T02:54:55Z commit: e049c26 $ psql -c '\d+ users' Table "public.users" Column | Type | Collation | Nullable | Default | Storage | Compression | Stats target | Description @@ -129,7 +129,7 @@ Access method: heap $ psql -c 'SELECT version, left(checksum, 12), applied_at FROM schema_migrations' version | checksum | applied_at -----------------------+--------------+------------------------------- - 0001_init | 9a13618f078a | 2026-10-29 23:36:11.340945+00 - 0002_idempotency_keys | d9159a355532 | 2026-10-29 23:36:11.346879+00 + 0001_init | 9a13618f078a | 2026-10-30 02:44:56.558169+00 + 0002_idempotency_keys | d9159a355532 | 2026-10-30 02:44:56.565046+00 (2 rows) diff --git a/evidence/secrets.txt b/evidence/secrets.txt index a715cc86..062bba1d 100644 --- a/evidence/secrets.txt +++ b/evidence/secrets.txt @@ -1,4 +1,4 @@ -date: 2026-10-29T23:43:48Z commit: b1c80ee +date: 2026-10-30T02:54:59Z commit: e049c26 $ git ls-files secrets .env backups volumes (пусто: секретов, .env, дампов и volumes в Git нет) $ git check-ignore -v secrets/database_url secrets/postgres_password .env backups/ diff --git a/evidence/smoke.txt b/evidence/smoke.txt index e001134e..621ca178 100644 --- a/evidence/smoke.txt +++ b/evidence/smoke.txt @@ -1,4 +1,4 @@ -date: 2026-10-29T23:43:42Z commit: b1c80ee +date: 2026-10-30T02:45:01Z commit: e049c26 $ make test # BASE_URL=http://127.0.0.1:18083 — порт lb из docker compose port python3 tests/smoke.py --base-url "http://127.0.0.1:18083" PASS: lab3 public API scenario; infrastructure and grading evidence remain separate. diff --git a/evidence/stack.txt b/evidence/stack.txt index f94babf1..6fd38f00 100644 --- a/evidence/stack.txt +++ b/evidence/stack.txt @@ -1,31 +1,31 @@ -date: 2026-10-29T23:43:43Z commit: b1c80ee +date: 2026-10-30T02:45:01Z commit: e049c26 $ docker compose --env-file .env config --quiet && echo valid valid $ docker compose ps --format '{{.Service}} {{.Name}} {{.Status}} {{.Ports}}' api mtusi2026lab3-api-1 Up 4 seconds (healthy) api mtusi2026lab3-api-2 Up 4 seconds (healthy) -lb mtusi2026lab3-lb-1 Up 6 seconds (healthy) 127.0.0.1:18083->8080/tcp, 127.0.0.1:23083->8404/tcp -postgres mtusi2026lab3-postgres-1 Up 6 seconds (healthy) -valkey mtusi2026lab3-valkey-1 Up 6 seconds (healthy) +lb mtusi2026lab3-lb-1 Up 7 seconds (healthy) 127.0.0.1:18083->8080/tcp, 127.0.0.1:23083->8404/tcp +postgres mtusi2026lab3-postgres-1 Up 7 seconds (healthy) +valkey mtusi2026lab3-valkey-1 Up 7 seconds (healthy) $ docker compose config | grep -c container_name 0 $ docker port <каждая реплика api> # реплики не публикуют порт -286766bf2b32: [] -fa81adafcb69: [] +ff81f93e8b0d: [] +fe75c6c37e5a: [] $ docker inspect: hostname = X-Instance-Id, сети, лимиты CPU (nano) и памяти -api 286766bf2b32 /mtusi2026lab3-api-1 nets=mtusi2026lab3_backend, cpus=1000000000 mem=536870912 user=10001:10001 ro=true -api fa81adafcb69 /mtusi2026lab3-api-2 nets=mtusi2026lab3_backend, cpus=1000000000 mem=536870912 user=10001:10001 ro=true -lb 55229893641c /mtusi2026lab3-lb-1 nets=mtusi2026lab3_backend,mtusi2026lab3_edge, cpus=1000000000 mem=134217728 user=haproxy ro=true -postgres 308851b9dd07 /mtusi2026lab3-postgres-1 nets=mtusi2026lab3_backend, cpus=2000000000 mem=1073741824 user=70:70 ro=false -valkey 70f5ef5be346 /mtusi2026lab3-valkey-1 nets=mtusi2026lab3_backend, cpus=500000000 mem=134217728 user=999:1000 ro=false +api fe75c6c37e5a /mtusi2026lab3-api-2 nets=mtusi2026lab3_backend, cpus=1000000000 mem=536870912 user=10001:10001 ro=true +api ff81f93e8b0d /mtusi2026lab3-api-1 nets=mtusi2026lab3_backend, cpus=1000000000 mem=536870912 user=10001:10001 ro=true +lb 35712870f3c4 /mtusi2026lab3-lb-1 nets=mtusi2026lab3_backend,mtusi2026lab3_edge, cpus=1000000000 mem=134217728 user=haproxy ro=true +postgres cd7b0d78bc19 /mtusi2026lab3-postgres-1 nets=mtusi2026lab3_backend, cpus=2000000000 mem=1073741824 user=70:70 ro=false +valkey c9501d6e445a /mtusi2026lab3-valkey-1 nets=mtusi2026lab3_backend, cpus=500000000 mem=134217728 user=999:1000 ro=false $ curl LB stats: backend api, server status check api1 UP L7OK 200 api2 UP L7OK 200 BACKEND UP $ for i in 1..6: curl -D - http://127.0.0.1:18083/health/live | X-Instance-Id -x-instance-id: fa81adafcb69 -x-instance-id: 286766bf2b32 -x-instance-id: fa81adafcb69 -x-instance-id: 286766bf2b32 -x-instance-id: fa81adafcb69 -x-instance-id: 286766bf2b32 +x-instance-id: fe75c6c37e5a +x-instance-id: ff81f93e8b0d +x-instance-id: fe75c6c37e5a +x-instance-id: ff81f93e8b0d +x-instance-id: fe75c6c37e5a +x-instance-id: ff81f93e8b0d diff --git a/evidence/student-tests.txt b/evidence/student-tests.txt index 58c8a363..c2b91639 100644 --- a/evidence/student-tests.txt +++ b/evidence/student-tests.txt @@ -1,4 +1,4 @@ -date: 2026-10-29T23:43:07Z commit: b1c80ee +date: 2026-10-30T02:44:17Z commit: e049c26 $ PYTEST_ADDOPTS=-vv make student-test # все собственные тесты без маркера stack (одноразовые PostgreSQL и Valkey в Docker), по именам .venv/bin/pytest ============================= test session starts ============================== @@ -255,13 +255,14 @@ student-tests/unit/test_domain.py::test_user_registration_emits_event PASSED [ 9 student-tests/unit/test_domain.py::test_clock_is_strictly_increasing PASSED [ 99%] student-tests/unit/test_timeouts.py::test_timeouts_shrink_inwards_and_shutdown_fits_the_stop_budget PASSED [100%] -===================== 243 passed, 12 deselected in 20.64s ====================== +===================== 243 passed, 12 deselected in 20.60s ====================== exit=0 $ .venv/bin/pytest -s -q student-tests/api/test_drain.py student-tests/unit/test_timeouts.py # SIGTERM-окно и цепочка таймаутов -.окно: ready/live (503, 200), порт закрыт через 1.12 с, выход 2.48 с +.окно: ready/live (503, 200), порт закрыт через 1.17 с, выход 2.43 с запрос, принятый до SIGTERM и дописанный после закрытия порта: HTTP/1.1 201 Created -запрос, тело которого так и не пришло: HTTP/1.1 500 Internal Server Error +запрос, тело которого так и не пришло: HTTP/1.1 503 Service Unavailable + content-type application/json, тело {'error': {'code': 'unavailable', 'message': 'Сервис временно недоступен', 'request_id': '83cd403af06b44c1ac1fbf05f09908b4'}} .обнаружение 1.5 с (зависание 3.5 с), окно 2.0 с, дообработка 3.0 с, остановка 6.0 с, хук 7.0 с, stop_grace_period 8.0 с; LB server 10.0 с > запрос 8.0 с > БД 3.0 с; readiness 0.8 с < check 1.0 с . -3 passed in 4.19s +3 passed in 4.14s exit=0