forked from mtusi2026/mtusi2026lab3
bench: трек 1 — серия D (A/B multi vs function, 3 повтора), план серии E
Образ коммита 4830be4, одна переменная MESSAGE_WRITE_PATH:
2x1.0 CPU / БД 2.0 — 283 -> 489 успешных/с (function не насыщен на сетке
до 500/с); 3x1.0 / БД 0.5 — 202 -> 452 успешных/с; SQL-операторов на
сообщение 15.4 -> 3.0. Серия E (ceiling) — поиск потолка нового пути.
Профили py-spy после серии не запустились (series.sh правился во время
выполнения), запускаются отдельно.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
co-authored by
Claude Opus 5.5
parent
55210c6e9c
commit
479cd78f7f
@@ -4,11 +4,12 @@
|
||||
# docker compose stop
|
||||
# sh bench/track1/series.sh baseline <commit-before-the-improvement>
|
||||
# sh bench/track1/series.sh improved <commit-with-the-improvement>
|
||||
# sh bench/track1/series.sh ceiling <commit-with-the-improvement>
|
||||
# ~2.5 h for `baseline`, ~1.5 h for `improved` on the reference laptop (see meta.json files).
|
||||
set -eu
|
||||
cd "$(dirname "$0")/../.."
|
||||
PY="${PYTHON:-$(command -v python3 || command -v python)}"
|
||||
phase="${1:?baseline or improved}"
|
||||
phase="${1:?baseline, improved or ceiling}"
|
||||
ref="${2:-HEAD}"
|
||||
run() { "$PY" bench/track1/run.py --git-ref "$ref" --repeats "${REPEATS:-3}" "$@"; }
|
||||
|
||||
@@ -33,5 +34,11 @@ case "$phase" in
|
||||
--config replicas=2,MESSAGE_WRITE_PATH=multi --config replicas=2,MESSAGE_WRITE_PATH=function \
|
||||
--config replicas=3,pg_cpus=0.5,MESSAGE_WRITE_PATH=multi --config replicas=3,pg_cpus=0.5,MESSAGE_WRITE_PATH=function
|
||||
;;
|
||||
*) echo "usage: series.sh baseline|improved <git-ref>" >&2; exit 2 ;;
|
||||
ceiling)
|
||||
# E. Series D showed the function path NOT saturated at 500/s with 2 x 1.0: find its ceiling
|
||||
# (same configurations, higher rates) and where the bottleneck moves to.
|
||||
run --series E-improved-ceiling --label "$ref" --rates 450,550,650,750,850 \
|
||||
--config replicas=2,MESSAGE_WRITE_PATH=function --config replicas=3,pg_cpus=0.5,MESSAGE_WRITE_PATH=function
|
||||
;;
|
||||
*) echo "usage: series.sh baseline|improved|ceiling <git-ref>" >&2; exit 2 ;;
|
||||
esac
|
||||
|
||||
Reference in New Issue
Block a user