Commit Graph
95 Commits
Author SHA1 Message Date
ricoromaandClaude Opus 5.5 3416ca16b9 docs: archive profile-resources and sync its specs
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-12 19:28:03 +03:00
ricoromaandClaude Opus 5.5 2514ff177d docs: address profile-resources verify findings
Report the failover ranges strictly over phases 1-5 with phase 06
apart, add per-window memory peaks to the failover table, describe
which intervals the window maximum covers, and note the per-second
rows and per-request zeros of the taken labels fixed in f34cb9a.
Record the design findings, the raw logs ignored by git as a known
issue, and the checks after the fixes.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-12 19:26:18 +03:00
ricoromaandClaude Opus 5.5 f34cb9af5c fix: label per-second rows around pause by their unfrozen part
The samples.csv row of an interval that touches the start of a freeze
now gets the window of its unfrozen part, as the window aggregates do
since the thaw correction. CPU per successful request is no longer
computed for a container absent from the window. The definitions in
the summary describe which intervals the window maximum covers.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-12 19:23:29 +03:00
ricoromaandClaude Opus 5.5 c5752962f6 docs: report CPU and memory of failover and rollout profiles
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-12 19:04:33 +03:00
ricoromaandClaude Opus 5.5 9c4249d8d1 docs: add rollout resources label
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-12 18:57:42 +03:00
ricoromaandClaude Opus 5.5 309a00da2a docs: add failover resources label
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-12 18:35:27 +03:00
ricoromaandClaude Opus 5.5 2d267bfbe6 fix: attribute replica CPU around pause to the unfrozen part
A sample interval that crosses docker pause or unpause carried the CPU
spent before the pause and the burst after unpause into the failover
window by proportional split. Use the pause and unpause moments from
Docker events so that interval CPU lands outside the frozen span.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-12 18:09:05 +03:00
ricoromaandClaude Opus 5.5 6505b5e929 feat: sample CPU and memory in failover and rollout profiles
Run bench/sampler.sh in a new scan mode (cgroup walk, no network, no
psql or LB polling) for the whole load of the failover and rollout
profiles. bench/resources.py turns the samples into per-window CPU,
throttling and memory of every component and the VM, with
samples.csv, resources.csv and summary sections; CPU per successful
request only in steady windows. Check the peak CPU budget before the
stand starts.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-12 17:42:04 +03:00
ricoromaandClaude Opus 5.5 417fdd2f22 docs: propose profile-resources change
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-12 17:22:14 +03:00
ricoromaandClaude Opus 5.5 8f007f7bab docs: add network and ports, p50 latency and README compose commands to the report
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-12 16:49:08 +03:00
ricoromaandClaude Opus 5.5 7f00128fbe docs: address final report review and remove PLAN.md
Fix the findings of the final REPORT.md review: prerequisites, the
defence scenario, swap sources, the single explanation of the R* drop
at PostgreSQL 0.5 CPU, known defects in the limitations, a dead link,
stale counts and references. Remove the device name from evidence.

Remove the lab plan now that every change is archived: its decisions
live in REPORT.md and the archived designs, live references point
there, and AGENTS.md drops the transitional section.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 22:20:22 +03:00
ricoromaandClaude Opus 5.5 b0637addea fix: run the make instances driver on system python3 3.9
datetime.UTC exists only since Python 3.11, so make instances failed on
the macOS system python3 listed in the report prerequisites. Use
timezone.utc and postponed annotations instead.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 22:20:22 +03:00
ricoromaandClaude Opus 5.5 063eedbc71 docs: complete lab 3 report and add final clean clone check
Fill the remaining report sections: clean clone run with versions and
prerequisites, lab 2 carry-over, transaction boundaries, teacher
agreements, skeleton variable mapping, rubric cross-check, experiment
overview, limitations summary, sources and AI usage. Record the clean
clone run of every documented command on default ports.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 21:53:13 +03:00
ricoromaandClaude Opus 5.5 67b4303a0a docs: archive scaling-improvement and sync its specs
Sync load-benchmark (series comparison table, track 1 before/after
rules, db4 series) and service-configuration (default pool 10 + 0)
into the main specs, move the change to the archive and drop it from
the transitional state in AGENTS.md.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 21:38:16 +03:00
ricoromaandClaude Opus 5.5 25f1962021 docs: address scaling-improvement verify findings
Fix the two-step threshold (x1.118), CPU-per-request spread and
PostgreSQL ranges in REPORT.md and design, record the LB side check
(lb_chkdown, error_codes) in evidence, add the db4 series to the
load-benchmark delta, refresh AGENTS.md, bench.md, PLAN.md and
proposal, and log the swapouts_delta passport defect.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 21:36:21 +03:00
ricoromaandClaude Opus 5.5 cb984c1d8d docs: count the pool improvement for track 1 with a recorded caveat
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 21:11:19 +03:00
ricoromaandClaude Opus 5.5 dee571c9cd docs: compare scaling-improvement result against the same-session A/A
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 21:11:19 +03:00
ricoromaandClaude Opus 5.5 adbb06d8f9 docs: report second scaling-improvement attempt for track 1
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 17:51:55 +03:00
ricoromaandClaude Opus 5.5 4648cd0a8c docs: add second scaling-improvement attempt comparisons and checks
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 17:51:55 +03:00
ricoromaandClaude Opus 5.5 17998c92ce docs: add scaling-db-nooverflow2 label
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 17:48:32 +03:00
ricoroma 7a38c5dbcc Revert "revert: measure scaling-improvement baseline again without the pool change"
This reverts commit 5c07923d8c.
2026-10-11 17:23:34 +03:00
ricoroma de6001c526 docs: add scaling-db-before2 bench evidence 2026-10-11 17:23:34 +03:00
ricoromaandClaude Opus 5.5 45a0ad723b docs: add second scaling db A/A label for scaling-improvement
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 16:58:20 +03:00
ricoromaandClaude Opus 5.5 5c07923d8c revert: measure scaling-improvement baseline again without the pool change
This reverts commit 53eb38e (the pool change 9c3959d, 623a973, 80e64cd).

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 16:30:27 +03:00
ricoromaandClaude Opus 5.5 a676a520b0 docs: plan the second scaling-improvement measurement attempt
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 16:30:27 +03:00
ricoromaandClaude Opus 5.5 056ca19a53 docs: format probe script in connection cost evidence
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 15:46:34 +03:00
ricoromaandClaude Opus 5.5 8b69913995 docs: report scaling-improvement pool result for track 1
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 15:46:24 +03:00
ricoromaandClaude Opus 5.5 1694b1d0ae docs: add scaling-improvement comparisons, connection cost and checks
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 15:46:13 +03:00
ricoromaandClaude Opus 5.5 cd88b48b41 docs: add scaling-db-nooverflow label
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 15:30:47 +03:00
ricoroma 53eb38e19b Revert "revert: measure scaling-improvement baseline without the pool change"
This reverts commit 62fa57535e.
2026-10-11 15:04:46 +03:00
ricoroma dfd9ecce29 docs: add scaling-db-before bench evidence 2026-10-11 15:04:46 +03:00
ricoromaandClaude Opus 5.5 3df111cd80 docs: add scaling db A/A label for scaling-improvement
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 14:37:29 +03:00
ricoromaandClaude Opus 5.5 62fa57535e revert: measure scaling-improvement baseline without the pool change
This reverts commits 9c3959d, 623a973 and 80e64cd.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 14:10:43 +03:00
ricoromaandClaude Opus 5.5 1bb8ea67ad feat: add two-cell db4 series for the scaling-improvement measurements
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 14:06:57 +03:00
ricoromaandClaude Opus 5.5 80e64cda4a test: count PostgreSQL sessions without healthcheck and flush races
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 13:46:39 +03:00
ricoromaandClaude Opus 5.5 623a973dac test: wait for PostgreSQL session stats before counting pool reconnections
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 13:30:38 +03:00
ricoromaandClaude Opus 5.5 9c3959d768 perf: keep a fixed PostgreSQL pool without overflow connections
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 13:25:26 +03:00
ricoromaandClaude Opus 5.5 0b0421ad2f docs: record track 1 improvement hypothesis H4
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 13:23:49 +03:00
ricoromaandClaude Opus 5.5 1e50a4a3fc feat: compare PostgreSQL sessions and connections in track 1 series
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 13:23:12 +03:00
ricoromaandClaude Opus 5.5 029aa3be82 docs: propose scaling-improvement change
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 13:19:56 +03:00
ricoromaandClaude Opus 5.5 bbd6f65316 chore: archive scaling-bench change
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 12:25:18 +03:00
ricoromaandClaude Opus 5.5 dedb8ba0fa docs: report PostgreSQL saturation series db and rubric answer
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 12:24:17 +03:00
ricoromaandClaude Opus 5.5 195a3f8ad9 docs: add series db plots and host check
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 12:22:45 +03:00
ricoromaandClaude Opus 5.5 9fbe2ea503 feat: draw series db in R* plot and summarize PostgreSQL saturation
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 12:22:32 +03:00
ricoromaandClaude Opus 5.5 48d10dad37 docs: add scaling series db
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 12:21:04 +03:00
ricoromaandClaude Opus 5.5 46e8f75a2c docs: record series db calibration in scaling-bench design
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 11:31:39 +03:00
ricoromaandClaude Opus 5.5 95539a1883 feat: add track 1 series db with a tight PostgreSQL CPU limit
Configs may carry a fifth element, the PostgreSQL CPU limit, which goes
into the config key (-pg<CPU>), the budget and the cell stand. Series db:
1, 2, 4 replicas at the tight limit and a 4 x 1 control at 2 CPU; label
summaries show PostgreSQL CPU at R* against its limit and throttling.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 11:27:30 +03:00
ricoromaandClaude Opus 5.5 a3279374f7 docs: fix scaling-bench verify findings in report, design and rules
Close the 53300 known issue, restate H1 and saturation conclusions
against the pre-registered criteria and grid resolution, name the
unresolved host mechanism, attribute overload 503 to the pool timeout,
and plan a fresh A/A for scaling-improvement.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 07:36:33 +03:00
ricoromaandClaude Opus 5.5 4abedaed78 docs: add 53300 evidence, regression and regenerated track 1 summaries
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 07:35:49 +03:00
ricoromaandClaude Opus 5.5 dcea85942a feat: add cost and memory tables, passports and sampler limits to track 1 outputs
plots.py summary gains per-request CPU by component, PostgreSQL waits and
pool, H1b throttling and memory peaks; compare.py and plots.py headers
name the spec, change and host; errors logs match 5xx by status field and
keep the exception tail; series labels record sampler limits.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 07:26:36 +03:00