forked from mtusi2026/mtusi2026lab4
Measure the pass cost up to 30k objects
Filling RustFS 1.0.4 to 100k objects under one prefix did not finish in two attempts: a write gets slower as the prefix grows (about 8 ms in an empty prefix against 32 ms at 28k objects, 13 writes per second with 16 parallel writers), with enough memory and no background scanner load. The cost matrix now stops at 30k objects with four parallel writers, which still spans a factor of 30 for the linearity check; the design and the spec of the change say so, and both aborted attempts with their 1k and 10k points and the diagnosis are kept in evidence/reconcile/cost-aborted. Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01V1d3RLHNBBMA6UqBLLJv27
This commit is contained in:
co-authored by
Claude Opus 5.5
parent
7dca40c55e
commit
5ca2cdc9af
@@ -464,7 +464,7 @@ def seed(count, env):
|
||||
"--count",
|
||||
str(count),
|
||||
"--concurrency",
|
||||
"16",
|
||||
"4",
|
||||
env=env,
|
||||
)
|
||||
return json.loads(out.strip().splitlines()[-1])
|
||||
@@ -576,9 +576,9 @@ def main():
|
||||
d.add_argument("--load-seconds", type=int, default=75)
|
||||
d.add_argument("--load-threads", type=int, default=3)
|
||||
k = sub.add_parser("cost", help="cost of a pass for N objects, repeated")
|
||||
k.add_argument("--sizes", type=int, nargs="+", default=[1000, 10000, 100000])
|
||||
k.add_argument("--sizes", type=int, nargs="+", default=[1000, 10000, 30000])
|
||||
k.add_argument("--repeats", type=int, default=3)
|
||||
k.add_argument("--deep-max", type=int, default=100000)
|
||||
k.add_argument("--deep-max", type=int, default=30000)
|
||||
k.add_argument("--page-compare", type=int, default=10000)
|
||||
k.add_argument("--settle", type=float, default=10)
|
||||
k.add_argument("--s3-memory", default="3g")
|
||||
|
||||
Reference in New Issue
Block a user