The first cost run stalled while filling the bucket to 100k objects: RustFS keeps object metadata in memory, at about 45k objects it hit its 1 GiB limit, the cgroup kept reclaiming and PutObject slowed from about 240 to 11 objects per second. The S3 CPU limit is now taken from S3_CPUS (default 1, as before), and the cost run gives RustFS 2 pinned CPUs and 3 GiB for every point, so all N are measured with the same limits; seeding uses 16 parallel writes. Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01V1d3RLHNBBMA6UqBLLJv27
63 lines
2.4 KiB
Bash
63 lines
2.4 KiB
Bash
# Copy to .env for your LOCAL synthetic test environment; never commit .env.
|
|
# These are logical interface suggestions; map actual framework names in REPORT.md.
|
|
APP_HOST=0.0.0.0
|
|
APP_PORT=8080
|
|
APP_ENV=lab
|
|
SESSION_TTL_SECONDS=3600
|
|
# Choose credentials locally. File paths contain no secret values.
|
|
DATABASE_URL_FILE=/run/secrets/database_url
|
|
# Optional on 3, required use on 4 in lab2; Redis OR Valkey:
|
|
SESSION_STORE=postgres
|
|
CACHE_URL_FILE=/run/secrets/cache_url
|
|
API_REPLICAS=2
|
|
IDEMPOTENCY_TTL_SECONDS=86400
|
|
S3_ENDPOINT=http://s3:9000
|
|
S3_REGION=us-east-1
|
|
S3_BUCKET=messenger-attachments
|
|
S3_ACCESS_KEY_ID_FILE=/run/secrets/s3_access_key_id
|
|
S3_SECRET_ACCESS_KEY_FILE=/run/secrets/s3_secret_access_key
|
|
MAX_UPLOAD_BYTES=10485760
|
|
MAX_IMAGE_PIXELS=40000000
|
|
# Solution-specific: published LB ports, replica limits, workers and pool per replica,
|
|
# LB queue per replica, drain window before closing the listener on SIGTERM, PostgreSQL
|
|
# limits, load generator limits (profile bench), cursor key file. API_PORT/SHORTTTL_PORT of lab2 are gone:
|
|
# only the load balancer is published.
|
|
LB_HTTP_PORT=8080
|
|
LB_STATS_PORT=8404
|
|
API_CPUS=1
|
|
API_MEMORY=512m
|
|
WEB_CONCURRENCY=2
|
|
DB_POOL_MAX_SIZE=8
|
|
API_SERVER_MAXCONN=64
|
|
DRAIN_SECONDS=2
|
|
PG_MAX_CONNECTIONS=200
|
|
PG_CPUS=2
|
|
PG_MEMORY=1g
|
|
K6_CPUS=2
|
|
K6_MEMORY=512m
|
|
CURSOR_SECRET_FILE=/run/secrets/cursor_secret
|
|
# Solution-specific for lab4: S3 client timeouts (connect + read, two attempts stay below
|
|
# REQUEST_TIMEOUT_SECONDS=8), parallel image checks per worker, RustFS memory limit.
|
|
S3_CONNECT_TIMEOUT_SECONDS=1
|
|
S3_READ_TIMEOUT_SECONDS=2
|
|
IMAGE_CHECK_CONCURRENCY=2
|
|
S3_MEMORY=512m
|
|
# Solution-specific for lab4 grade 4: upload bodies buffered at once per worker, grace period
|
|
# before an abandoned pending upload is swept, sweep interval and rows per sweep pass.
|
|
UPLOAD_CONCURRENCY=3
|
|
UPLOAD_GRACE_SECONDS=900
|
|
UPLOAD_SWEEP_INTERVAL_SECONDS=30
|
|
UPLOAD_SWEEP_BATCH=100
|
|
# Fixed glibc mmap threshold for the API: buffers above 128 KiB are returned to the system on free.
|
|
MALLOC_MMAP_THRESHOLD_=131072
|
|
# Solution-specific for lab4 track 2: limits of the one-off reconciler (profile reconcile), its S3
|
|
# read timeout for listing pages, optional CPU pinning of the measured services (empty = no pinning)
|
|
# and the CPU limit of RustFS (make reconcile-cost raises it with its memory for 100k objects).
|
|
RECONCILE_CPUS=1
|
|
RECONCILE_MEMORY=256m
|
|
RECONCILE_S3_READ_TIMEOUT_SECONDS=10
|
|
RECONCILE_CPUSET=
|
|
S3_CPUSET=
|
|
PG_CPUSET=
|
|
S3_CPUS=1
|