The API key now has only GetObject, PutObject and DeleteObject on the attachment objects: the server never lists the bucket, never runs multipart uploads and has its region set. The reconciler gets its own user messenger-reconciler with ListBucket, GetObject and DeleteObject, created by s3-init from a secret of its own, so the API replicas can no longer list the bucket. The cost seeding writes objects and therefore runs in a one-off API container under the API key. s3-check proves the API key cannot list and checks the reconciler key; its snapshot drops dated fields with a JSON filter instead of grep, which left a dangling comma, and its first line carries the date and the commit. s3-init and s3-cli run as uid 65534, and migrate and reconciler get an init process, so SIGTERM reaches python and docker stop ends a pass in a fraction of a second instead of waiting for SIGKILL. limits.py and CI check the users of the one-off services. Stack tests move a 3 MiB file up and down through the balancer at 256 and 192 KiB/s, longer than the request timeout, and check 401 before the declared size. Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01V1d3RLHNBBMA6UqBLLJv27
66 lines
2.6 KiB
Bash
66 lines
2.6 KiB
Bash
# Copy to .env for your LOCAL synthetic test environment; never commit .env.
|
|
# These are logical interface suggestions; map actual framework names in REPORT.md.
|
|
APP_HOST=0.0.0.0
|
|
APP_PORT=8080
|
|
APP_ENV=lab
|
|
SESSION_TTL_SECONDS=3600
|
|
# Choose credentials locally. File paths contain no secret values.
|
|
DATABASE_URL_FILE=/run/secrets/database_url
|
|
# Optional on 3, required use on 4 in lab2; Redis OR Valkey:
|
|
SESSION_STORE=postgres
|
|
CACHE_URL_FILE=/run/secrets/cache_url
|
|
API_REPLICAS=2
|
|
IDEMPOTENCY_TTL_SECONDS=86400
|
|
S3_ENDPOINT=http://s3:9000
|
|
S3_REGION=us-east-1
|
|
S3_BUCKET=messenger-attachments
|
|
S3_ACCESS_KEY_ID_FILE=/run/secrets/s3_access_key_id
|
|
S3_SECRET_ACCESS_KEY_FILE=/run/secrets/s3_secret_access_key
|
|
MAX_UPLOAD_BYTES=10485760
|
|
MAX_IMAGE_PIXELS=40000000
|
|
# Solution-specific: published LB ports, replica limits, workers and pool per replica,
|
|
# LB queue per replica, drain window before closing the listener on SIGTERM, PostgreSQL
|
|
# limits, load generator limits (profile bench), cursor key file. API_PORT/SHORTTTL_PORT of lab2 are gone:
|
|
# only the load balancer is published.
|
|
LB_HTTP_PORT=8080
|
|
LB_STATS_PORT=8404
|
|
API_CPUS=1
|
|
API_MEMORY=512m
|
|
WEB_CONCURRENCY=2
|
|
DB_POOL_MAX_SIZE=8
|
|
API_SERVER_MAXCONN=64
|
|
DRAIN_SECONDS=2
|
|
PG_MAX_CONNECTIONS=200
|
|
PG_CPUS=2
|
|
PG_MEMORY=1g
|
|
K6_CPUS=2
|
|
K6_MEMORY=512m
|
|
CURSOR_SECRET_FILE=/run/secrets/cursor_secret
|
|
# Solution-specific for lab4: S3 client timeouts (connect + read, two attempts stay below
|
|
# REQUEST_TIMEOUT_SECONDS=8), parallel image checks per worker, RustFS memory limit.
|
|
S3_CONNECT_TIMEOUT_SECONDS=1
|
|
S3_READ_TIMEOUT_SECONDS=2
|
|
IMAGE_CHECK_CONCURRENCY=2
|
|
S3_MEMORY=512m
|
|
# Solution-specific for lab4 grade 4: upload bodies buffered at once per worker, grace period
|
|
# before an abandoned pending upload is swept, sweep interval and rows per sweep pass.
|
|
UPLOAD_CONCURRENCY=3
|
|
UPLOAD_GRACE_SECONDS=900
|
|
UPLOAD_SWEEP_INTERVAL_SECONDS=30
|
|
UPLOAD_SWEEP_BATCH=100
|
|
# Fixed glibc mmap threshold for the API: buffers above 128 KiB are returned to the system on free.
|
|
MALLOC_MMAP_THRESHOLD_=131072
|
|
# Minimal client transfer rate, bytes/s: every body byte moved in either direction extends the
|
|
# request deadline by 1/rate, so slow but steady uploads and downloads outlive REQUEST_TIMEOUT_SECONDS.
|
|
MIN_TRANSFER_RATE_BYTES=131072
|
|
# Solution-specific for lab4 track 2: limits of the one-off reconciler (profile reconcile), its S3
|
|
# read timeout for listing pages, optional CPU pinning of the measured services (empty = no pinning)
|
|
# and the CPU limit of RustFS (make reconcile-cost raises it with its memory for the 100k point).
|
|
RECONCILE_CPUS=1
|
|
RECONCILE_MEMORY=256m
|
|
RECONCILE_S3_READ_TIMEOUT_SECONDS=10
|
|
RECONCILE_CPUSET=
|
|
S3_CPUSET=
|
|
PG_CPUSET=
|
|
S3_CPUS=1
|