forked from mtusi2026/mtusi2026lab2
The API key now has only GetObject, PutObject and DeleteObject on the attachment objects: the server never lists the bucket, never runs multipart uploads and has its region set. The reconciler gets its own user messenger-reconciler with ListBucket, GetObject and DeleteObject, created by s3-init from a secret of its own, so the API replicas can no longer list the bucket. The cost seeding writes objects and therefore runs in a one-off API container under the API key. s3-check proves the API key cannot list and checks the reconciler key; its snapshot drops dated fields with a JSON filter instead of grep, which left a dangling comma, and its first line carries the date and the commit. s3-init and s3-cli run as uid 65534, and migrate and reconciler get an init process, so SIGTERM reaches python and docker stop ends a pass in a fraction of a second instead of waiting for SIGKILL. limits.py and CI check the users of the one-off services. Stack tests move a 3 MiB file up and down through the balancer at 256 and 192 KiB/s, longer than the request timeout, and check 401 before the declared size. Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01V1d3RLHNBBMA6UqBLLJv27
102 lines
3.9 KiB
YAML
102 lines
3.9 KiB
YAML
name: Application
|
||
|
||
on: [push, pull_request]
|
||
|
||
permissions:
|
||
contents: read
|
||
|
||
jobs:
|
||
quality:
|
||
name: Линт, типы и собственные тесты
|
||
runs-on: ubuntu-latest
|
||
steps:
|
||
- uses: actions/checkout@v4
|
||
- uses: astral-sh/setup-uv@v5
|
||
with:
|
||
enable-cache: true
|
||
- run: uv sync --locked --group dev
|
||
- run: make lint VENV=.venv
|
||
- run: make student-test VENV=.venv
|
||
|
||
acceptance:
|
||
name: Стенд Compose с RustFS за HAProxy, smoke, вложения, отказ реплики, рестарт и отказы зависимостей
|
||
runs-on: ubuntu-latest
|
||
steps:
|
||
- uses: actions/checkout@v4
|
||
- uses: astral-sh/setup-uv@v5
|
||
with:
|
||
enable-cache: true
|
||
- run: uv sync --locked --group dev
|
||
|
||
- name: Поднять стенд из чистого clone
|
||
run: make up
|
||
|
||
- name: Публичный smoke через балансировщик
|
||
run: make test
|
||
|
||
- name: Вложение после остановки принявшей его реплики и при недоступном S3
|
||
run: |
|
||
make scenario SCENARIO=failover-upload
|
||
make scenario SCENARIO=s3-outage
|
||
|
||
- name: Приватный bucket, ограниченный ключ API и повторный bootstrap
|
||
run: make s3-check
|
||
|
||
- name: Негативный suite вложений, компенсация, уборка после grace, обрыв и зависание загрузки
|
||
run: make upload-faults
|
||
|
||
- name: Несколько реплик на одном токене и гонка одного ключа
|
||
run: make lb-check
|
||
|
||
- name: Повтор неподтверждённой записи после потерянного ответа и убитой реплики
|
||
run: make retry-check
|
||
|
||
- name: Остановка реплики под запросами, затем возврат
|
||
run: |
|
||
make test-failover ACTION_SCRIPT=scripts/stop-one.sh
|
||
docker compose ps -a api
|
||
make restore
|
||
|
||
- name: Рестарт LB, API и хранилищ с сохранением volumes
|
||
run: make test-persistence ACTION_SCRIPT=scripts/restart.sh
|
||
|
||
- name: Отказы Valkey и PostgreSQL, гонка и rollback
|
||
run: make test-faults
|
||
|
||
- name: Лимиты, порты, секреты, volumes и сети по политике
|
||
run: make limits
|
||
|
||
- name: Время обнаружения отказа балансировщиком (SIGTERM, kill, pause, PostgreSQL)
|
||
run: make detection
|
||
|
||
- name: Наружу опубликован только балансировщик
|
||
run: |
|
||
docker compose ps --format '{{.Service}} {{.Ports}}' | awk '$2 != "" && $1 != "lb" {print; bad=1} END {exit bad}'
|
||
|
||
- name: Процессы работают не от root
|
||
run: |
|
||
for id in $(docker compose ps -q); do
|
||
docker top "$id" -eo pid,uid,comm | awk 'NR>1 && $2==0 {print; bad=1} END {exit bad}' || exit 1
|
||
done
|
||
|
||
- name: Одноразовые сервисы не от root
|
||
run: |
|
||
for service in migrate s3-init; do
|
||
user=$(docker inspect -f '{{.Config.User}}' "$(docker compose ps -aq "$service")")
|
||
echo "$service: $user"
|
||
case "${user%%:*}" in ""|0|root) exit 1 ;; esac
|
||
done
|
||
|
||
- name: Корректная остановка реплик API по SIGTERM
|
||
run: |
|
||
start=$(date +%s)
|
||
docker compose kill --signal SIGTERM api
|
||
codes=$(docker wait $(docker compose ps -aq api) | sort -u)
|
||
elapsed=$(( $(date +%s) - start ))
|
||
echo "остановка за ${elapsed} с, коды завершения ${codes}"
|
||
test "$elapsed" -le 10 && test "$codes" = "0"
|
||
|
||
- name: Журналы стенда
|
||
if: always()
|
||
run: docker compose logs --tail 80
|