No failover run ever lost an answer, so the retry of an unconfirmed write was only covered in process. make retry-check holds the chat row with SELECT ... FOR UPDATE for 1.5 s (below lock_timeout), sends a message with a 0.5 s client timeout, finds the replica whose request waits on the lock in pg_stat_activity and then retries with the same key and text through the LB, once with that replica alive and once after docker kill. It checks the 201, a single copy with the id of the retry answer and, for the live replica, the 201 it logged without a client; created_at tells which attempt wrote the message. CI runs it. failover-each and rolling-update now record the database size and a docker stats snapshot in the background of the action, rolling-update names the tag and id of every image it replaces, and scaling.py writes started and the compose-up log marks in UTC with Z; the track README states that the recorded rows are host time (MSK) and what host-others.csv covers. Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01V1d3RLHNBBMA6UqBLLJv27
83 lines
3.0 KiB
YAML
83 lines
3.0 KiB
YAML
name: Application
|
|
|
|
on: [push, pull_request]
|
|
|
|
permissions:
|
|
contents: read
|
|
|
|
jobs:
|
|
quality:
|
|
name: Линт, типы и собственные тесты
|
|
runs-on: ubuntu-latest
|
|
steps:
|
|
- uses: actions/checkout@v4
|
|
- uses: astral-sh/setup-uv@v5
|
|
with:
|
|
enable-cache: true
|
|
- run: uv sync --locked --group dev
|
|
- run: make lint VENV=.venv
|
|
- run: make student-test VENV=.venv
|
|
|
|
acceptance:
|
|
name: Стенд Compose за HAProxy, smoke, отказ реплики, рестарт и отказы зависимостей
|
|
runs-on: ubuntu-latest
|
|
steps:
|
|
- uses: actions/checkout@v4
|
|
- uses: astral-sh/setup-uv@v5
|
|
with:
|
|
enable-cache: true
|
|
- run: uv sync --locked --group dev
|
|
|
|
- name: Поднять стенд из чистого clone
|
|
run: make up
|
|
|
|
- name: Публичный smoke через балансировщик
|
|
run: make test
|
|
|
|
- name: Несколько реплик на одном токене и гонка одного ключа
|
|
run: make lb-check
|
|
|
|
- name: Повтор неподтверждённой записи после потерянного ответа и убитой реплики
|
|
run: make retry-check
|
|
|
|
- name: Остановка реплики под запросами, затем возврат
|
|
run: |
|
|
make test-failover ACTION_SCRIPT=scripts/stop-one.sh
|
|
docker compose ps -a api
|
|
make restore
|
|
|
|
- name: Рестарт LB, API и хранилищ с сохранением volumes
|
|
run: make test-persistence ACTION_SCRIPT=scripts/restart.sh
|
|
|
|
- name: Отказы Valkey и PostgreSQL, гонка и rollback
|
|
run: make test-faults
|
|
|
|
- name: Лимиты, порты, секреты, volumes и сети по политике
|
|
run: make limits
|
|
|
|
- name: Время обнаружения отказа балансировщиком (SIGTERM, kill, pause, PostgreSQL)
|
|
run: make detection
|
|
|
|
- name: Наружу опубликован только балансировщик
|
|
run: |
|
|
docker compose ps --format '{{.Service}} {{.Ports}}' | awk '$2 != "" && $1 != "lb" {print; bad=1} END {exit bad}'
|
|
|
|
- name: Процессы работают не от root
|
|
run: |
|
|
for id in $(docker compose ps -q); do
|
|
docker top "$id" -eo pid,uid,comm | awk 'NR>1 && $2==0 {print; bad=1} END {exit bad}' || exit 1
|
|
done
|
|
|
|
- name: Корректная остановка реплик API по SIGTERM
|
|
run: |
|
|
start=$(date +%s)
|
|
docker compose kill --signal SIGTERM api
|
|
codes=$(docker wait $(docker compose ps -aq api) | sort -u)
|
|
elapsed=$(( $(date +%s) - start ))
|
|
echo "остановка за ${elapsed} с, коды завершения ${codes}"
|
|
test "$elapsed" -le 10 && test "$codes" = "0"
|
|
|
|
- name: Журналы стенда
|
|
if: always()
|
|
run: docker compose logs --tail 80
|