Files
mtusi2026lab5/evidence/worker/process.md
T

8.8 KiB
Raw Blame History

Процесс worker

  • Команда: python3 .claude/skills/run-mtusi-messenger/driver.py --port 8080 worker-process
  • Дата: 2026-10-31, 15:58:11–16:01:07 UTC; код выхода 0
  • Commit: 399da05 (ветка feat/pipeline-reliability), рабочее дерево без правок кода (добавлены только файлы evidence/)
  • Стенд: проект compose mtusi-lab5, собран make run_docker из HEAD
  • Спеки: container-run, container-image, graceful-shutdown, service-configuration
  • Что показано: PID 1, нет healthcheck, лимиты 1 CPU / 1 ГБ; _imaging нет ни в репликах API, ни в процессе 1 worker: декодер только в процессе обработки; неверные WORKER__* — код 2, запись называет поле без значения; значения по умолчанию и подмена окружением; остановка простаивающего и на старте; «Worker переживает рестарт хранилищ»; остановка на двух дорогих JPEG: 8,15 с, при замороженных PostgreSQL и брокере 9,18 с, граница 9,5 с (design, решение 19), код 0, задания после этого дошли по аренде до failed, limit_cpu
  • Вывод сокращён: однотипные строки таблицы «record names …», «default …», «names the field», «hides the value» и «early stop» свёрнуты, все совпали с ожидаемым
Started worker:
  concurrency: 2
  prefetch: 2
  max_attempts: 5
  job_timeout_seconds: 60
  lease_margin_seconds: 10
  retry_base_delay_seconds: 5
  retry_max_delay_seconds: 300
  render_timeout_seconds: 40
  render_cpu_limit_seconds: 15
  render_memory_limit_mib: 450
  graceful_shutdown_seconds: 8
  reconnect_seconds: 2
  broker_host: rabbitmq
  broker_port: 5672
  broker_queue: messenger.attachment.process.v1
  s3_host: s3
  s3_port: 8333
  s3_bucket: messenger
  database_host: postgres
  database_port: 5432
  database_name: messenger
  database_pool_size: 2
WORKER__CONCURRENCY=0: exit 2, errors [{'loc': 'worker.concurrency', 'msg': 'Input should be greater than or equal to 1'}]
WORKER__PREFETCH=0: exit 2, errors [{'loc': 'worker.prefetch', 'msg': 'Input should be greater than or equal to 1'}]
WORKER__MAX_ATTEMPTS=abc: exit 2, errors [{'loc': 'worker.max_attempts', 'msg': 'Input should be a valid integer, unable to parse string as an integer'}]
WORKER__GRACEFUL_SHUTDOWN_SECONDS=9: exit 2, errors [{'loc': 'worker.graceful_shutdown_seconds', 'msg': 'Input should be less than or equal to 8'}]
WORKER__RENDER_MEMORY_LIMIT_MIB=0: exit 2, errors [{'loc': 'worker.render_memory_limit_mib', 'msg': 'Input should be greater than or equal to 1'}]
WORKER__RENDER_TIMEOUT_SECONDS=120: exit 2, errors [{'loc': 'worker.render_timeout_seconds', 'msg': 'Value error, must be less than job_timeout_seconds'}]
docker compose stop worker: 0.2 s
docker stop after 0.3 s: 0.06 s, exit 0, records ['Stopped worker before startup']
docker stop after 0.2 s: 0.05 s, exit 0, records ['Stopped worker before startup']
docker stop after 0.4 s: 0.07 s, exit 0, records ['Stopped worker before startup']
stop under load: docker stop worker took 8.15 s
stop frozen storage: docker stop worker took 9.18 s
PID 1 of the worker                                         expected python -m src.worker got python -m src.worker
healthcheck                                                 expected NONE            got NONE
limit NanoCpus                                              expected 1000000000      got 1000000000
limit Memory                                                expected 1073741824      got 1073741824
_imaging in mtusi-lab5-api-15                               expected no              got no
_imaging in mtusi-lab5-api-16                               expected no              got no
API replicas checked                                        expected yes             got yes
_imaging in PID 1 of the worker                             expected no              got no
Pillow in the image = uv.lock                               expected 13.0.0          got 13.0.0
'Started worker' record, every field named, defaults as above: expected = got
six invalid WORKER__* : exit code 2, names the field, hides the value: expected = got
env override container started                              expected 0               got 0
env override concurrency                                    expected 3               got 3
env override reconnect_seconds                              expected 1.0             got 1.0
stop idle: command exit code                                expected 0               got 0
stop idle: container exit code                              expected 0               got 0
stop idle: under 10 s                                       expected yes             got yes
stop idle: last record                                      expected Stopped worker  got Stopped worker
stop idle: record exit_code                                 expected 0               got 0
docker compose start worker                                 expected 0               got 0
early stop 0.2, 0.3, 0.4 s: docker stop 0, exit code 0, within 1 s: expected = got
'Stopped worker before startup' seen                        expected yes             got yes
worker running before restart                               expected yes             got yes
scripts/restart.sh                                          expected 0               got 0
LB ready after restart                                      expected yes             got yes
worker StartedAt unchanged                                  expected yes             got yes
worker RestartCount                                         expected 0               got 0
new upload after restart                                    expected 202             got 202
new upload becomes ready                                    expected yes             got yes
expensive JPEG generated                                    expected yes             got yes
stop under load: worker stopped before uploads              expected 0               got 0
stop under load: upload 0                                   expected 202             got 202
stop under load: upload 1                                   expected 202             got 202
stop under load: worker started                             expected 0               got 0
stop under load: both files in processing                   expected processing      got processing
stop under load: command exit code                          expected 0               got 0
stop under load: under 9.5 s                                expected yes             got yes
stop under load: container exit code                        expected 0               got 0
stop under load: OOM killed                                 expected false           got false
stop under load: last record                                expected Stopped worker  got Stopped worker
stop under load: worker back                                expected 0               got 0
stop frozen storage: worker stopped before uploads          expected 0               got 0
stop frozen storage: upload 0                               expected 202             got 202
stop frozen storage: upload 1                               expected 202             got 202
stop frozen storage: worker started                         expected 0               got 0
stop frozen storage: both files in processing               expected processing      got processing
stop frozen storage: storage paused                         expected 0               got 0
stop frozen storage: command exit code                      expected 0               got 0
stop frozen storage: under 9.5 s                            expected yes             got yes
stop frozen storage: container exit code                    expected 0               got 0
stop frozen storage: OOM killed                             expected false           got false
stop frozen storage: last record                            expected Stopped worker  got Stopped worker
stop frozen storage: worker back                            expected 0               got 0
LB ready after unpause                                      expected yes             got yes
stopped work finished: 4f53824c-a065-4875-8ddf-d7a507e505a0 expected failed limit_cpu got failed limit_cpu
stopped work finished: 6845c972-0f91-4401-91dc-d84dc2229b10 expected failed limit_cpu got failed limit_cpu
stopped work finished: fc9cc3a5-dbeb-4e3c-9b63-d2ce6180b584 expected failed limit_cpu got failed limit_cpu
stopped work finished: 7811470c-95fd-492d-95f1-ff4d4dde4a23 expected failed limit_cpu got failed limit_cpu
PASS: the worker process matches the spec
worker and relay running at the end: yes