===== run 1  18:34:29
## api before:
2ba86c0a9ce9 mtusi-lab3-api-8 Up 17 seconds (healthy)
53edc66ecc4d mtusi-lab3-api-10 Up 17 seconds (healthy)
$ make test-failover ACTION_SCRIPT=scripts/stop-one.cmd
Executing explicit failover hook; hook output suppressed to avoid leaking secrets.
{"observed_instances_before": 2, "successful_writes": 136, "failed_attempts": 0, "first_recovery_seconds": 3.888}
PASS: failover preserved confirmed data and existing session. Hook scope needs operator evidence.
## api after (stopped replica must be Exited):
2ba86c0a9ce9 mtusi-lab3-api-8 Exited (0) 11 seconds ago
53edc66ecc4d mtusi-lab3-api-10 Up 33 seconds (healthy)
===== run 2  18:34:54
## api before:
2ba86c0a9ce9 mtusi-lab3-api-8 Up 6 seconds (healthy)
53edc66ecc4d mtusi-lab3-api-10 Up 42 seconds (healthy)
$ make test-failover ACTION_SCRIPT=scripts/stop-one.cmd
Executing explicit failover hook; hook output suppressed to avoid leaking secrets.
{"observed_instances_before": 2, "successful_writes": 137, "failed_attempts": 0, "first_recovery_seconds": 3.869}
PASS: failover preserved confirmed data and existing session. Hook scope needs operator evidence.
## api after (stopped replica must be Exited):
2ba86c0a9ce9 mtusi-lab3-api-8 Exited (0) 11 seconds ago
53edc66ecc4d mtusi-lab3-api-10 Up 58 seconds (healthy)
===== run 3  18:35:19
## api before:
2ba86c0a9ce9 mtusi-lab3-api-8 Up 6 seconds (healthy)
53edc66ecc4d mtusi-lab3-api-10 Up About a minute (healthy)
$ make test-failover ACTION_SCRIPT=scripts/stop-one.cmd
Executing explicit failover hook; hook output suppressed to avoid leaking secrets.
{"observed_instances_before": 2, "successful_writes": 136, "failed_attempts": 0, "first_recovery_seconds": 3.763}
PASS: failover preserved confirmed data and existing session. Hook scope needs operator evidence.
## api after (stopped replica must be Exited):
2ba86c0a9ce9 mtusi-lab3-api-8 Exited (0) 11 seconds ago
53edc66ecc4d mtusi-lab3-api-10 Up About a minute (healthy)
===== run 4  18:35:44
## api before:
2ba86c0a9ce9 mtusi-lab3-api-8 Up 6 seconds (healthy)
53edc66ecc4d mtusi-lab3-api-10 Up About a minute (healthy)
$ make test-failover ACTION_SCRIPT=scripts/stop-one.cmd
Executing explicit failover hook; hook output suppressed to avoid leaking secrets.
{"observed_instances_before": 2, "successful_writes": 138, "failed_attempts": 0, "first_recovery_seconds": 3.842}
PASS: failover preserved confirmed data and existing session. Hook scope needs operator evidence.
## api after (stopped replica must be Exited):
2ba86c0a9ce9 mtusi-lab3-api-8 Exited (0) 11 seconds ago
53edc66ecc4d mtusi-lab3-api-10 Up About a minute (healthy)
===== run 5  18:36:09
## api before:
2ba86c0a9ce9 mtusi-lab3-api-8 Up 6 seconds (healthy)
53edc66ecc4d mtusi-lab3-api-10 Up About a minute (healthy)
$ make test-failover ACTION_SCRIPT=scripts/stop-one.cmd
Executing explicit failover hook; hook output suppressed to avoid leaking secrets.
{"observed_instances_before": 2, "successful_writes": 139, "failed_attempts": 0, "first_recovery_seconds": 3.913}
PASS: failover preserved confirmed data and existing session. Hook scope needs operator evidence.
## api after (stopped replica must be Exited):
2ba86c0a9ce9 mtusi-lab3-api-8 Exited (0) 11 seconds ago
53edc66ecc4d mtusi-lab3-api-10 Up 2 minutes (healthy)
===== run 6  18:36:34
## api before:
2ba86c0a9ce9 mtusi-lab3-api-8 Up 6 seconds (healthy)
53edc66ecc4d mtusi-lab3-api-10 Up 2 minutes (healthy)
$ make test-failover ACTION_SCRIPT=scripts/stop-one.cmd
Executing explicit failover hook; hook output suppressed to avoid leaking secrets.
{"observed_instances_before": 2, "successful_writes": 137, "failed_attempts": 0, "first_recovery_seconds": 3.806}
PASS: failover preserved confirmed data and existing session. Hook scope needs operator evidence.
## api after (stopped replica must be Exited):
2ba86c0a9ce9 mtusi-lab3-api-8 Exited (0) 11 seconds ago
53edc66ecc4d mtusi-lab3-api-10 Up 2 minutes (healthy)
mtusi-lab3-api-10 Up 2 minutes (healthy)
mtusi-lab3-api-8 Up 6 seconds (healthy)
mtusi-lab3-lb-1 Up 2 minutes (healthy)
mtusi-lab3-postgres-1 Up 2 minutes (healthy)
mtusi-lab3-valkey-1 Up 2 minutes (healthy)
===== shifted run 1 (+1 LB request)  18:37:12
## api before:
2ba86c0a9ce9 mtusi-lab3-api-8 Up 19 seconds (healthy)
53edc66ecc4d mtusi-lab3-api-10 Up 2 minutes (healthy)
$ make test-failover ACTION_SCRIPT=scripts/stop-one.cmd
Executing explicit failover hook; hook output suppressed to avoid leaking secrets.
{"observed_instances_before": 2, "successful_writes": 139, "failed_attempts": 0, "first_recovery_seconds": 3.905}
PASS: failover preserved confirmed data and existing session. Hook scope needs operator evidence.
## api after (stopped replica must be Exited):
2ba86c0a9ce9 mtusi-lab3-api-8 Up 35 seconds (healthy)
53edc66ecc4d mtusi-lab3-api-10 Exited (0) 11 seconds ago
