jgrusewski
bfc3ffa9dc
diag(sp15-wave5): in-capture CAPTURE_PHASE_* checkpoints
Smoke train-fp7xx printed all 16 Phase-6/7/8 checkpoints clean through
PER_PRIORITY_DONE. CAPTURE_DONE missing, exit changed 139→143 (SIGTERM)
— capture_training_graph hangs or takes ~40s past PER_PRIORITY_DONE
before Argo terminates the pod.
Adds 14 CAPTURE_PHASE_* checkpoints across the 12 child captures +
parent compose:
BEGIN / PER_SAMPLE / COUNTERS / SPECTRAL / FORWARD / DDQN / AUX
POST_AUX / ADAM_GRAD / ADAM_UPDATE / MAINTENANCE / IQL_MODULATE
PER_PRIORITY / CHILDREN_STORED / PARENT_COMPOSED
Diagnostic-only.
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-07 12:47:23 +02:00
..
2026-05-07 11:39:34 +02:00
2026-04-23 08:41:44 +02:00
2026-04-23 10:50:56 +02:00
2026-05-02 14:02:53 +02:00
2026-05-06 23:39:45 +02:00
2026-05-07 12:47:23 +02:00
2026-04-24 13:10:49 +02:00
2026-04-23 08:41:44 +02:00
2026-05-03 11:34:41 +02:00
2026-04-27 22:35:47 +02:00
2026-05-02 19:48:49 +02:00
2026-05-01 01:45:18 +02:00
2026-05-01 11:10:41 +02:00
2026-04-24 13:10:49 +02:00
2026-05-02 14:02:53 +02:00