jgrusewski
bfc3ffa9dc
diag(sp15-wave5): in-capture CAPTURE_PHASE_* checkpoints
Smoke train-fp7xx printed all 16 Phase-6/7/8 checkpoints clean through
PER_PRIORITY_DONE. CAPTURE_DONE missing, exit changed 139→143 (SIGTERM)
— capture_training_graph hangs or takes ~40s past PER_PRIORITY_DONE
before Argo terminates the pod.
Adds 14 CAPTURE_PHASE_* checkpoints across the 12 child captures +
parent compose:
BEGIN / PER_SAMPLE / COUNTERS / SPECTRAL / FORWARD / DDQN / AUX
POST_AUX / ADAM_GRAD / ADAM_UPDATE / MAINTENANCE / IQL_MODULATE
PER_PRIORITY / CHILDREN_STORED / PARENT_COMPOSED
Diagnostic-only.
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-07 12:47:23 +02:00
..
2026-02-23 11:19:58 +01:00
2026-03-11 22:00:13 +01:00
2026-05-06 10:32:10 +02:00
2026-04-30 17:26:25 +02:00
2026-05-02 21:13:53 +02:00
2026-04-27 22:19:41 +02:00
2026-05-07 12:47:23 +02:00
2026-04-25 12:29:47 +02:00
2026-04-28 23:54:45 +02:00
2026-05-07 09:35:58 +02:00
2026-04-28 09:23:32 +02:00
2026-04-26 10:36:03 +02:00