jgrusewski
2542fbabd4
perf: Phase 1 mega-graph — capture CQL + C51 clip + pruning in graph_adam
Moved 3 per-step operations into CUDA Graph capture:
1. CQL gradient (submit_cql_ops): CQL logit grad kernel + f32→bf16 cast
+ cuBLAS backward into cql_grad_scratch + grad_norm + clipped SAXPY.
Full cuBLAS backward is graph-capturable. Budget fractions baked as
literals (all auxiliaries always active: CQL=25%, C51=60%).
2. C51 gradient clip (submit_c51_clip_ops): grad_norm + finalize + clip.
Budget 60% baked at capture time.
3. Pruning mask (submit_pruning_mask_ops): element-wise grad *= mask.
graph_adam now contains: CQL backward + C51 clip + pruning + grad_norm
+ Adam + unflatten. Eliminates ~10 ungraphed kernel launches per step.
Per-step kernel launches reduced from ~38 to ~28.
Remaining ungraphed (Phase 2 targets):
- spectral_norm (~3 launches)
- EMA (~1 launch)
- attention fwd+bwd+adam (~6 launches)
- IQL train_value_step (~5 launches)
- IQN train + trunk grad (~10 launches)
- HER relabel (~2 launches)
- causal (1/100 steps)
- vaccine (1/10 steps)
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-04-02 09:32:43 +02:00
..
2026-03-13 10:18:35 +01:00
2026-03-27 19:52:44 +01:00
2026-03-12 19:10:18 +01:00
2026-03-14 11:35:15 +01:00
2026-03-13 10:18:35 +01:00
2026-03-13 10:18:35 +01:00
2026-03-01 22:47:39 +01:00
2026-04-02 09:32:43 +02:00
2026-03-13 10:18:35 +01:00
2026-03-13 10:18:35 +01:00
2026-03-13 10:18:35 +01:00
2026-04-01 23:38:36 +02:00
2026-03-01 22:47:39 +01:00
2026-03-13 10:18:35 +01:00
2026-04-02 09:06:23 +02:00
2026-03-29 22:35:37 +02:00
2026-03-29 22:35:37 +02:00
2026-03-31 12:37:25 +02:00
2026-03-29 19:18:47 +02:00
2026-03-19 00:39:03 +01:00
2026-03-13 10:18:35 +01:00
2026-03-13 10:18:35 +01:00
2026-03-31 00:39:59 +02:00
2026-03-16 21:01:28 +01:00
2026-03-13 10:18:35 +01:00
2026-03-13 10:18:35 +01:00
2026-03-13 10:18:35 +01:00
2026-03-10 13:18:57 +01:00
2026-03-28 01:51:45 +01:00
2026-03-13 10:18:35 +01:00
2026-03-13 10:18:35 +01:00
2026-03-13 10:18:35 +01:00
2026-03-18 00:53:47 +01:00
2026-03-14 11:35:15 +01:00
2026-03-01 22:47:39 +01:00
2026-03-15 11:59:31 +01:00
2026-03-01 22:47:39 +01:00
2026-03-03 22:16:35 +01:00