jgrusewski
dcd851a62d
perf(rl): cuBLAS SGEMM for DQN/IQN + Bellman/outcome kernel fusion
DQN: replace hand-written fwd/bwd/grad (27.5% GPU time) with cuBLAS
SGEMM tensor-core operations. Eliminates 30MiB per-batch grad scratch.
IQN: replace embedding matmul + output projection with cuBLAS SGEMM.
Pre-allocate scratch buffers for graph-capture safety. Fix device_ptr
→ raw_ptr in helpers. Convert remaining 6 launch_builder to raw_launch.
Bellman: fuse select_action_atoms + bellman_target_projection into
single kernel with shared-memory intermediate. Saves 424 launches.
Outcome: fuse fwd + CE + bwd into single kernel with shared-memory
logits/grad. Saves 848 launches.
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
2026-05-26 17:17:56 +02:00
..
2026-05-22 18:08:36 +02:00
2026-05-22 20:39:32 +02:00
2026-05-26 17:17:56 +02:00
2026-05-24 21:15:04 +02:00
2026-05-19 01:19:13 +02:00
2026-05-14 02:13:05 +02:00
2026-05-08 13:09:21 +02:00
2026-05-08 13:09:21 +02:00
2026-05-24 23:11:03 +02:00
2026-05-08 13:09:21 +02:00
2026-05-08 13:09:21 +02:00