Files
foxhunt/crates
jgrusewski dcd851a62d perf(rl): cuBLAS SGEMM for DQN/IQN + Bellman/outcome kernel fusion
DQN: replace hand-written fwd/bwd/grad (27.5% GPU time) with cuBLAS
SGEMM tensor-core operations. Eliminates 30MiB per-batch grad scratch.

IQN: replace embedding matmul + output projection with cuBLAS SGEMM.
Pre-allocate scratch buffers for graph-capture safety. Fix device_ptr
→ raw_ptr in helpers. Convert remaining 6 launch_builder to raw_launch.

Bellman: fuse select_action_atoms + bellman_target_projection into
single kernel with shared-memory intermediate. Saves 424 launches.

Outcome: fuse fwd + CE + bwd into single kernel with shared-memory
logits/grad. Saves 848 launches.

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
2026-05-26 17:17:56 +02:00
..