jgrusewski
bf87a8d0bb
perf: kan_grad_reduce — batch-parallel 2-phase (8ms×208 → <0.1ms×208)
Replace single-phase one-thread-per-param serial loop (batch_size iterations
per thread) with kan_grad_reduce_p1 (block sums, grid=(ceil(B/256),total_params),
shared mem) + kan_grad_reduce_p2 (warp-shuffle final reduce, grid=(total_params)).
Allocate partials scratch [ceil(B/256)*total_params] for trunk + 4 branches.
Update CublasBackwardSet constructor signature and both call sites.
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-04-19 12:49:03 +02:00
..
2026-04-11 11:54:09 +02:00
2026-04-11 00:13:09 +02:00
2026-04-19 12:49:03 +02:00
2026-03-31 10:56:20 +02:00
2026-04-02 09:06:23 +02:00
2026-04-11 21:03:05 +02:00
2026-04-03 18:30:44 +02:00
2026-04-18 01:04:11 +02:00
2026-04-11 00:13:09 +02:00
2026-04-11 11:54:09 +02:00
2026-04-19 10:23:51 +02:00
2026-04-11 11:54:09 +02:00
2026-04-11 00:13:09 +02:00
2026-04-04 09:41:53 +02:00
2026-04-17 02:12:33 +02:00
2026-04-10 18:54:14 +02:00
2026-04-18 01:04:11 +02:00
2026-04-02 22:46:30 +02:00