Files
foxhunt/crates
jgrusewski 85138e2fbd feat(ml): add StreamAwareEnsemble with per-model CUDA streams
Stream-aware ensemble that runs models on separate CUDA streams
for true GPU-level parallelism. Falls back to rayon on CPU.
Uses CudaStreamPool for synchronization.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-02 17:59:12 +01:00
..