Files
foxhunt/crates
jgrusewski 1a6834fff2 feat(ml): parallel ensemble inference via rayon — sub-ms multi-model predictions
Replace sequential for-loop over ModelInferenceAdapters with rayon
par_iter(). Each adapter's predict() runs on a separate thread,
then results are aggregated sequentially (fast arithmetic).

ModelInferenceAdapter: Send + Sync makes this safe for parallel execution.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-01 21:31:38 +01:00
..