Files
foxhunt/crates
jgrusewski 719f18baab perf: eliminate ALL remaining concerns — zero waste in hot path
Vaccine:
- Replaced upload_batch_gpu (sync DtoD) with upload_batch_ptrs_6 +
  submit_indirect_upload_ops (async indirect kernels). Zero sync.
- Deleted upload_batch_gpu entirely — no callers remain.

Causal intervention:
- Removed entirely from hot path. Was running 14 cuBLAS forward passes
  every 100 steps with no readback and no training decision based on
  the result. Pure GPU waste.
- Kernel still exists in cubin for future offline analysis.

Causal readback:
- Removed stream.synchronize() + memcpy_dtoh from run_causal_intervention.
  Return value was already discarded by caller. Now returns 0.0 immediately.
  Sensitivity stays on GPU.

Dead code:
- Deleted upload_batch_gpu (72 lines) — replaced by indirect upload.

Per-step hot path on step 2+:
  9 graph replays (~45µs)
  5 async HtoD (92 bytes, ~5µs)
  Zero sync. Zero DtoH. Zero alloc. Zero CPU compute.
  Zero concerns.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-04-02 10:35:16 +02:00
..