Files
foxhunt/crates
jgrusewski 0c8cb6ad5b fix(rl): v9 defensive eval-boundary calibration
Implements docs/superpowers/specs/2026-05-31-v9-defensive-eval-boundary-calibration.md.
Closes the [[pearl_adaptive_carryover_discipline]] gap: every adaptive
EMA must reset OR re-bootstrap at regime boundaries, never selectively
preserve train-acquired statistics.

Layer 1 — full EMA reset in `reset_session_state`:
  - win_rate, avg_win/loss EMAs → neutral sentinels
  - cumulative_dones → 0 (re-enter Kelly bootstrap)
  - inventory_beta + inventory_variance EMAs → 0
  - reward_clamp pos/neg max EMAs + clip_rate EMA → 0
  - Kelly fraction → 1.0 (bootstrap)
  Lifts Fix D's deliberate carryover (commit 7064c9269), which was
  diagnosed in v8 fold-1 eval as the primary -$507k driver: agent
  entered eval with train wr=0.34 EMA and took aggressively-sized
  losing trades while EMA decayed to true eval wr=0.25.

Layer 2 — defensive warmup window:
  - New `rl_eval_warmup_decay` CUDA kernel: single-thread single-block,
    no atomics, mapped-pinned only. Runs after fused controllers each
    step. Overrides 4 risk-sizing floors (Kelly safety_frac, IQN τ_min,
    entropy_coef_min, PPO clip ε_min) with conservative defensive
    values for the first 500 steps post-boundary, with linear decay
    over the final 200 steps back to normal targets.
  - 11 new ISV slots (685-695): remaining counter, configured
    durations, defensive overrides (0.25/0.30/0.05/0.10), normal
    targets (0.50/0.10/0.01/0.05).
  - Sentinel counter = -1 at boot → kernel is no-op until reset arms it.

All boundary semantics live in ISV; no hardcoded constants in the
kernel. Build verified, all 13 risk-stack invariants + 5 controller
adaptive-floor tests + integrated-trainer smoke pass on RTX 3050.
2026-05-31 01:52:29 +02:00
..