jgrusewski 6192bd4eb6 spec: Q-learning improvements — n-step + IQN ensemble + noisy nets ...

Three-phase plan to push Q convergence past profitability:
1. N-step returns (n=10): 10× more direct reward signal
2. IQN complementary head alongside C51: ensemble action selection
3. Noisy linear layers: state-dependent exploration

C51 stays for the confidence gate's distributional LCB. IQN adds
flexible quantile estimation. Ensemble combines both for action
selection. All ISV-driven.

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>

2026-05-25 20:07:10 +02:00

..

infra

feat(infra): GPU training launcher with local/cloud routing

2026-02-23 11:19:58 +01:00

plans

design(foxhuntq): architectural pivot away from per-bar DQN to decoupled Belief Bus + Conformal DRL

2026-05-14 19:21:25 +02:00

superpowers

spec: Q-learning improvements — n-step + IQN ensemble + noisy nets

2026-05-25 20:07:10 +02:00

dqn-backward-nan-audit.md

fix(dqn): SP3 Mech 10 — ISV-driven h_s2 activation clamp + slot 49 diag

2026-04-30 17:26:25 +02:00

dqn-gpu-hot-path-audit.md

fix(sp15-cubin-preload): pre-load 6 SP15 launchers' CudaFunction handles in experience collector

2026-05-07 23:36:07 +02:00

dqn-named-dims.md

fix(dqn): mag_concat_qdir SH2+b0 vs SH2+3 off-by-one — buffer + weight migration

2026-04-27 22:19:41 +02:00

dqn-wire-up-audit.md

fix(ml): migrate test uploads from clone_htod to mapped-pinned

2026-05-22 20:39:32 +02:00

h_s2_consumers_audit.md

audit(dqn-v2): h_s2 audit anchor corrections (post-2c.3+4 reconnaissance)

2026-04-25 12:29:47 +02:00

health_diag_inventory.md

feat(diag): Phase 2A — health_diag_isv_mirror kernel + GpuHealthDiag orchestrator

2026-04-28 23:54:45 +02:00

isv-slots.md

feat(regime): vol_ref floor controller + cross-invocation disk persist

2026-05-16 09:22:20 +02:00

lookahead-bias-audit-2026-04-28.md

fix(audit): lookahead housekeeping — purge gap + per-fold NormStats

2026-05-09 13:52:00 +02:00

ml-supervised-to-dqn-concept-audit.md

plan4(task7): Part E audit close-out — every supervised concept landed or OUT

2026-04-26 10:36:03 +02:00

sp18-wireup-audit.md

feat(loader): instrument_id filter + outdated test fix + sp18 fingerprint

2026-05-22 15:56:31 +02:00