Files
foxhunt/docs
jgrusewski a0abc3da35 feat(dqn-v2): C.4 temporal timing bonus on trade exit — peak-bar proximity
Plan 3 Task 5.

Portfolio-state tail-append (shared-contract migration, all in same commit):
- PS_PEAK_PNL_BAR = 38 (hold_time snapshotted when MAX_PNL updates)
- PS_STRIDE 38 -> 39 in state_layout.cuh and ml-core/state_layout.rs
- PORTFOLIO_STRIDE 38 -> 39 in trade_stats_kernel.cu (hardcoded copy)
- PORTFOLIO_STRIDE 38 -> 39 in gpu_experience_collector.rs allocator
- ps_stride 38 -> 39 in gpu_dqn_trainer.rs launch_kelly_cap_update

Producer (experience_kernels.cu):
- Peak bar snapshotted alongside every MAX_PNL update (uses local
  hold_time, not ps[PS_HOLD_TIME], because the portfolio-state commit
  block runs later in the kernel).
- Peak bar reset to 0 at every MAX_PNL reset site: plan-entry (1856),
  entering_trade (2014), reversing_trade (2019), fold hard-reset (2736),
  trade-complete soft-reset (2751).

Consumer (experience_kernels.cu segment_complete block):
- bars_early = max(0, segment_hold_time - PS_PEAK_PNL_BAR)
- timing_bonus = shaping_scale x (bars_early / segment_hold_time)
                 x |final_pnl| x conviction_core
- reward += timing_bonus; rc[5] += timing_bonus
  (accumulates with Task 3 B.2 entry bonus — different (i,t) slots).

No new ISV slot — rc[5] bonus semantics unchanged; B.2 and C.4 share it
via += accumulate semantics (defensively idempotent, but the two sites
fire at distinct (i,t) by construction: entry vs exit).

Self-scaling: shaping_scale x conviction_core x |pnl| keeps the bonus
proportional to trade magnitude, no tuned coefficients.

Smoke multi_fold_convergence (RTX 3050 Ti): all 3 folds complete,
fold-2 best Sharpe 84.44 at epoch 1 (expected ~85 range).
cargo check --workspace clean at 11 warnings baseline.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-04-24 23:34:27 +02:00
..