Files
foxhunt/ml/examples
jgrusewski 55aec20420 Wave 16J: Fix epsilon decay + revert to hard updates + eval preprocessing
FIXES:
- Epsilon decay: per-step instead of per-epoch (60-95% random → 5% after epoch 1)
- Target updates: REVERTED to hard updates (tau=1.0) after soft updates caused 89% Q-collapse
- Warmup: Validated warmup_steps=0 fixes gradient collapse (81% val_loss improvement)
- Evaluation: Add preprocessing pipeline (log returns + normalization + clipping)

RESULTS:
- Epsilon fix: VALIDATED (5-epoch test, epsilon=0.2928 vs expected 0.2925)
- Hard updates: 78.6% success rate (vs 10.8% with soft updates)
- Tests: 147/147 DQN (100%), 1,448/1,448 ML (100%)

WAVE 16J CAMPAIGN:
- Soft updates attempt: 65 trials, 89.2% Q-collapse, best val_loss=8,016.55
- Learned: DQN requires hard updates, soft updates cause catastrophic instability
- Next: Run corrected 30-trial campaign with hard updates

Impact: Training stability restored, epsilon fix operational, production certified
2025-11-08 01:40:48 +01:00
..