Commit Graph

9 Commits

Author SHA1 Message Date
jgrusewski
b4e1ce30e1 docs: add gradient accumulation implementation plan
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-02-20 21:59:14 +01:00
jgrusewski
1d6663027e docs: add gradient accumulation design
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-02-20 21:53:45 +01:00
jgrusewski
079f3192eb docs: add DQN pipeline production readiness design
4-phase plan: fix tests + OOM safety, inference path,
longer training, hyperopt end-to-end.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-02-20 20:49:41 +01:00
jgrusewski
ee601149de docs: add DQN training smoke test implementation plan
4-task plan: add trainer accessors, write smoke test with 6 core
assertions (loss convergence, finite losses, Q-value divergence,
checkpoint integrity, epsilon decay), add Sharpe comparison vs
untrained baseline, final verification.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-02-20 20:03:10 +01:00
jgrusewski
525355fe73 docs: add DQN training smoke test design
Single integration test that verifies the complete train → checkpoint →
validate pipeline works on real 6E.FUT data. 7 assertions covering
loss convergence, Q-value divergence, checkpoint round-trip, epsilon
decay, and Sharpe improvement vs untrained baseline.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-02-20 19:56:20 +01:00
jgrusewski
6007f98c26 docs: Add DQN algorithm fix implementation plan (11 tasks)
Detailed TDD implementation plan for:
- Task 1: Bug fixes (NaN panic, Adam eps, dedup enum)
- Task 2: State dimension consolidation (→51)
- Task 3-5: CQL offline RL regularization
- Task 4,6-9: IQN distributional RL (replaces broken C51)
- Task 8: CVaR risk-aware action selection
- Task 10-11: Integration test and verification

Each task has exact file paths, code, test commands, and safety gates.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-02-20 14:44:44 +01:00
jgrusewski
91af2b9334 docs: Add DQN algorithm fix & 2026 modernization design
Research-validated design for fixing critical DQN issues:
- CQL regularization for offline RL training on historical data
- IQN integration replacing broken C51 (Candle scatter_add bug)
- CVaR risk-aware action selection
- State dimension consolidation (51 is canonical)
- NaN panic fix, Adam epsilon fix per Rainbow paper

Verified against 20+ papers and 2026 SOTA.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-02-20 14:39:58 +01:00
jgrusewski
2b914728c6 docs: Add codebase deep clean implementation plan
16-task bottom-up execution plan with exact file paths, commands,
and safety gates. Covers: doc purge, dead code removal, module
consolidation, test reorganization, file splitting, and folder
restructuring.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-02-20 13:21:25 +01:00
jgrusewski
cec36d3072 docs: Add codebase deep clean design document
Comprehensive cleanup plan covering: documentation purge, dead code
removal (~4,846 lines across 11 files), module consolidation,
test reorganization, large file splitting, and folder restructuring.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-02-20 13:08:10 +01:00