jgrusewski a35a564f45 fix(ml): DQN hyperopt overhaul — DSR reward, dead features, C51/noisy/network fixes ...

22-task overhaul (6 phases) for DQN training quality:
- Differential Sharpe Ratio (DSR) reward replacing raw PnL
- Remove 11 dead features (3 regime + 8 OFI): state_dim 54→43, feature_dim 51→40
- C51 v_min/v_max aligned to DSR Q-value range (±25.0)
- IQN batch path fix — consistent network for train+inference
- RMSNorm in distributional-dueling network
- Noisy layer sigma_init wired through config
- Rainbow config unified with DSR/C51/noisy defaults
- All dimension constants, comments, CUDA buffers updated
- 2747 lib tests passing, 0 failures, 0 warnings

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

2026-03-07 12:08:39 +01:00

..

2026-02-26-on-demand-training-design.md

…

2026-02-26-on-demand-training-implementation.md

…

2026-02-26-training-pipeline-design.md

…

2026-02-26-training-pipeline-implementation.md

…

2026-02-27-autonomous-agents-design.md

…

2026-02-27-autonomous-agents-implementation.md

…

2026-02-27-cockpit-nat-gateway-design.md

…

2026-02-27-cockpit-nat-gateway-implementation.md

…

2026-02-27-gpu-resource-optimization-design.md

…

2026-02-27-gpu-resource-optimization-implementation.md

…

2026-02-27-training-deploy-design.md

…

2026-02-27-training-deploy-plan.md

…

2026-02-28-gpu-pipeline-design.md

…

2026-02-28-gpu-pipeline-phase2b-design.md

…

2026-02-28-gpu-pipeline-phase2b-implementation.md

…

2026-02-28-gpu-pipeline-phase2c-implementation.md

…

2026-02-28-gpu-utilization-optimization-design.md

…

2026-02-28-gpu-utilization-optimization-implementation.md

…

2026-02-28-numeric-type-standardization-design.md

…

2026-02-28-numeric-type-standardization-implementation.md

…

2026-02-28-ppo-cuda-pipeline-design.md

…

2026-02-28-s3-binary-share-design.md

…

2026-02-28-s3-binary-share-implementation.md

…

2026-03-01-codebase-consolidation-design.md

…

2026-03-01-codebase-consolidation-implementation.md

…

2026-03-01-deferred-stubs-design.md

…

2026-03-01-deferred-stubs-implementation.md

…

2026-03-01-gpu-blockers-validation-design.md

…

2026-03-01-gpu-full-sweep-design.md

…

2026-03-01-gpu-full-sweep-implementation.md

…

2026-03-01-gpu-max-performance-phase2-design.md

…

2026-03-01-infra-security-hardening-design.md

docs: add infrastructure security hardening design

2026-03-01 23:13:13 +01:00

2026-03-01-infra-security-hardening-implementation.md

docs: add infrastructure security hardening implementation plan

2026-03-01 23:16:44 +01:00

2026-03-01-io-pipeline-wiring-design.md

…

2026-03-01-io-pipeline-wiring-implementation.md

…

2026-03-01-ml-inference-production-cleanup-design.md

…

2026-03-01-ml-inference-production-cleanup-implementation.md

…

2026-03-01-real-metrics-overhaul-design.md

…

2026-03-01-real-metrics-overhaul-implementation.md

…

2026-03-01-training-metrics-common-design.md

…

2026-03-01-training-observability-design.md

…

2026-03-01-training-observability-implementation.md

docs: training observability implementation plan (reduced scope)

2026-03-01 22:31:54 +01:00

2026-03-01-workspace-cleanup-design.md

docs: workspace cleanup design and implementation plan

2026-03-01 22:32:54 +01:00

2026-03-01-workspace-cleanup-implementation.md

docs: workspace cleanup design and implementation plan

2026-03-01 22:32:54 +01:00

2026-03-02-additional-training-metrics-design.md

docs: additional training metrics design — 17 new Prometheus metrics

2026-03-02 23:44:45 +01:00

2026-03-02-additional-training-metrics.md

docs: implementation plan for 17 additional training metrics

2026-03-02 23:48:18 +01:00

2026-03-02-binary-cache-consolidation-design.md

docs: binary cache PVC consolidation design (8 PVCs → 1 shared)

2026-03-02 10:58:33 +01:00

2026-03-02-binary-cache-consolidation-implementation.md

chore(infra): delete 8 per-service binary-cache PVCs (replaced by foxhunt-binaries)

2026-03-02 11:20:03 +01:00

2026-03-02-fxt-broker-check-design.md

docs: add design for fxt broker check CLI command

2026-03-02 13:26:17 +01:00

2026-03-02-fxt-broker-check-implementation.md

docs: add implementation plan for fxt broker check command

2026-03-02 13:28:51 +01:00

2026-03-02-gpu-per-sumtree-design.md

docs: GPU-resident PER sum-tree design

2026-03-02 23:40:57 +01:00

2026-03-02-gpu-per-sumtree-implementation.md

docs: GPU PER sum-tree implementation plan (13 tasks)

2026-03-02 23:45:27 +01:00

2026-03-02-monitoring-service-design.md

docs: add monitoring service design — live training metrics over gRPC

2026-03-02 21:05:48 +01:00

2026-03-02-monitoring-service.md

feat(fxt,ml): add fxt train monitor command and update DQN tests for action collapse fix

2026-03-04 22:58:40 +01:00

2026-03-02-node-pool-split-design.md

docs: 3-pool node split design (gitlab/platform/foxhunt)

2026-03-02 09:49:46 +01:00

2026-03-02-node-pool-split-implementation.md

infra(tf): add platform pool, rename services → foxhunt in Kapsule module

2026-03-02 09:59:21 +01:00

2026-03-03-bf16-training-design.md

docs: add BF16 training design — pure BF16 for all 10 models

2026-03-03 15:56:14 +01:00

2026-03-03-bf16-training.md

docs: update stale rainbow_agent_impl path in bf16 plan

2026-03-04 18:36:28 +01:00

2026-03-03-dqn-action-collapse-fix.md

docs: DQN action collapse fix design — 5 fixes for 45-action diversity

2026-03-03 00:59:20 +01:00

2026-03-03-dqn-production-hardening-design.md

docs: add DQN production hardening design

2026-03-03 20:40:46 +01:00

2026-03-03-epoch-financial-metrics-design.md

feat(fxt,ml): add fxt train monitor command and update DQN tests for action collapse fix

2026-03-04 22:58:40 +01:00

2026-03-03-epoch-financial-metrics-implementation.md

feat(fxt,ml): add fxt train monitor command and update DQN tests for action collapse fix

2026-03-04 22:58:40 +01:00

2026-03-03-fxt-dashboard-design.md

docs: fxt dashboard & CLI completion design

2026-03-03 01:14:02 +01:00

2026-03-03-fxt-dashboard-implementation.md

docs: fxt dashboard implementation plan (15 tasks)

2026-03-03 01:20:27 +01:00

2026-03-03-fxt-overhaul-design.md

docs: fxt 2.0 design and implementation plan

2026-03-03 20:11:21 +01:00

2026-03-03-fxt-overhaul-implementation.md

docs: fxt 2.0 design and implementation plan

2026-03-03 20:11:21 +01:00

2026-03-03-hyperopt-improvements-design.md

docs: add hyperopt improvements design and implementation plan

2026-03-03 18:17:23 +01:00

2026-03-03-hyperopt-improvements.md

docs: add hyperopt improvements design and implementation plan

2026-03-03 18:17:23 +01:00

2026-03-03-ppo-improvements-design.md

feat(ppo): wire symlog, adaptive entropy, percentile scaling into training loop

2026-03-03 20:12:00 +01:00

2026-03-03-rl-agent-gaps-design.md

docs: RL agent gaps design — 7 features for training quality and production readiness

2026-03-03 02:23:38 +01:00

2026-03-03-rl-agent-gaps-implementation.md

docs: RL agent gaps implementation plan — 7 tasks, vertical slices

2026-03-03 02:30:00 +01:00

2026-03-04-argo-migration-design.md

docs: add Argo Workflows migration design

2026-03-04 22:30:12 +01:00

2026-03-04-argo-workflows-phase1.md

feat(argo): add Argo Workflows infrastructure for training orchestration

2026-03-04 22:58:40 +01:00

2026-03-04-argo-workflows-training-design.md

feat(argo): add Argo Workflows infrastructure for training orchestration

2026-03-04 22:58:40 +01:00

2026-03-04-dqn-action-collapse-fix.md

feat(fxt,ml): add fxt train monitor command and update DQN tests for action collapse fix

2026-03-04 22:58:40 +01:00

2026-03-04-dqn-action-collapse-implementation.md

feat(fxt,ml): add fxt train monitor command and update DQN tests for action collapse fix

2026-03-04 22:58:40 +01:00

2026-03-04-gateway-unification-design.md

docs: add gateway unification design (api_gateway + web-gateway → api)

2026-03-04 23:13:35 +01:00

2026-03-04-gateway-unification-implementation.md

docs: add gateway unification implementation plan (22 tasks)

2026-03-04 23:18:10 +01:00

2026-03-04-minio-binary-distribution-design.md

feat(infra): replace PVC binary distribution with MinIO S3 fetch

2026-03-04 16:46:57 +01:00

2026-03-04-minio-binary-distribution.md

feat(infra): replace PVC binary distribution with MinIO S3 fetch

2026-03-04 16:46:57 +01:00

2026-03-04-per-service-ci-design.md

docs: add per-service CI compilation & selective deploy design

2026-03-04 22:58:40 +01:00

2026-03-04-per-service-ci-implementation.md

docs: add per-service CI implementation plan (12 tasks)

2026-03-04 21:56:09 +01:00

2026-03-04-pods-panel-versioning-design.md

feat(infra): standalone Prometheus deployment for foxhunt namespace

2026-03-04 13:24:52 +01:00

2026-03-04-pods-panel-versioning.md

chore: add SubscribeClusterPods stub to trading_service + plan doc

2026-03-04 13:17:41 +01:00

2026-03-04-tui-live-data-design.md

docs: TUI live data wiring design

2026-03-04 01:54:33 +01:00

2026-03-04-tui-live-data.md

docs: TUI live data wiring implementation plan

2026-03-04 02:04:08 +01:00

2026-03-05-hyperopt-degenerate-fix-design.md

chore: track logo, hyperopt design docs, gitignore playwright-mcp

2026-03-05 17:06:53 +01:00

2026-03-05-hyperopt-degenerate-fix.md

chore: track logo, hyperopt design docs, gitignore playwright-mcp

2026-03-05 17:06:53 +01:00

2026-03-06-dqn-action-space-fix.md

fix(ml): DQN hyperopt overhaul — DSR reward, dead features, C51/noisy/network fixes

2026-03-07 12:08:39 +01:00

2026-03-06-dqn-hyperopt-overhaul-design.md

docs: DQN hyperopt overhaul design — 7 remaining root cause fixes

2026-03-06 11:44:02 +01:00

2026-03-06-dqn-hyperopt-overhaul-implementation.md

docs: add DQN hyperopt overhaul implementation plan

2026-03-06 14:32:37 +01:00

2026-03-07-dqn-hyperopt-overhaul-v2.md

fix(ml): DQN hyperopt overhaul — DSR reward, dead features, C51/noisy/network fixes

2026-03-07 12:08:39 +01:00

2026-03-07-hyperopt-objective-fixes.md

fix(ml): 3 hyperopt objective bugs — sliding windows, tanh normalization, adaptive tau

2026-03-07 02:14:31 +01:00