jgrusewski ba8fb8eedd feat(ppo): wire symlog, adaptive entropy, percentile scaling into training loop ...

Integrate all PPO improvement modules into the core training paths:
- Symlog value predictions in compute_value_loss (MLP + LSTM)
- Adaptive entropy auto-tuning replaces fixed entropy_coeff
- Percentile P5/P95 advantage scaling for heavy-tailed returns
- DAPO clip_epsilon_high wired in all 7 PPOConfig construction sites
- Shape mismatch fix in adaptive_entropy (unsqueeze scalar)

2726 tests pass, 0 clippy errors.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

2026-03-03 20:12:00 +01:00

..

2026-02-26-on-demand-training-design.md

docs: add on-demand training dispatch design

2026-02-26 11:39:05 +01:00

2026-02-26-on-demand-training-implementation.md

docs: add on-demand training dispatch implementation plan

2026-02-26 11:42:54 +01:00

2026-02-26-training-pipeline-design.md

feat(ml): add manually-triggered GitLab CI training pipeline

2026-02-26 09:04:58 +01:00

2026-02-26-training-pipeline-implementation.md

feat(ml): add manually-triggered GitLab CI training pipeline

2026-02-26 09:04:58 +01:00

2026-02-27-autonomous-agents-design.md

docs: autonomous CI agents design — OpenHands + GitLab issue bus

2026-02-27 08:14:17 +01:00

2026-02-27-autonomous-agents-implementation.md

docs: add autonomous agents implementation plan (23 tasks, 6 phases)

2026-02-27 08:20:56 +01:00

2026-02-27-cockpit-nat-gateway-design.md

docs: add Cockpit metrics + NAT gateway design

2026-02-27 00:27:23 +01:00

2026-02-27-cockpit-nat-gateway-implementation.md

docs: add implementation plan for Cockpit metrics + NAT gateway

2026-02-27 00:30:06 +01:00

2026-02-27-gpu-resource-optimization-design.md

docs: GPU resource optimization design — RL→L4, supervised→L40S

2026-02-27 16:15:07 +01:00

2026-02-27-gpu-resource-optimization-implementation.md

docs: GPU resource optimization implementation plan

2026-02-27 16:16:55 +01:00

2026-02-27-training-deploy-design.md

docs: add training pipeline & model deployment design

2026-02-27 22:08:26 +01:00

2026-02-27-training-deploy-plan.md

docs: add training pipeline & model deployment implementation plan

2026-02-27 22:13:29 +01:00

2026-02-28-gpu-pipeline-design.md

perf: eliminate heap-alloc Decimal→float casts across 19 files (36 instances)

2026-02-28 02:29:04 +01:00

2026-02-28-gpu-pipeline-phase2b-design.md

docs: add GPU pipeline Phase 2b design — zero-roundtrip CUDA experience collection

2026-02-28 11:51:43 +01:00

2026-02-28-gpu-pipeline-phase2b-implementation.md

docs: add Phase 2b implementation plan — 10 tasks for zero-roundtrip kernel

2026-02-28 11:58:30 +01:00

2026-02-28-gpu-pipeline-phase2c-implementation.md

docs: add PPO CUDA pipeline Phase 2c implementation plan — 11 tasks

2026-02-28 13:07:20 +01:00

2026-02-28-gpu-utilization-optimization-design.md

docs: GPU utilization optimization design

2026-02-28 21:18:51 +01:00

2026-02-28-gpu-utilization-optimization-implementation.md

docs: GPU utilization optimization implementation plan

2026-02-28 21:24:51 +01:00

2026-02-28-numeric-type-standardization-design.md

docs: numeric type standardization design (i64/6dp financial types)

2026-02-28 02:32:46 +01:00

2026-02-28-numeric-type-standardization-implementation.md

docs: numeric type standardization implementation plan

2026-02-28 02:37:53 +01:00

2026-02-28-ppo-cuda-pipeline-design.md

docs: add PPO CUDA pipeline Phase 2c design — zero-roundtrip experience collection

2026-02-28 12:59:45 +01:00

2026-02-28-s3-binary-share-design.md

docs: add S3 binary share design — eliminate Docker builds, faster pod startup

2026-02-28 17:46:13 +01:00

2026-02-28-s3-binary-share-implementation.md

docs: add S3 binary share implementation plan (15 tasks)

2026-02-28 17:50:37 +01:00

2026-03-01-codebase-consolidation-design.md

docs: add codebase consolidation & DRY cleanup design

2026-03-01 19:22:22 +01:00

2026-03-01-codebase-consolidation-implementation.md

docs: add codebase consolidation implementation plan

2026-03-01 19:25:01 +01:00

2026-03-01-deferred-stubs-design.md

docs: add deferred stubs implementation design

2026-03-01 21:17:30 +01:00

2026-03-01-deferred-stubs-implementation.md

docs: add deferred stubs implementation plan

2026-03-01 21:21:53 +01:00

2026-03-01-gpu-blockers-validation-design.md

feat(ml): maximize GPU utilization — BF16 mixed precision, dynamic sizing, sync reduction

2026-03-01 17:54:25 +01:00

2026-03-01-gpu-full-sweep-design.md

docs: GPU optimization full sweep design — training binary, PPO parity, NCCL multi-GPU

2026-03-01 21:25:36 +01:00

2026-03-01-gpu-full-sweep-implementation.md

docs: GPU full sweep implementation plan — 17 tasks covering P0-P3

2026-03-01 21:25:36 +01:00

2026-03-01-gpu-max-performance-phase2-design.md

docs: GPU max performance Phase 2 design (L4 → H100)

2026-03-01 18:37:03 +01:00

2026-03-01-infra-security-hardening-design.md

docs: add infrastructure security hardening design

2026-03-01 23:13:13 +01:00

2026-03-01-infra-security-hardening-implementation.md

docs: add infrastructure security hardening implementation plan

2026-03-01 23:16:44 +01:00

2026-03-01-io-pipeline-wiring-design.md

docs: I/O pipeline wiring design — prefetcher, buffer pool, double-buffer

2026-03-01 21:39:50 +01:00

2026-03-01-io-pipeline-wiring-implementation.md

docs: I/O pipeline wiring implementation plan — 7 tasks

2026-03-01 21:42:38 +01:00

2026-03-01-ml-inference-production-cleanup-design.md

docs: ML inference production cleanup design

2026-03-01 17:16:08 +01:00

2026-03-01-ml-inference-production-cleanup-implementation.md

docs: ML inference production cleanup implementation plan

2026-03-01 17:23:07 +01:00

2026-03-01-real-metrics-overhaul-design.md

docs: add real metrics overhaul design

2026-03-01 01:51:24 +01:00

2026-03-01-real-metrics-overhaul-implementation.md

docs: add real metrics overhaul implementation plan

2026-03-01 02:00:08 +01:00

2026-03-01-training-metrics-common-design.md

docs: training metrics design — common::metrics ownership

2026-03-01 15:23:41 +01:00

2026-03-01-training-observability-design.md

docs: training observability + Grafana dashboards design

2026-03-01 22:25:11 +01:00

2026-03-01-training-observability-implementation.md

docs: training observability implementation plan (reduced scope)

2026-03-01 22:31:54 +01:00

2026-03-01-workspace-cleanup-design.md

docs: workspace cleanup design and implementation plan

2026-03-01 22:32:54 +01:00

2026-03-01-workspace-cleanup-implementation.md

docs: workspace cleanup design and implementation plan

2026-03-01 22:32:54 +01:00

2026-03-02-additional-training-metrics-design.md

docs: additional training metrics design — 17 new Prometheus metrics

2026-03-02 23:44:45 +01:00

2026-03-02-additional-training-metrics.md

docs: implementation plan for 17 additional training metrics

2026-03-02 23:48:18 +01:00

2026-03-02-binary-cache-consolidation-design.md

docs: binary cache PVC consolidation design (8 PVCs → 1 shared)

2026-03-02 10:58:33 +01:00

2026-03-02-binary-cache-consolidation-implementation.md

chore(infra): delete 8 per-service binary-cache PVCs (replaced by foxhunt-binaries)

2026-03-02 11:20:03 +01:00

2026-03-02-fxt-broker-check-design.md

docs: add design for fxt broker check CLI command

2026-03-02 13:26:17 +01:00

2026-03-02-fxt-broker-check-implementation.md

docs: add implementation plan for fxt broker check command

2026-03-02 13:28:51 +01:00

2026-03-02-gpu-per-sumtree-design.md

docs: GPU-resident PER sum-tree design

2026-03-02 23:40:57 +01:00

2026-03-02-gpu-per-sumtree-implementation.md

docs: GPU PER sum-tree implementation plan (13 tasks)

2026-03-02 23:45:27 +01:00

2026-03-02-monitoring-service-design.md

docs: add monitoring service design — live training metrics over gRPC

2026-03-02 21:05:48 +01:00

2026-03-02-node-pool-split-design.md

docs: 3-pool node split design (gitlab/platform/foxhunt)

2026-03-02 09:49:46 +01:00

2026-03-02-node-pool-split-implementation.md

infra(tf): add platform pool, rename services → foxhunt in Kapsule module

2026-03-02 09:59:21 +01:00

2026-03-03-bf16-training-design.md

docs: add BF16 training design — pure BF16 for all 10 models

2026-03-03 15:56:14 +01:00

2026-03-03-bf16-training.md

docs: add BF16 training implementation plan (21 tasks, ~150 sites)

2026-03-03 16:02:10 +01:00

2026-03-03-dqn-action-collapse-fix.md

docs: DQN action collapse fix design — 5 fixes for 45-action diversity

2026-03-03 00:59:20 +01:00

2026-03-03-fxt-dashboard-design.md

docs: fxt dashboard & CLI completion design

2026-03-03 01:14:02 +01:00

2026-03-03-fxt-dashboard-implementation.md

docs: fxt dashboard implementation plan (15 tasks)

2026-03-03 01:20:27 +01:00

2026-03-03-hyperopt-improvements-design.md

docs: add hyperopt improvements design and implementation plan

2026-03-03 18:17:23 +01:00

2026-03-03-hyperopt-improvements.md

docs: add hyperopt improvements design and implementation plan

2026-03-03 18:17:23 +01:00

2026-03-03-ppo-improvements-design.md

feat(ppo): wire symlog, adaptive entropy, percentile scaling into training loop

2026-03-03 20:12:00 +01:00

2026-03-03-rl-agent-gaps-design.md

docs: RL agent gaps design — 7 features for training quality and production readiness

2026-03-03 02:23:38 +01:00

2026-03-03-rl-agent-gaps-implementation.md

docs: RL agent gaps implementation plan — 7 tasks, vertical slices

2026-03-03 02:30:00 +01:00