jgrusewski 9e2c036c5e tune(rl): lower KL β=0.0005 + reward_kl=0.001 for b=1024 ...

β=0.003 pinned Hold=100% at b=1024 despite 60 dones/step.
The KL gradient overwhelms even the dense PPO signal.
Try 6× lower β to find the balance point.

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>

2026-05-27 11:14:58 +02:00

..

backtesting

…

common

…

config

…

ctrader-openapi

…

data

fix(loader): soft-validate FrontMonth symbol when no streaming SymbolMapping

2026-05-22 18:08:36 +02:00

database

…

market-data

…

ml

fix(ml): migrate test uploads from clone_htod to mapped-pinned

2026-05-22 20:39:32 +02:00

ml-alpha

tune(rl): lower KL β=0.0005 + reward_kl=0.001 for b=1024

2026-05-27 11:14:58 +02:00

ml-asset-selection

…

ml-backtesting

perf(rl): eliminate 2 of 3 per-step lobsim syncs — 21ms → 10ms/step

2026-05-27 11:07:57 +02:00

ml-checkpoint

…

ml-core

fix(ml-core): deterministic GPU weight init via scoped_init_seed

2026-05-19 01:19:13 +02:00

ml-data

…

ml-data-validation

…

ml-dqn

feat(sp22-vnext): Phase B4b-2 — replay-buffer scatter + trainer setter

2026-05-14 02:13:05 +02:00

ml-ensemble

fix(build-infra): cargo:rerun-if-env-changed=CUDA_COMPUTE_CAP across 6 crates

2026-05-08 13:09:21 +02:00

ml-explainability

fix(build-infra): cargo:rerun-if-env-changed=CUDA_COMPUTE_CAP across 6 crates

2026-05-08 13:09:21 +02:00

ml-features

fix(ml-features): imbalance bar cache on persistent PVC, not /tmp

2026-05-24 23:11:03 +02:00

ml-hyperopt

…

ml-labeling

…

ml-observability

…

ml-paper-trading

…

ml-ppo

fix(build-infra): cargo:rerun-if-env-changed=CUDA_COMPUTE_CAP across 6 crates

2026-05-08 13:09:21 +02:00

ml-regime

…

ml-regime-detection

…

ml-risk

…

ml-security

…

ml-stress-testing

…

ml-supervised

fix(build-infra): cargo:rerun-if-env-changed=CUDA_COMPUTE_CAP across 6 crates

2026-05-08 13:09:21 +02:00

ml-universe

…

ml-validation

…

model_loader

…

risk

…

risk-data

…

storage

…

trading_engine

…

trading-data

…

training_uploader

…