jgrusewski 5935907cd7 feat(ppo): gradient accumulation, clip-higher, and WorkingPPO→PPO rename ...

- Add accumulation_steps config to PPOConfig with gradient accumulation
  in update_mlp() using existing accumulate_grads/scale_grads utilities
- Add clip_epsilon_high: Option<f32> for asymmetric PPO clipping to
  prevent entropy collapse during long training
- Rename WorkingPPO → PPO for consistency with DQN naming convention
- Add pub type WorkingPPO = PPO for backward compatibility
- Fix PPOConfig struct literals in trading_service and hyperopt adapter

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

2026-02-21 01:00:54 +01:00

13 KiB

Raw Blame History

View Raw