jgrusewski ae99567362 feat(generalization): CQL alpha 0.1→1.0, gradient budget 15%→25% ...

CQL was effectively disabled (0.1 alpha × 0.15 budget = 1.5% of gradient).
Now: alpha=1.0 × 0.25 budget = 25% of gradient enforces conservatism.
C51 reduced from 70% to 60% to accommodate.

CQL penalizes Q-values for actions not in the data — directly prevents
the model from being "confident but wrong" on OOS state-action pairs.

Hyperopt search range updated: [0.0, 1.0] → [0.5, 5.0].

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

2026-03-29 23:40:30 +02:00

3.4 KiB

Raw Blame History

View Raw