Intermediate state — masked advantages still crash qpa because distillation + entropy gradients run every step on non-done elements. Next: two-timescale π update (option 4). Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
Intermediate state — masked advantages still crash qpa because distillation + entropy gradients run every step on non-done elements. Next: two-timescale π update (option 4). Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>