plan(dqn): MoE regime redesign — bite-sized implementation plan
Implementation plan for the approved MoE spec at
docs/superpowers/specs/2026-04-27-moe-regime-redesign-design.md.
6 phases:
- Phase 0: use_* flag cleanup + count_bonus refactor (precondition,
partially in stash@{0})
- Phase 1: MoE infrastructure (additive — moe_lambda hyperparameter,
9 ISV slots, MoeGate/MoeExpert skeletons, params_buf layout extension)
- Phase 2: 4 new CUDA kernels (mixture forward/backward,
load_balance_loss, expert_util_ema_update) with TDD unit tests
- Phase 3: wire MoE into the training graph (forward, backward, loss
aggregation, ISV producer launch, HEALTH_DIAG aux_moe line)
- Phase 4: atomic deletion of vestigial RegimeConditionalDQN (per
feedback_no_partial_refactor.md)
- Phase 5: Layer 3/5 tests + L40S 30-epoch validation with explicit
kill criteria
Each task has bite-sized steps (2-5 min each) with exact file paths,
copy-pasteable code, exact commands, and TDD pattern (test fails first,
implement to make pass, commit).
Self-review: spec section coverage verified, no placeholders, type
consistency verified across phases.
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
69141d6266