Raw E[Q] ~ 0.1 while h_s2 ~ 1.0 post-ReLU. Without normalization, Q_dir columns learn 10x slower. Dividing by delta_z scales to ~1-10. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Raw E[Q] ~ 0.1 while h_s2 ~ 1.0 post-ReLU. Without normalization, Q_dir columns learn 10x slower. Dividing by delta_z scales to ~1-10. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>