Files
foxhunt/docs
jgrusewski f49ae6858e fix: Layer 3 plan — add Q_dir normalization by delta_z
Raw E[Q] ~ 0.1 while h_s2 ~ 1.0 post-ReLU. Without normalization,
Q_dir columns learn 10x slower. Dividing by delta_z scales to ~1-10.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-04-14 22:30:29 +02:00
..