jgrusewski
b5530b551b
docs(plans): model capacity scale-up — 3-phase implementation plan
Three sequenced architectural capacity additions to push h6000 AUC
from current ~0.72-0.74 cross-fold plateau toward ≥0.78 deployment
target. Each phase independently deployable + measurable.
Phase 1 — Per-horizon specialisation (~1.5hr code):
- LayerNorm between Mamba2 trunk and CfC K-loop (with backward
+ per-row param-grad reduction kernel; no atomicAdd).
- 2-layer GELU MLP heads [hidden=128 → mid=64 → 1] per horizon;
ISV lambda integrates into the trunk-grad component of head
backward. Tasks 1.1-1.8 fully detailed (kernel source +
integration + numerical grad check + smoke + deploy).
Phase 2A — Decision-stride sampling (~1.5hr code):
- User-prioritised lever. Yield every S-th snapshot per training
sequence; K=64 with stride=4 covers 256 ticks of context for
the same compute as 64 ticks at stride=1. Mamba2's dt_s scalar
becomes stride-aware. Tasks 2A.1-2A.5 fully detailed (loader
refactor + test + CLI plumbing + synthetic smoke + deploy).
Phase 2B — 2-stack Mamba2 (~2hr code, sketch):
- Two Mamba2Block instances; forward chain
snap_feat → mamba2_l1 → LN → mamba2_l2 → LN → CfC.
- Acceptance criteria + key implementation notes documented;
bite-sized tasks elaborated when Phase 1+2A results land.
Phase 3 — Attention pool over Mamba2 K-positions (~4-6hr code,
sketch):
- Replace CfC's zero-init initial state with an attention-
pooled context vector over all K Mamba2 outputs. Design
decision documented (Option A: attention sets initial state,
preserving CfC's recurrent path).
Cross-phase deployment loop documented: fold-1 smoke → 3-fold
CV → per-fold comparison + isv-snapshot trajectory archive.
Honors `superpowers:writing-plans` skill: exact file paths,
complete code in every step, exact commands with expected output,
TDD-style steps, frequent commits, no placeholders in Phase 1
tasks. Self-review pass complete.
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
2026-05-17 21:18:49 +02:00
..
2026-03-11 22:00:13 +01:00
2026-03-13 11:51:58 +01:00
2026-03-14 19:41:40 +01:00
2026-03-16 16:11:48 +01:00
2026-03-16 21:01:28 +01:00
2026-03-17 22:27:56 +01:00
2026-03-17 15:13:04 +01:00
2026-03-18 19:36:41 +01:00
2026-03-18 07:26:56 +01:00
2026-03-18 13:31:35 +01:00
2026-03-21 10:26:11 +01:00
2026-03-21 11:23:09 +01:00
2026-03-21 15:33:00 +01:00
2026-03-21 16:29:32 +01:00
2026-03-21 23:22:58 +01:00
2026-03-22 20:35:57 +01:00
2026-03-22 00:39:34 +01:00
2026-03-23 09:03:19 +01:00
2026-03-23 20:42:08 +01:00
2026-03-24 21:48:38 +01:00
2026-03-24 23:57:04 +01:00
2026-03-24 22:00:45 +01:00
2026-03-24 23:57:04 +01:00
2026-03-25 19:43:26 +01:00
2026-03-25 09:01:12 +01:00
2026-03-25 23:58:30 +01:00
2026-03-25 01:49:53 +01:00
2026-03-25 23:02:39 +01:00
2026-03-26 00:43:58 +01:00
2026-03-26 01:06:28 +01:00
2026-03-27 23:39:43 +01:00
2026-03-27 19:52:44 +01:00
2026-03-27 20:42:37 +01:00
2026-03-27 19:52:44 +01:00
2026-03-27 19:52:44 +01:00
2026-03-27 07:56:50 +01:00
2026-03-27 00:47:34 +01:00
2026-03-27 08:16:51 +01:00
2026-03-29 20:23:51 +02:00
2026-03-29 23:24:10 +02:00
2026-03-29 23:32:12 +02:00
2026-03-31 01:35:04 +02:00
2026-03-30 12:38:33 +02:00
2026-04-02 09:06:23 +02:00
2026-03-31 23:35:47 +02:00
2026-03-31 10:56:20 +02:00
2026-04-01 21:41:21 +02:00
2026-04-02 21:26:24 +02:00
2026-04-02 09:06:23 +02:00
2026-04-02 13:49:26 +02:00
2026-04-02 23:29:04 +02:00
2026-04-02 23:29:04 +02:00
2026-04-04 08:56:44 +02:00
2026-04-04 08:56:44 +02:00
2026-04-03 08:46:30 +02:00
2026-04-04 11:49:13 +02:00
2026-04-04 11:12:47 +02:00
2026-04-04 09:36:10 +02:00
2026-04-04 01:02:00 +02:00
2026-04-05 21:45:51 +02:00
2026-04-06 11:15:24 +02:00
2026-04-07 13:58:11 +02:00
2026-04-06 11:15:24 +02:00
2026-04-07 23:14:40 +02:00
2026-04-07 23:14:40 +02:00
2026-04-08 01:26:09 +02:00
2026-04-07 23:14:40 +02:00
2026-04-08 20:05:22 +02:00
2026-04-08 02:25:58 +02:00
2026-04-08 10:03:54 +02:00
2026-04-08 14:12:12 +02:00
2026-04-08 20:05:22 +02:00
2026-04-08 22:23:19 +02:00
2026-04-08 20:26:40 +02:00
2026-04-09 22:05:46 +02:00
2026-04-09 20:04:01 +02:00
2026-04-10 20:36:03 +02:00
2026-04-10 18:52:21 +02:00
2026-04-10 10:33:36 +02:00
2026-04-10 22:23:16 +02:00
2026-04-11 12:27:56 +02:00
2026-04-11 11:28:59 +02:00
2026-04-11 22:40:47 +02:00
2026-04-11 23:10:25 +02:00
2026-04-11 13:35:15 +02:00
2026-04-12 07:58:02 +02:00
2026-04-12 14:33:56 +02:00
2026-04-13 14:56:27 +02:00
2026-04-13 11:32:23 +02:00
2026-04-14 21:42:57 +02:00
2026-04-14 23:26:13 +02:00
2026-04-14 22:30:29 +02:00
2026-04-15 20:33:03 +02:00
2026-04-15 19:43:50 +02:00
2026-04-15 08:40:09 +02:00
2026-04-16 22:46:54 +02:00
2026-04-16 01:32:16 +02:00
2026-04-16 17:34:14 +02:00
2026-04-17 00:02:02 +02:00
2026-04-17 00:48:18 +02:00
2026-04-16 21:49:19 +02:00
2026-04-17 23:58:32 +02:00
2026-04-18 16:07:06 +02:00
2026-04-18 21:26:40 +02:00
2026-04-19 23:47:04 +02:00
2026-04-19 12:15:04 +02:00
2026-04-19 23:21:24 +02:00
2026-04-19 00:06:05 +02:00
2026-04-20 19:12:41 +02:00
2026-04-20 14:36:03 +02:00
2026-04-22 11:18:28 +02:00
2026-04-21 21:06:33 +02:00
2026-04-24 18:29:34 +02:00
2026-04-24 19:04:56 +02:00
2026-04-25 09:15:43 +02:00
2026-04-25 11:53:10 +02:00
2026-04-24 10:06:25 +02:00
2026-04-27 08:10:42 +02:00
2026-04-27 08:10:42 +02:00
2026-04-29 17:26:22 +02:00
2026-04-27 08:10:42 +02:00
2026-04-27 18:22:40 +02:00
2026-04-29 23:21:26 +02:00
2026-04-30 08:49:36 +02:00
2026-05-01 14:07:10 +02:00
2026-05-01 20:01:27 +02:00
2026-05-02 01:47:07 +02:00
2026-05-03 00:35:07 +02:00
2026-05-04 00:40:36 +02:00
2026-05-05 08:27:49 +02:00
2026-05-05 17:36:56 +02:00
2026-05-06 10:32:10 +02:00
2026-05-08 03:01:13 +02:00
2026-05-08 18:56:58 +02:00
2026-05-08 20:57:28 +02:00
2026-05-09 00:25:06 +02:00
2026-05-10 00:30:33 +02:00
2026-05-10 22:19:28 +02:00
2026-05-15 01:13:42 +02:00
2026-05-15 22:08:31 +02:00
2026-05-15 10:42:14 +02:00
2026-05-16 20:48:14 +02:00
2026-05-16 21:51:48 +02:00
2026-05-16 20:48:14 +02:00
2026-05-16 20:48:14 +02:00
2026-05-17 21:18:49 +02:00