jgrusewski 9f5b7b58d4 perf: eliminate 86ms/step PER double-sample + guard overhead ...

Three performance optimizations targeting the 15.6s/epoch training:

1. Single write lock for sample+step (was: read lock → sample → release
   → write lock → step → release = 43ms lock contention per step)
2. Vaccine batch sampled only when needed (every 10th step, not every
   step — saves 43ms on 90% of steps)
3. Training guard runs every 5th step instead of every step (12ms/step
   → 2.4ms/step amortized). NaN/loss checks persist across steps.
4. Causal intervention interval 10→50 (14 forward passes less often)
5. Removed all remaining H100_DIAG tracing::info in training_loop

Expected impact: ~86ms → ~43ms sample, ~12ms → ~2.4ms guard = ~52ms/step
savings = ~3.6s/epoch → target ~12s/epoch.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

2026-04-06 22:37:47 +02:00

..

backtesting

fix(clippy): resolve all clippy warnings across entire workspace (--all-targets)

2026-03-13 10:18:35 +01:00

common

fix: switch tracing to stderr (unbuffered) — stdbuf has no effect on Rust

2026-04-02 16:29:55 +02:00

config

fix(ci): clippy test-gate uses --lib, fix pre-existing lint errors

2026-03-12 19:10:18 +01:00

ctrader-openapi

fix: tune log levels across workspace — demote noisy warn to debug/trace

2026-03-14 11:35:15 +01:00

data

fix(clippy): resolve all clippy warnings across entire workspace (--all-targets)

2026-03-13 10:18:35 +01:00

database

fix(clippy): resolve all clippy warnings across entire workspace (--all-targets)

2026-03-13 10:18:35 +01:00

market-data

docs: create/update README.md for all 17 crates

2026-03-01 22:47:39 +01:00

ml

perf: eliminate 86ms/step PER double-sample + guard overhead

2026-04-06 22:37:47 +02:00

ml-asset-selection

fix(clippy): resolve all clippy warnings across entire workspace (--all-targets)

2026-03-13 10:18:35 +01:00

ml-backtesting

fix(clippy): resolve all clippy warnings across entire workspace (--all-targets)

2026-03-13 10:18:35 +01:00

ml-checkpoint

fix(clippy): resolve all clippy warnings across entire workspace (--all-targets)

2026-03-13 10:18:35 +01:00

ml-core

fix: restore explicit buffer_size in GPU profiles (auto-sizing removed)

2026-04-04 01:24:19 +02:00

ml-data

docs: create/update README.md for all 17 crates

2026-03-01 22:47:39 +01:00

ml-data-validation

fix(clippy): resolve all clippy warnings across entire workspace (--all-targets)

2026-03-13 10:18:35 +01:00

ml-dqn

perf: pre-allocate insert + flush scratch buffers (zero cuMemAlloc per step)

2026-04-06 19:38:50 +02:00

ml-ensemble

feat(ensemble): GPU-native ensemble reduce kernel, remove CPU fallbacks

2026-03-29 22:35:37 +02:00

ml-explainability

feat(ensemble): GPU-native ensemble reduce kernel, remove CPU fallbacks

2026-03-29 22:35:37 +02:00

ml-features

fix: test reads threshold from dqn-smoketest.toml — no hardcoded values

2026-03-31 12:37:25 +02:00

ml-hyperopt

refactor: LHS is the correct algorithm for small budgets, not a fallback

2026-03-29 19:18:47 +02:00

ml-labeling

fix(clippy): ml-supervised + ml-core + thin crates — 34 errors fixed

2026-03-19 00:39:03 +01:00

ml-observability

fix(clippy): resolve all clippy warnings across entire workspace (--all-targets)

2026-03-13 10:18:35 +01:00

ml-paper-trading

fix(clippy): resolve all clippy warnings across entire workspace (--all-targets)

2026-03-13 10:18:35 +01:00

ml-ppo

feat: add PPO CUDA kernels and curiosity inference kernel

2026-03-31 00:39:59 +02:00

ml-regime

refactor(cuda): eliminate all CPU fallbacks — CUDA mandatory across ML stack

2026-03-16 21:01:28 +01:00

ml-regime-detection

fix(clippy): resolve all clippy warnings across entire workspace (--all-targets)

2026-03-13 10:18:35 +01:00

ml-risk

fix(clippy): resolve all clippy warnings across entire workspace (--all-targets)

2026-03-13 10:18:35 +01:00

ml-security

fix(clippy): resolve all clippy warnings across entire workspace (--all-targets)

2026-03-13 10:18:35 +01:00

ml-stress-testing

fix(clippy): achieve zero warnings across entire workspace

2026-03-10 13:18:57 +01:00

ml-supervised

feat(bf16): ml-dqn, ml-ppo, ml-supervised, ml-ensemble, ml-explainability compile clean

2026-03-28 01:51:45 +01:00

ml-universe

fix(clippy): resolve all clippy warnings across entire workspace (--all-targets)

2026-03-13 10:18:35 +01:00

ml-validation

fix(clippy): resolve all clippy warnings across entire workspace (--all-targets)

2026-03-13 10:18:35 +01:00

model_loader

fix(clippy): resolve all clippy warnings across entire workspace (--all-targets)

2026-03-13 10:18:35 +01:00

risk

refactor: eliminate candle from entire workspace — tests, examples, Cargo.toml

2026-03-18 00:53:47 +01:00

risk-data

fix: tune log levels across workspace — demote noisy warn to debug/trace

2026-03-14 11:35:15 +01:00

storage

docs: create/update README.md for all 17 crates

2026-03-01 22:47:39 +01:00

trading_engine

fix(ml): BF16/F32 boundary alignment, GPU-resident ops across all ML crates

2026-03-15 11:59:31 +01:00

trading-data

docs: create/update README.md for all 17 crates

2026-03-01 22:47:39 +01:00

training_uploader

feat: implement all 15 fxt CLI commands with real gRPC calls

2026-03-03 22:16:35 +01:00