jgrusewski adcbd6f0df fix: two-phase vaccine dot+norm reduction (3rd atomicAdd hang on H100) ...

gradient_dot_and_norm kernel used atomicAdd with 1264 blocks to compute
dot(g_train, g_val) and |g_val|² — same H100 L2 contention pattern as
the grad_norm hang. Replaced with two-phase: per-block partials + single-
block finalize (gradient_dot_norm_finalize). Zero atomicAdd.

Also added step-0-only per-phase GPU syncs to catch any remaining hangs
immediately (forward, aux, conditional, Adam, PER — only on step 0).

TODO: Causal intervention runs 14 full cuBLAS forward passes per step.
Should be optimized (batched or reduced frequency).

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

2026-04-06 21:47:25 +02:00

..

backtesting

fix(clippy): resolve all clippy warnings across entire workspace (--all-targets)

2026-03-13 10:18:35 +01:00

common

fix: switch tracing to stderr (unbuffered) — stdbuf has no effect on Rust

2026-04-02 16:29:55 +02:00

config

fix(ci): clippy test-gate uses --lib, fix pre-existing lint errors

2026-03-12 19:10:18 +01:00

ctrader-openapi

fix: tune log levels across workspace — demote noisy warn to debug/trace

2026-03-14 11:35:15 +01:00

data

fix(clippy): resolve all clippy warnings across entire workspace (--all-targets)

2026-03-13 10:18:35 +01:00

database

fix(clippy): resolve all clippy warnings across entire workspace (--all-targets)

2026-03-13 10:18:35 +01:00

market-data

…

ml

fix: two-phase vaccine dot+norm reduction (3rd atomicAdd hang on H100)

2026-04-06 21:47:25 +02:00

ml-asset-selection

fix(clippy): resolve all clippy warnings across entire workspace (--all-targets)

2026-03-13 10:18:35 +01:00

ml-backtesting

fix(clippy): resolve all clippy warnings across entire workspace (--all-targets)

2026-03-13 10:18:35 +01:00

ml-checkpoint

fix(clippy): resolve all clippy warnings across entire workspace (--all-targets)

2026-03-13 10:18:35 +01:00

ml-core

fix: restore explicit buffer_size in GPU profiles (auto-sizing removed)

2026-04-04 01:24:19 +02:00

ml-data

…

ml-data-validation

fix(clippy): resolve all clippy warnings across entire workspace (--all-targets)

2026-03-13 10:18:35 +01:00

ml-dqn

perf: pre-allocate insert + flush scratch buffers (zero cuMemAlloc per step)

2026-04-06 19:38:50 +02:00

ml-ensemble

feat(ensemble): GPU-native ensemble reduce kernel, remove CPU fallbacks

2026-03-29 22:35:37 +02:00

ml-explainability

feat(ensemble): GPU-native ensemble reduce kernel, remove CPU fallbacks

2026-03-29 22:35:37 +02:00

ml-features

fix: test reads threshold from dqn-smoketest.toml — no hardcoded values

2026-03-31 12:37:25 +02:00

ml-hyperopt

refactor: LHS is the correct algorithm for small budgets, not a fallback

2026-03-29 19:18:47 +02:00

ml-labeling

fix(clippy): ml-supervised + ml-core + thin crates — 34 errors fixed

2026-03-19 00:39:03 +01:00

ml-observability

fix(clippy): resolve all clippy warnings across entire workspace (--all-targets)

2026-03-13 10:18:35 +01:00

ml-paper-trading

fix(clippy): resolve all clippy warnings across entire workspace (--all-targets)

2026-03-13 10:18:35 +01:00

ml-ppo

feat: add PPO CUDA kernels and curiosity inference kernel

2026-03-31 00:39:59 +02:00

ml-regime

refactor(cuda): eliminate all CPU fallbacks — CUDA mandatory across ML stack

2026-03-16 21:01:28 +01:00

ml-regime-detection

fix(clippy): resolve all clippy warnings across entire workspace (--all-targets)

2026-03-13 10:18:35 +01:00

ml-risk

fix(clippy): resolve all clippy warnings across entire workspace (--all-targets)

2026-03-13 10:18:35 +01:00

ml-security

fix(clippy): resolve all clippy warnings across entire workspace (--all-targets)

2026-03-13 10:18:35 +01:00

ml-stress-testing

fix(clippy): achieve zero warnings across entire workspace

2026-03-10 13:18:57 +01:00

ml-supervised

feat(bf16): ml-dqn, ml-ppo, ml-supervised, ml-ensemble, ml-explainability compile clean

2026-03-28 01:51:45 +01:00

ml-universe

fix(clippy): resolve all clippy warnings across entire workspace (--all-targets)

2026-03-13 10:18:35 +01:00

ml-validation

fix(clippy): resolve all clippy warnings across entire workspace (--all-targets)

2026-03-13 10:18:35 +01:00

model_loader

fix(clippy): resolve all clippy warnings across entire workspace (--all-targets)

2026-03-13 10:18:35 +01:00

risk

refactor: eliminate candle from entire workspace — tests, examples, Cargo.toml

2026-03-18 00:53:47 +01:00

risk-data

fix: tune log levels across workspace — demote noisy warn to debug/trace

2026-03-14 11:35:15 +01:00

storage

…

trading_engine

fix(ml): BF16/F32 boundary alignment, GPU-resident ops across all ML crates

2026-03-15 11:59:31 +01:00

trading-data

…

training_uploader

feat: implement all 15 fxt CLI commands with real gRPC calls

2026-03-03 22:16:35 +01:00