jgrusewski 12d85993cf perf(data): parallelize MBP-10 and trade file loading with rayon ...

Both walk-forward and full-training data loading paths now use rayon
par_iter to parse MBP-10 .dbn files concurrently. Previously 9 files
were parsed sequentially (~4 min on H100); parallel loading gives
~7-9x speedup proportional to file count. Trade file loading also
parallelized. Removed dead collect_dbn_files helper (superseded by
collect_dbn_files_recursive at module scope).

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

2026-03-12 21:52:45 +01:00

..

backtesting

fix(tests): update stale 51-dim feature assertions to match 42-dim extractor

2026-03-12 20:06:17 +01:00

common

Merge branch 'worktree-branching-dqn-plan'

2026-03-11 08:46:58 +01:00

config

fix(ci): clippy test-gate uses --lib, fix pre-existing lint errors

2026-03-12 19:10:18 +01:00

ctrader-openapi

fix(ci): clippy test-gate uses --lib, fix pre-existing lint errors

2026-03-12 19:10:18 +01:00

data

fix(ml): streaming parallel OFI + fix hardcoded state_dim=54 in backtest

2026-03-07 23:28:18 +01:00

database

docs: create/update README.md for all 17 crates

2026-03-01 22:47:39 +01:00

market-data

docs: create/update README.md for all 17 crates

2026-03-01 22:47:39 +01:00

ml

perf(data): parallelize MBP-10 and trade file loading with rayon

2026-03-12 21:52:45 +01:00

ml-asset-selection

fix(clippy): apply cargo clippy --fix across workspace

2026-03-10 11:17:51 +01:00

ml-backtesting

fix(clippy): achieve zero warnings across entire workspace

2026-03-10 13:18:57 +01:00

ml-checkpoint

fix(clippy): achieve zero warnings across entire workspace

2026-03-10 13:18:57 +01:00

ml-core

fix(ci): remove cuda from all 8 ML sub-crate default features

2026-03-12 20:24:07 +01:00

ml-data

docs: create/update README.md for all 17 crates

2026-03-01 22:47:39 +01:00

ml-data-validation

fix(clippy): achieve zero warnings across entire workspace

2026-03-10 13:18:57 +01:00

ml-dqn

fix(ci): remove cuda from all 8 ML sub-crate default features

2026-03-12 20:24:07 +01:00

ml-ensemble

fix(ci): remove cuda from all 8 ML sub-crate default features

2026-03-12 20:24:07 +01:00

ml-explainability

fix(ci): remove cuda from all 8 ML sub-crate default features

2026-03-12 20:24:07 +01:00

ml-features

perf(ofi): replace O(n) linear scan with binary search in get_snapshots_for_timestamp

2026-03-12 20:54:44 +01:00

ml-hyperopt

fix(ci): remove cuda from all 8 ML sub-crate default features

2026-03-12 20:24:07 +01:00

ml-labeling

fix(ci): remove cuda from all 8 ML sub-crate default features

2026-03-12 20:24:07 +01:00

ml-observability

fix(clippy): add doc backticks and const fn across ML crates

2026-03-10 11:51:31 +01:00

ml-paper-trading

refactor(ml): extract regime-detection, explainability, paper-trading

2026-03-08 15:17:22 +01:00

ml-ppo

fix(ci): remove cuda from all 8 ML sub-crate default features

2026-03-12 20:24:07 +01:00

ml-regime

fix(clippy): resolve misc warnings across ML crates

2026-03-10 12:12:14 +01:00

ml-regime-detection

fix(clippy): achieve zero warnings across entire workspace

2026-03-10 13:18:57 +01:00

ml-risk

refactor(ml): split monolith into 9 sub-crates + delete dead code

2026-03-08 15:17:22 +01:00

ml-security

fix(clippy): apply cargo clippy --fix across workspace

2026-03-10 11:17:51 +01:00

ml-stress-testing

fix(clippy): achieve zero warnings across entire workspace

2026-03-10 13:18:57 +01:00

ml-supervised

fix(ci): remove cuda from all 8 ML sub-crate default features

2026-03-12 20:24:07 +01:00

ml-universe

fix(clippy): achieve zero warnings across entire workspace

2026-03-10 13:18:57 +01:00

ml-validation

fix(clippy): achieve zero warnings across entire workspace

2026-03-10 13:18:57 +01:00

model_loader

docs: create/update README.md for all 17 crates

2026-03-01 22:47:39 +01:00

risk

refactor: remove trading_engine dep from ml and risk crates

2026-03-05 23:19:38 +01:00

risk-data

docs: create/update README.md for all 17 crates

2026-03-01 22:47:39 +01:00

storage

docs: create/update README.md for all 17 crates

2026-03-01 22:47:39 +01:00

trading_engine

refactor: replace all api_gateway/web-gateway references across codebase

2026-03-05 00:18:58 +01:00

trading-data

docs: create/update README.md for all 17 crates

2026-03-01 22:47:39 +01:00

training_uploader

feat: implement all 15 fxt CLI commands with real gRPC calls

2026-03-03 22:16:35 +01:00