Files

jgrusewski 2c2b62639e build: per-package CGU + dep dedup — workspace builds ~30% faster

Two complementary changes to reduce clean workspace build time from
~13min to ~8:43:

1. Per-package codegen-units overrides
   Default for all release builds: codegen-units = 16 (parallel LLVM).
   Numerical-sensitive crates (ml-* family, ndarray, nalgebra, cudarc,
   simba, etc.) override back to 1 to preserve bit-exact LLVM
   optimization decisions for the DQN regression suite.
   Non-numerical plumbing (arrow, sqlx, tokio, parquet, ...) compiles
   in parallel via 16 CGUs, no numerical impact.

2. Dependency deduplication
   - axum 0.7 → 0.8 (workspace + services/api): dedupes vs tonic 0.14's
     transitive axum 0.8. Eliminates a full duplicate compile of axum
     and axum-core.
   - statrs 0.17 → 0.18: dedupes nalgebra 0.32 vs 0.33. Also closes a
     numerical concern (two nalgebra versions linked simultaneously).
   - governor 0.6 → 0.10 (services/api + crates/data): dedupes dashmap
     5 vs 6. dashmap is heavy; eliminating one full compile is a real
     win.
   - hashbrown 0.14 → 0.16 (workspace): partial dedupe (dashmap 6.1
     still pulls 0.14 transitively).
   - Workspace Cargo.toml documents residual unfixable duplicates with
     reasons (base64, chacha20, phf, darling, itertools, getrandom,
     hashbrown, syn, thiserror — all blocked by third-party crates we
     can't bump without breakage).

Verified: cargo check --workspace passes.  Numerical crates remain
at codegen-units = 1 — DQN bit-exact reproducibility preserved.

2026-05-01 01:00:52 +02:00

benches

fix(clippy): resolve all clippy warnings across entire workspace (--all-targets)

2026-03-13 10:18:35 +01:00

data

…

src

cleanup: wire storage.base_directory in training_pipeline tests

2026-04-23 08:38:44 +02:00

tests

cleanup: strip stale TODO markers from data integration tests

2026-04-23 08:27:33 +02:00

Cargo.toml

build: per-package CGU + dep dedup — workspace builds ~30% faster

2026-05-01 01:00:52 +02:00

README.md

docs: create/update README.md for all 17 crates

2026-03-01 22:47:39 +01:00

README.md

data

Market data ingestion, broker integration, and feature extraction.

Providers

Databento — historical and real-time market data via DBN format
Benzinga — news and fundamentals feed

Broker Integrations

IB TWS — Interactive Brokers TWS/Gateway socket connection
ICMarkets — FIX 4.4 protocol integration

Key Modules

brokers — broker adapters (IB TWS, ICMarkets FIX)
providers — data provider clients (Databento, Benzinga)
parquet_persistence — Parquet read/write for tick and bar data
replay — market data replay for backtesting
training_pipeline — data preparation for ML model training
features — technical indicator and feature computation
validation — data quality checks and schema validation

Cargo Features

Feature	Default	Description
`databento`	yes	Databento provider support
`benzinga`	yes	Benzinga provider support
`icmarkets`	yes	ICMarkets FIX 4.4 integration
`redis-cache`	no	Redis caching layer
`ib`	no	Interactive Brokers adapter
`mock`	no	Mock providers for testing