jgrusewski e3f32742fa feat(ml): walk-forward training pipeline with real Databento data ...

Fix zstd decoder in train_baseline.rs and evaluate_baseline.rs (same
pattern as hyperopt adapters — branch on .dbn.zst extension). Add CLI
flags for walk-forward config (train/val/test/step months), learning
rate, and max-steps-per-epoch to make pipeline validation feasible.

Pipeline validated end-to-end: hyperopt (5 trials, best Sharpe 2.37) →
walk-forward training (4 folds, 6/1/1 month windows on ES.FUT) →
evaluation (4 fold test sets, checkpoints + norm stats saved).

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

2026-02-23 21:48:10 +01:00

..

ab_test_demonstration.rs

…

adaptive_ml_backtest.rs

…

analyze_dqn_checkpoints.rs

…

backtest_dqn_replay.rs

Wave 15: Complete FactoredAction migration + production monitoring

2025-11-11 23:48:02 +01:00

backtest_dqn.rs

refactor(ml): consolidate 13 duplicate OHLCVBar definitions into single canonical type

2026-02-20 18:14:42 +01:00

backtest_ensemble.rs

…

benchmark_cuda_speedup.rs

feat(ppo): gradient accumulation, clip-higher, and WorkingPPO→PPO rename

2026-02-21 01:00:54 +01:00

benchmark_future_decoder.rs

feat: Wave 2 - Update MEDIUM RISK files (225→54 features)

2025-11-23 00:57:17 +01:00

benchmark_ppo_optimization.rs

feat: Wave 2 - Update MEDIUM RISK files (225→54 features)

2025-11-23 00:57:17 +01:00

benchmark_streaming_vs_batch.rs

…

benchmark_weight_caching.rs

feat: Wave 2 - Update MEDIUM RISK files (225→54 features)

2025-11-23 00:57:17 +01:00

cache_dqn_features.rs

feat: WAVE 23 Complete - Early Stopping + Feature Caching (99% speedup)

2025-11-24 10:03:15 +01:00

check_feature_count.rs

feat: Wave 2 - Update MEDIUM RISK files (225→54 features)

2025-11-23 00:57:17 +01:00

check_performance_regression.rs

…

check_tft_weight_init.rs

feat(ml): MAMBA-2 P0 fixes + hyperparameter optimization (13 params)

2025-10-28 14:11:18 +01:00

comprehensive_model_backtest.rs

…

convert_6e_dbn_to_parquet.rs

Wave 15: Complete FactoredAction migration + production monitoring

2025-11-11 23:48:02 +01:00

convert_6e_parquet_simple.rs

Wave 15: Complete FactoredAction migration + production monitoring

2025-11-11 23:48:02 +01:00

create_small_parquet_files.rs

Wave 15: Complete FactoredAction migration + production monitoring

2025-11-11 23:48:02 +01:00

cross_validation_backtest.rs

…

cuda_test.rs

…

diagnose_factored_network.rs

Wave 15: Complete FactoredAction migration + production monitoring

2025-11-11 23:48:02 +01:00

diagnose_q_value_diversity.rs

Wave 15: Complete FactoredAction migration + production monitoring

2025-11-11 23:48:02 +01:00

download_baseline.rs

fix(ml): add stype_in=Parent for Databento .FUT symbol downloads

2026-02-23 20:02:38 +01:00

download_l2_data.rs

…

download_l2_test.rs

…

download_training_data.rs

…

ensemble_uncertainty_demo.rs

Wave 15: Complete FactoredAction migration + production monitoring

2025-11-11 23:48:02 +01:00

ensemble_visualization.rs

…

evaluate_baseline.rs

feat(ml): walk-forward training pipeline with real Databento data

2026-02-23 21:48:10 +01:00

evaluate_dqn_component5_usage_example.rs

Wave 15: Complete FactoredAction migration + production monitoring

2025-11-11 23:48:02 +01:00

evaluate_dqn_component5.rs

Wave 15: Complete FactoredAction migration + production monitoring

2025-11-11 23:48:02 +01:00

evaluate_dqn_load_function.rs

refactor: consolidate DQNConfig to single canonical definition

2026-02-22 20:49:22 +01:00

evaluate_dqn_main_orchestrator.rs

feat: Wave 2 - Update MEDIUM RISK files (225→54 features)

2025-11-23 00:57:17 +01:00

evaluate_dqn.rs

feat: Wave 2 - Update MEDIUM RISK files (225→54 features)

2025-11-23 00:57:17 +01:00

evaluate_ppo.rs

feat(ppo): gradient accumulation, clip-higher, and WorkingPPO→PPO rename

2026-02-21 01:00:54 +01:00

evaluate_production_checkpoint.rs

refactor(ml): consolidate 13 duplicate OHLCVBar definitions into single canonical type

2026-02-20 18:14:42 +01:00

feature_importance_analysis.rs

refactor(ml): consolidate 13 duplicate OHLCVBar definitions into single canonical type

2026-02-20 18:14:42 +01:00

generate_backtest_report.rs

Wave 15: Complete FactoredAction migration + production monitoring

2025-11-11 23:48:02 +01:00

generate_calibration_dataset.rs

…

gpu_memory_benchmark.rs

…

gpu_memory_monitor.rs

…

gpu_training_benchmark.rs

feat: Wave 2 - Update MEDIUM RISK files (225→54 features)

2025-11-23 00:57:17 +01:00

hyperopt_baseline.rs

feat(ml): add hyperopt runner for DQN/PPO on real market data

2026-02-23 18:51:51 +01:00

hyperopt_continuous_ppo_demo.rs

Wave 11: Rainbow DQN integration + 23/23 tests passing

2025-11-18 13:53:59 +01:00

hyperopt_dqn_demo.rs

feat: WAVE 23 Complete - Early Stopping + Feature Caching (99% speedup)

2025-11-24 10:03:15 +01:00

hyperopt_early_stopping_demo.rs

Wave 15: Complete FactoredAction migration + production monitoring

2025-11-11 23:48:02 +01:00

hyperopt_mamba2_demo.rs

Wave 15: Complete FactoredAction migration + production monitoring

2025-11-11 23:48:02 +01:00

hyperopt_ppo_demo.rs

Wave 15: Complete FactoredAction migration + production monitoring

2025-11-11 23:48:02 +01:00

hyperopt_tft_demo.rs

feat: Wave 2 - Update MEDIUM RISK files (225→54 features)

2025-11-23 00:57:17 +01:00

inference_benchmark.rs

…

inspect_dbn_raw.rs

Wave 16S-V11: Bug #8 fix + P2-A/B implementation

2025-11-12 23:05:51 +01:00

inspect_safetensors.rs

Wave 15: Complete FactoredAction migration + production monitoring

2025-11-11 23:48:02 +01:00

load_parquet_data_function.rs

feat: Wave 2 - Update MEDIUM RISK files (225→54 features)

2025-11-23 00:57:17 +01:00

MAMBA2_DBN_INTEGRATION.md

…

measure_dqn_memory.rs

feat: Wave 2 - Update MEDIUM RISK files (225→54 features)

2025-11-23 00:57:17 +01:00

model_diversity_analysis.rs

…

model_registry_api.rs

feat(ml): MAMBA-2 P0 fixes + hyperparameter optimization (13 params)

2025-10-28 14:11:18 +01:00

ofi_features_demo.rs

feat: Wave 1 - Update HIGH RISK files (225→54 features)

2025-11-23 00:41:22 +01:00

optimize_all_models.rs

Wave 15: Complete FactoredAction migration + production monitoring

2025-11-11 23:48:02 +01:00

optimize_barriers.rs

…

optimize_batch_sizes.rs

…

optimize_ensemble_weights.rs

…

optimize_mamba2_egobox.rs

Wave 15: Complete FactoredAction migration + production monitoring

2025-11-11 23:48:02 +01:00

optimize_mamba2_standalone.rs

Wave 15: Complete FactoredAction migration + production monitoring

2025-11-11 23:48:02 +01:00

ppo_separate_lr_demo.rs

Wave 15: Complete FactoredAction migration + production monitoring

2025-11-11 23:48:02 +01:00

profile_model_memory.rs

feat(ppo): gradient accumulation, clip-higher, and WorkingPPO→PPO rename

2026-02-21 01:00:54 +01:00

profile_tft_int8_memory.rs

feat: Wave 2 - Update MEDIUM RISK files (225→54 features)

2025-11-23 00:57:17 +01:00

profile_training_memory_180d.rs

Wave 15: Complete FactoredAction migration + production monitoring

2025-11-11 23:48:02 +01:00

quantize_tft_varmap.rs

Wave 15: Complete FactoredAction migration + production monitoring

2025-11-11 23:48:02 +01:00

quantized_checkpoint_demo.rs

feat: Wave 2 - Update MEDIUM RISK files (225→54 features)

2025-11-23 00:57:17 +01:00

quick_checkpoint_analysis.rs

…

quick_performance_benchmark.rs

…

README_MAMBA2_PARQUET.md

feat(wave1-2): Complete multi-model training architecture + TLI commands

2025-10-22 20:50:43 +02:00

real_time_inference_benchmark.rs

feat(ppo): gradient accumulation, clip-higher, and WorkingPPO→PPO rename

2026-02-21 01:00:54 +01:00

register_trained_models.rs

…

retrain_all_models.rs

feat(ml): wire PPO/TFT/Mamba2 training in retrain_all_models

2026-02-21 19:28:57 +01:00

simple_dqn_eval.rs

refactor(ml): consolidate 13 duplicate OHLCVBar definitions into single canonical type

2026-02-20 18:14:42 +01:00

six_model_ensemble.rs

…

stress_test_dqn.rs

feat: Wave 16 - Complete DQN advanced risk management integration

2025-11-13 19:14:20 +01:00

test_adamw_optimizer.rs

Wave 15: Complete FactoredAction migration + production monitoring

2025-11-11 23:48:02 +01:00

test_adaptive_regime_detection.rs

…

test_cuda_basic.rs

feat: Wave 2 - Update MEDIUM RISK files (225→54 features)

2025-11-23 00:57:17 +01:00

test_dbn_loading.rs

…

test_dbn_prices.rs

…

test_dqn_init.rs

feat: Wave 2 - Update MEDIUM RISK files (225→54 features)

2025-11-23 00:57:17 +01:00

test_ensemble.rs

…

test_factored_q_values.rs

Wave 15: Complete FactoredAction migration + production monitoring

2025-11-11 23:48:02 +01:00

test_future_decoder.rs

feat: Wave 2 - Update MEDIUM RISK files (225→54 features)

2025-11-23 00:57:17 +01:00

test_gpu_hardware.rs

…

test_gradient_checkpointing.rs

feat: Wave 2 - Update MEDIUM RISK files (225→54 features)

2025-11-23 00:57:17 +01:00

test_lstm_ppo.rs

feat(ppo): gradient accumulation, clip-higher, and WorkingPPO→PPO rename

2026-02-21 01:00:54 +01:00

test_memory_optimization.rs

…

test_new_factored_network.rs

Wave 15: Complete FactoredAction migration + production monitoring

2025-11-11 23:48:02 +01:00

test_parquet_schema.rs

feat(wave12): Complete ML warning fixes and add Parquet training infrastructure

2025-10-21 08:54:26 +02:00

test_polyak_averaging.rs

Wave 15: Complete FactoredAction migration + production monitoring

2025-11-11 23:48:02 +01:00

test_ppo_fix.rs

Wave 15: Complete FactoredAction migration + production monitoring

2025-11-11 23:48:02 +01:00

test_symmetric_quantization.rs

Wave 15: Complete FactoredAction migration + production monitoring

2025-11-11 23:48:02 +01:00

test_tft_fp32_varmap.rs

feat: Wave 2 - Update MEDIUM RISK files (225→54 features)

2025-11-23 00:57:17 +01:00

tft_int8_calibration_simple.rs

…

tft_int8_calibration.rs

…

train_baseline.rs

feat(ml): walk-forward training pipeline with real Databento data

2026-02-23 21:48:10 +01:00

train_continuous_ppo_parquet.rs

fix(ml): fix PPO flow policy shape dimensions and clean up tests

2026-02-20 23:52:12 +01:00

train_dqn_es_fut.rs

feat(hyperopt): Complete DQN hyperopt analysis and PSO optimizer fix

2025-11-02 21:49:07 +01:00

train_dqn_production.rs

feat(ml): add inference demo to train_dqn_production example

2026-02-20 21:32:58 +01:00

train_dqn.rs

fix(ml): fix PPO flow policy shape dimensions and clean up tests

2026-02-20 23:52:12 +01:00

train_liquid_dbn.rs

…

train_mamba2_dbn.rs

feat: Wave 2 - Update MEDIUM RISK files (225→54 features)

2025-11-23 00:57:17 +01:00

train_mamba2_parquet.rs

feat: Wave 2 - Update MEDIUM RISK files (225→54 features)

2025-11-23 00:57:17 +01:00

train_mamba2.rs

Wave 15: Complete FactoredAction migration + production monitoring

2025-11-11 23:48:02 +01:00

train_ppo_es_fut.rs

feat(hyperopt): Complete DQN hyperopt analysis and PSO optimizer fix

2025-11-02 21:49:07 +01:00

train_ppo_extended.rs

feat: Wave 2 - Update MEDIUM RISK files (225→54 features)

2025-11-23 00:57:17 +01:00

train_ppo_parquet.rs

fix(ml): fix PPO flow policy shape dimensions and clean up tests

2026-02-20 23:52:12 +01:00

train_ppo.rs

feat: Wave 2 - Update MEDIUM RISK files (225→54 features)

2025-11-23 00:57:17 +01:00

train_rainbow.rs

feat: Wave 2 - Update MEDIUM RISK files (225→54 features)

2025-11-23 00:57:17 +01:00

train_tft_dbn.rs

feat: Wave 2 - Update MEDIUM RISK files (225→54 features)

2025-11-23 00:57:17 +01:00

train_tft_parquet.rs

feat: Wave 2 - Update MEDIUM RISK files (225→54 features)

2025-11-23 00:57:17 +01:00

train_tft_qat.rs

feat: Wave 2 - Update MEDIUM RISK files (225→54 features)

2025-11-23 00:57:17 +01:00

train_tft.rs

feat: Wave 2 - Update MEDIUM RISK files (225→54 features)

2025-11-23 00:57:17 +01:00

train_tlob.rs

…

tune_hyperparameters.rs

fix(dqn): Integrate Bug #1-3 fixes from Wave B agents - Production ready

2025-11-04 23:54:18 +01:00

validate_54_features.rs

feat: Wave 8 - Integrate MBP-10 OFI features into DQN trainer

2025-11-23 14:24:50 +01:00

validate_225_features_databento.rs

feat: Wave 2 - Update MEDIUM RISK files (225→54 features)

2025-11-23 00:57:17 +01:00

validate_225_features_runtime.rs

feat: Wave 2 - Update MEDIUM RISK files (225→54 features)

2025-11-23 00:57:17 +01:00

validate_checkpoints.rs

…

validate_databento_files.rs

Wave 15: Complete FactoredAction migration + production monitoring

2025-11-11 23:48:02 +01:00

validate_dqn_225_features.rs

feat: Wave 2 - Update MEDIUM RISK files (225→54 features)

2025-11-23 00:57:17 +01:00

validate_dqn_225_simple.rs

feat: Wave 2 - Update MEDIUM RISK files (225→54 features)

2025-11-23 00:57:17 +01:00

validate_dqn_hyperopt_fixes.rs

Wave 15: Complete FactoredAction migration + production monitoring

2025-11-11 23:48:02 +01:00

validate_dqn_real_training.rs

Wave 15: Complete FactoredAction migration + production monitoring

2025-11-11 23:48:02 +01:00

validate_dqn_simple.rs

Wave 15: Complete FactoredAction migration + production monitoring

2025-11-11 23:48:02 +01:00

validate_features_1_50.rs

…

validate_features_151_200.rs

…

validate_per_channel_quantization.rs

Wave 15: Complete FactoredAction migration + production monitoring

2025-11-11 23:48:02 +01:00

validate_ppo_checkpoints.rs

feat(ppo): gradient accumulation, clip-higher, and WorkingPPO→PPO rename

2026-02-21 01:00:54 +01:00

validate_quantile_loss.rs

…

validate_regime_features.rs

feat: Wave 2 - Update MEDIUM RISK files (225→54 features)

2025-11-23 00:57:17 +01:00

validate_tft_hyperopt.rs

feat: Wave 2 - Update MEDIUM RISK files (225→54 features)

2025-11-23 00:57:17 +01:00

validate_tft_int8_accuracy.rs

feat: Wave 2 - Update MEDIUM RISK files (225→54 features)

2025-11-23 00:57:17 +01:00

validate_wave_c_features_51_150.rs

…

verify_225_feature_values.rs

feat: Wave 2 - Update MEDIUM RISK files (225→54 features)

2025-11-23 00:57:17 +01:00

verify_225_features_wave9.rs

feat: Wave 2 - Update MEDIUM RISK files (225→54 features)

2025-11-23 00:57:17 +01:00

verify_action_mapping.rs

Wave 15: Complete FactoredAction migration + production monitoring

2025-11-11 23:48:02 +01:00

verify_dbn_loader_zero_free.rs

feat: Wave 2 - Update MEDIUM RISK files (225→54 features)

2025-11-23 00:57:17 +01:00

verify_feature_dims.rs

…

verify_grn_weight_init.rs

…

verify_mamba2_dimensions.rs

feat: Wave 2 - Update MEDIUM RISK files (225→54 features)

2025-11-23 00:57:17 +01:00

wave_c_backtest.rs

feat: Wave 2 - Update MEDIUM RISK files (225→54 features)

2025-11-23 00:57:17 +01:00

wave_comparison_full_features.rs

feat: Wave 2 - Update MEDIUM RISK files (225→54 features)

2025-11-23 00:57:17 +01:00

wave_comparison_simple.rs

feat: Wave 2 - Update MEDIUM RISK files (225→54 features)

2025-11-23 00:57:17 +01:00

wave_d_backtest.rs

feat: Wave 2 - Update MEDIUM RISK files (225→54 features)

2025-11-23 00:57:17 +01:00