e61e8f54da
Changes: - CLAUDE.md: Update OOM fix validation status - Add comprehensive documentation (30+ markdown reports) - LSTM encoder varmap bug fix (tft/lstm_encoder.rs:290) - Quantized LSTM layer matching fix (tft/quantized_lstm.rs) - Hyperopt paths module (ml/src/hyperopt/paths.rs) - Training path tests for all adapters (DQN, MAMBA-2, PPO, TFT) - Checkpoint integrity tests - Script cleanup: Remove 29 obsolete deployment scripts - Archive old scripts to scripts/archive/ - New deployment utilities: check_gpu_availability.py, monitor_hyperopt.sh Validation: - OOM fixes validated: 5/5 trials successful (pod b6kc3mc5lbjiro) - Batch-size-max 256 tested successfully - All hyperopt adapters working correctly 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com>
30 lines
842 B
Bash
Executable File
30 lines
842 B
Bash
Executable File
#!/bin/bash
|
|
# Bypass volume cache - download binary directly from S3
|
|
|
|
set -e
|
|
|
|
echo "================================================"
|
|
echo "Bypassing Volume Cache - Downloading from S3"
|
|
echo "================================================"
|
|
|
|
# Download fresh binary from S3
|
|
aws s3 cp s3://se3zdnb5o4/binaries/current/hyperopt_mamba2_demo /tmp/demo \
|
|
--endpoint-url https://s3api-eur-is-1.runpod.io
|
|
|
|
# Make executable
|
|
chmod +x /tmp/demo
|
|
|
|
# Verify it has correct arguments
|
|
echo "Verifying binary..."
|
|
/tmp/demo --help | grep -q "base-dir" && echo "✅ Binary verified" || (echo "❌ Wrong binary!" && exit 1)
|
|
|
|
# Execute training
|
|
echo "Starting training..."
|
|
/tmp/demo \
|
|
--parquet-file /runpod-volume/test_data/ES_FUT_180d.parquet \
|
|
--base-dir /runpod-volume/ml_training \
|
|
--trials 2 \
|
|
--epochs 1 \
|
|
--batch-size-max 256 \
|
|
--seed 42
|