- Docker: Delete 23 deprecated Dockerfiles, fix CI/CD to use Dockerfile.foxhunt-build - Config: Remove 36 .env files, keep 4 essential, delete config/environments/ - Docs: Archive 614 Wave D files to docs/archive/wave_d/, 95% reduction in root - Scripts: Delete 56 deprecated scripts, keep 58 production-critical (49% reduction) - Python: Organize 37 scripts into scripts/python/ subdirectories, delete ml/python/ - Build: Remove 1GB artifacts, delete old venvs, clean Python cache from git - Migrations: Delete deprecated directory (4,432 lines), remove duplicate database/migrations/ - Infrastructure: Delete deployment/ (61 files), docs/scripts/ (8 files) Total impact: ~2,500 files cleaned, 750MB+ space freed, zero production impact All deleted scripts backed up to archives. runpod/ and tests/runpod/ preserved. data_acquisition_service retained per user request.
87 lines
3.3 KiB
Plaintext
87 lines
3.3 KiB
Plaintext
# =============================================================================
|
|
# RUNPOD S3 CONFIGURATION TEMPLATE
|
|
# =============================================================================
|
|
# Copy this file to .env.runpod and fill in your Runpod credentials
|
|
#
|
|
# How to get credentials:
|
|
# 1. S3_ENDPOINT: Datacenter-specific endpoint
|
|
# - US-CA-1: https://s3api-us-ca-1.runpod.io
|
|
# - EU-RO-1: https://s3api-eu-ro-1.runpod.io
|
|
# - Find yours: https://docs.runpod.io/storage/s3-api#endpoint-urls
|
|
#
|
|
# 2. S3_BUCKET: Your Network Volume ID
|
|
# - Go to: https://www.runpod.io/console/storage
|
|
# - Click on your Network Volume
|
|
# - Copy the Volume ID (e.g., abc123xyz456)
|
|
#
|
|
# 3. AWS_ACCESS_KEY_ID: Your Runpod User ID
|
|
# - Go to: https://www.runpod.io/console/settings
|
|
# - Copy your User ID (shown at top of page)
|
|
#
|
|
# 4. AWS_SECRET_ACCESS_KEY: Your Runpod API Key
|
|
# - Go to: https://www.runpod.io/console/settings
|
|
# - Click "API Keys" tab
|
|
# - Create new API key with "Read/Write" permissions
|
|
# - Copy the secret key (only shown once!)
|
|
# =============================================================================
|
|
|
|
# Runpod S3 Endpoint (datacenter-specific)
|
|
# Examples:
|
|
# US-CA-1: https://s3api-us-ca-1.runpod.io
|
|
# EU-RO-1: https://s3api-eu-ro-1.runpod.io
|
|
S3_ENDPOINT=https://s3api-DATACENTER.runpod.io
|
|
|
|
# Network Volume ID (acts as S3 bucket name)
|
|
# Find this in: https://www.runpod.io/console/storage
|
|
S3_BUCKET=your-network-volume-id
|
|
|
|
# Runpod User ID (acts as AWS_ACCESS_KEY_ID)
|
|
# Find this in: https://www.runpod.io/console/settings
|
|
AWS_ACCESS_KEY_ID=your-runpod-user-id
|
|
|
|
# Runpod API Key (acts as AWS_SECRET_ACCESS_KEY)
|
|
# Create this in: https://www.runpod.io/console/settings -> API Keys
|
|
AWS_SECRET_ACCESS_KEY=your-runpod-api-key
|
|
|
|
# AWS Region (default: us-east-1)
|
|
# This is used by AWS CLI but Runpod doesn't enforce specific regions
|
|
AWS_REGION=us-east-1
|
|
|
|
# =============================================================================
|
|
# TRAINING CONFIGURATION (for Docker deployment)
|
|
# =============================================================================
|
|
|
|
# Binary to execute (downloaded from s3://${S3_BUCKET}/binaries/)
|
|
BINARY_NAME=train_tft_parquet
|
|
|
|
# Data file to download (optional - can mount as volume instead)
|
|
# Downloaded from s3://${S3_BUCKET}/data/
|
|
DATA_NAME=ES_FUT_180d.parquet
|
|
|
|
# Training arguments (passed to binary)
|
|
# Override these in Runpod container settings or docker run command
|
|
TRAINING_ARGS=--epochs 50 --batch-size 32 --lookback-window 60 --forecast-horizon 10
|
|
|
|
# =============================================================================
|
|
# USAGE INSTRUCTIONS
|
|
# =============================================================================
|
|
#
|
|
# 1. Copy this file:
|
|
# cp .env.runpod.template .env.runpod
|
|
#
|
|
# 2. Fill in your credentials (see instructions above)
|
|
#
|
|
# 3. Upload binaries and data to Runpod S3:
|
|
# ./upload_to_runpod_s3.sh
|
|
#
|
|
# 4. Build and push Docker image:
|
|
# docker build -f Dockerfile.runpod.s3 -t yourusername/foxhunt-runpod-s3:latest .
|
|
# docker push yourusername/foxhunt-runpod-s3:latest
|
|
#
|
|
# 5. Deploy on Runpod:
|
|
# - Use Docker image: yourusername/foxhunt-runpod-s3:latest
|
|
# - Set environment variables from this file
|
|
# - GPU: RTX 4090 or similar (24GB VRAM recommended)
|
|
#
|
|
# =============================================================================
|