jgrusewski
55821af90d
fix: argo-precompute.sh uses train workflow + regenerated v2 fxcache
...
Script rewritten to use argo submit --from=wftmpl/train with
train-epochs=0 — runs ensure-binary + ensure-fxcache only.
Local test fxcache regenerated with FXCACHE_VERSION=2, OFI_DIM=20.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
2026-04-17 01:29:42 +02:00
jgrusewski
242c18f4ab
feat: argo-precompute.sh — regenerate fxcache on PVC
...
Usage: ./scripts/argo-precompute.sh [--branch main] [--watch]
Deletes old fxcache, builds precompute binary, runs with MBP-10 +
trades data. OFI_DIM=20 (20 microstructure features). ~5-10 min.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
2026-04-17 01:14:46 +02:00
jgrusewski
445c2197f2
feat: unified Argo train workflow — replace 7 templates with 1
...
New: train-template.yaml with smart caching:
- ensure-binary: checks /data/bin/{sha}/ on PVC, compiles only on cache miss
- ensure-fxcache: runs precompute only if cache doesn't exist
- gpu-warmup: parallel autoscale during compile
- hyperopt → train-best → evaluate → upload-results
Deleted 7 redundant templates:
- compile-and-train-template.yaml
- train-dqn-template.yaml
- train-baseline-rl-template.yaml
- train-supervised-template.yaml
- training-workflow-template.yaml
- precompute-features-template.yaml
- train-ppo-template.yaml
Deleted: scripts/argo-precompute.sh (absorbed into ensure-fxcache step)
Rewritten: scripts/argo-train.sh (single template, --sha for commit pinning)
Updated: kustomization.yaml
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
2026-04-10 20:36:03 +02:00
jgrusewski
8919eccbb9
cleanup: remove --bf16 flag from precompute scripts and Argo template
...
Binary no longer accepts --bf16 (single f32 format). Removed from:
- scripts/argo-precompute.sh
- infra/k8s/argo/precompute-features-template.yaml
PVC fxcache cleaned: deleted 2.4GB old bf16 cache from feature-cache-pvc.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
2026-04-10 20:05:58 +02:00
jgrusewski
cba407b79d
feat: Argo precompute-features template + argo-precompute.sh CLI
...
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
2026-03-31 23:59:34 +02:00