Files
foxhunt/infra
jgrusewski 92f8cba74a fix(infra): add LD_LIBRARY_PATH stubs filter and env vars to compile-and-train template
The ci-builder image has CUDA stub libraries that shadow real NVIDIA
drivers. Without filtering stubs from LD_LIBRARY_PATH, training binaries
report "CUDA GPU required but none available" even on GPU nodes.

Add to hyperopt, train-best, and evaluate steps:
- LD_LIBRARY_PATH stubs filter (grep -v stubs)
- nvidia-smi verification
- RUST_LOG, SQLX_OFFLINE, CUBLAS_WORKSPACE_CONFIG env vars
- PATH includes /workspace/bin (use binary name, not full path)

Matches the existing pattern in training-workflow-template.yaml.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-15 12:22:55 +01:00
..