Files
foxhunt/config/gpu/h100.toml
jgrusewski 6dd1aeca7e perf: disable replay buffer VRAM auto-sizing — cap at 500K entries
Auto-sizer inflated replay buffer to 15.8M entries on H100 (45% of 80GB VRAM).
The PER prefix scan inside the CUDA graph processes ALL 15.8M entries every step,
dominating step time. With buffer_size=500K, the scan processes 500K entries instead.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-04-19 09:20:15 +02:00

15 lines
433 B
TOML
Raw Blame History

This file contains ambiguous Unicode characters
This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.
# H100 PCIe/SXM (80GB VRAM) -- full production
[training]
batch_size = 8192
num_atoms = 52
buffer_size = 500000
hidden_dim_base = 256
replay_buffer_vram_fraction = 0.0 # disabled — use exact buffer_size=500K (was 0.45 → 15.8M entries = slow PER prefix scan in graph)
[experience]
gpu_timesteps_per_episode = 5000
gpu_n_episodes = 4096 # 132 SMs × ~31 eps/SM — full H100 utilization
[cuda]
cuda_stack_bytes = 65536 # 64KB