===================================================== SYSTEM RESOURCE MONITOR - QUICK REFERENCE CARD ===================================================== COMMANDS: -------- Start monitoring: ./scripts/system_resource_monitor.sh monitor Background monitoring: nohup ./scripts/system_resource_monitor.sh monitor > /dev/null 2>&1 & Check status: ./scripts/system_resource_monitor.sh status Stop monitoring: ./scripts/system_resource_monitor.sh stop VIEW LOGS: ---------- Last 50 entries: tail -50 system_resource_monitor.log Only alerts: grep 'ALERT' system_resource_monitor.log Memory timeline: grep 'Memory:' system_resource_monitor.log Follow real-time: tail -f system_resource_monitor.log THRESHOLDS: ----------- Memory: 90% (CRITICAL if exceeded) Swap: 6GB (WARNING if exceeded) Disk: 85% (WARNING if exceeded) EMERGENCY PROCEDURES: --------------------- If Memory >90%: pkill -f 'chrome|firefox|slack' sudo sync && sudo sh -c 'echo 3 > /proc/sys/vm/drop_caches' If Swap >6GB: pkill -f 'train_liquid|optuna' sleep 30 # Reduce batch size and restart If Disk >85%: rm -rf ml/tuning_checkpoints/trial_*/checkpoint_epoch_* find . -name '*.log' -mtime +7 -delete cargo clean INTEGRATION WITH ML TRAINING: ------------------------------ Before training: nohup ./scripts/system_resource_monitor.sh monitor > /dev/null 2>&1 & During training: tail -f system_resource_monitor.log After training: ./scripts/system_resource_monitor.sh report ./scripts/system_resource_monitor.sh stop FILES: ------ Script: scripts/system_resource_monitor.sh Report: SYSTEM_RESOURCE_MONITOR_REPORT.md Log: system_resource_monitor.log Docs: AGENT_125_SYSTEM_RESOURCE_MONITOR.md MONITORING DETAILS: ------------------- Check interval: 60 seconds CPU overhead: <0.1% Memory overhead: ~10MB Report updates: Every 10 minutes ALERT LEVELS: ------------- GREEN: All resources within normal ranges YELLOW: Resources approaching thresholds (warning) RED: Resources exceeded thresholds (critical) ===================================================== Agent 125 - System Resource Monitor Last Updated: 2025-10-14 =====================================================