# Agent 155: E2E Test Dtype Fix ## Mission Change test tensors from F32 to F64 in MAMBA-2 E2E tests to match model expectations. ## Status **COMPLETE** - All tensor dtype issues fixed in 7 test functions ## Changes Made ### File Modified `ml/tests/e2e_mamba2_training.rs` ### Fixes Applied Changed all `Tensor::randn(0f32, ...)` calls to `Tensor::randn(0f64, ...)` in the following test functions: 1. **test_mamba2_simple_forward_pass** (Line 69) - Input tensor: `[batch=8, seq=60, features=256]` 2. **test_mamba2_batch_shapes** (Line 101) - Input tensors for batch sizes: [1, 8, 16, 32] 3. **test_mamba2_cuda_device** (Line 133) - Input tensor: `[batch=16, seq=60, features=256]` 4. **test_mamba2_sequence_lengths** (Line 172) - Input tensors for sequence lengths: [10, 30, 60, 120] 5. **test_mamba2_gradient_flow** (Lines 205-206) - Input tensor: `[batch=8, seq=60, features=256]` - Target tensor: `[batch=8, seq=60, output=1]` 6. **test_mamba2_training_loop_simple** (Lines 246-247) - Input tensor: `[batch=16, seq=60, features=256]` - Target tensor: `[batch=16, seq=60, output=1]` 7. **test_mamba2_config_variations** (Line 289) - Input tensors for d_model: [128, 256, 512] ## Root Cause MAMBA-2 model expects F64 tensors (as specified in Agent 147's analysis), but E2E tests were creating F32 tensors, causing dtype mismatch during forward pass. ## Impact - **Tests Affected**: 7 functions in `e2e_mamba2_training.rs` - **Total Changes**: 8 tensor initialization calls converted from F32 to F64 - **Expected Outcome**: All E2E tests should now pass without dtype mismatch errors ## Testing Notes These changes align test data types with the MAMBA-2 model's internal F64 precision requirements. The model uses F64 for: - Input embeddings - Hidden states - Output projections - Gradient computations ## Time Spent 5 minutes (code changes only, no compilation) ## Next Steps 1. Compile and run tests: `cargo test -p ml e2e_mamba2 -- --nocapture` 2. Verify all 7 tests pass without dtype errors 3. Proceed with full MAMBA-2 training pipeline validation ## Files Modified - `/home/jgrusewski/Work/foxhunt/ml/tests/e2e_mamba2_training.rs` (+8 dtype fixes) ## Verification All `Tensor::randn()` calls in the test file now use `0f64` instead of `0f32`, ensuring dtype consistency with MAMBA-2 model expectations.