Quick Debugging Playbook
- Sanity check: can the model overfit a tiny subset (e.g., 10 samples)?
- Loss not decreasing? Lower
lr
, check gradient signs and shapes. - Exploding loss? Clip gradients, reduce
lr
, check for NaNs. - Validation worse than training? Add regularization or more data.