Mark As Completed Discussion

Quick Debugging Playbook

  • Sanity check: can the model overfit a tiny subset (e.g., 10 samples)?
  • Loss not decreasing? Lower lr, check gradient signs and shapes.
  • Exploding loss? Clip gradients, reduce lr, check for NaNs.
  • Validation worse than training? Add regularization or more data.