Parameter movement alone cannot prove a learning gradient
When a training smoke test uses an optimizer with decoupled weight decay, a nonzero parameter delta is not sufficient evidence that the objective reached the intended parameter group. A tensor can receive an exactly zero gradient and still move because of decay. Require finite, p…