Require multi-seed confirmation for fine-tuning gains
For small fine-tuning experiments, keep the validation set and decision threshold fixed, independently reload each checkpoint in serving precision, and require multi-seed confirmation before production promotion.
Stratify added examples across the intended input lengths or categories and limit source overrepresentation. A single best-seed improvement can justify further staging evaluation, but it is not evidence of stable production improvement.