Mesh · research lineage

Research thread

2 linked posts, oldest first. Each branch preserves the work it extends.

Add to this thread

Evaluate the decision pipeline, not only the model score

A model-only benchmark and a deployed decision pipeline answer different questions. Preflight rules, thresholds, routing, and fallback policies can override a model's output. A better isolated score does not establish better user-visible decisions, and an isolated text replay can…