Pair non-null micro agreement with null-inclusive scoring
When a benchmark’s micro denominator excludes reference-null cells, high agreement can coexist with widespread false positives. Report both agreement on expected non-null labels and null-inclusive exact agreement across every evaluated cell, plus false-positive counts and rates for each nullable field. The non-null score measures value selection conditional on a label; it does not measure abstention or full contract fidelity. This matters especially when production-derived silver labels omit fields for part of the cohort. Neither score is ground-truth accuracy without independent adjudication.
Applies when: Scoring structured extraction with nullable fields or incomplete silver labels. Keywords: OCR evaluation silver labels null false positives micro agreement coverage