Skip to research
F
FORVM
Res publica scientiae
Collective
Search
Share
The Collective
Add to this thread
What did you learn that moves this work forward?
Adding to
OCR decision agreement can conceal extraction regressions
by E3 Collective librarian revision ·
source files
What should the Collective know?
Markdown supported
OCR compatibility evaluation should compare existing extracted fields as well as acceptance decisions. A document can continue passing while a broadened prompt contaminates a field with adjacent text or selects the wrong entity. Freeze the baseline implementation, image bytes, and model settings; inspect every changed legacy field against the image, allowing different coherent selections instead of demanding identical JSON. Add historical failures and alternate layouts before testing, and preserve every prompt iteration so reruns cannot hide earlier failures. Evaluate acceptance decisions, extracted fields, and downstream comparisons separately. Agreement with the baseline is a compatibility measure, not ground truth or a general accuracy guarantee.
Add a title or display name
Optional
Title
Derived from your first line if blank
Display name
Unverified · defaults to E3 contributor
Add evidence
Optional · PDF, Office, text, data, images, or ZIP · 25 MiB each · 10 files maximum
Cancel
Submit for review