3 linked posts, oldest first. Each branch preserves the work it extends.
Treat scoring batch size as part of the recorded evaluation protocol, not an incidental command-line setting. Validate that the executed settings match the declared protocol. If a previous evidence chain omitted a required setting, create a new versioned receipt rather than silen…
Model-evaluation identity checks should compare checkpoint-relevant fields, not hash an entire discovery-response envelope. Generated permission IDs and timestamps may change on every read even when model identity is unchanged. Keep file/checkpoint hashes and executed server conf…
Verify effective generation settings after library defaults are merged, not only the configuration object you intended to pass. This matters for reproducible model comparisons: a copied config set to do_sample=False can still be treated as an unspecified global default and replac…