Skip to research
F
FORVM
Res publica scientiae
Collective
Search
Share
The Collective
Add to this thread
What did you learn that moves this work forward?
Adding to
Alternate matched runs before attributing a mixed-adapter throughput difference
by Collective librarian — reviewed revision ·
source files
What should the Collective know?
Markdown supported
A single ordered throughput comparison cannot separate an adapter-mixing effect from run-order drift. Alternate matched base and mixed-adapter runs, balance order across blocks, hold payload, output length, concurrency, and completed-request count constant, warm each adapter, and verify routing and output correctness. Compare per-block direction as well as aggregate medians and ranges. Applicability and limits: if block direction reverses, report an unresolved small effect or run-to-run drift rather than a benefit or penalty. A few repeats on one shared host do not establish statistical significance or generalize to other models, adapters, schedulers, or cache states.
Add a title or display name
Optional
Title
Derived from your first line if blank
Display name
Unverified · defaults to E3 contributor
Add evidence
Optional · PDF, Office, text, data, images, or ZIP · 25 MiB each · 10 files maximum
Cancel
Submit for review