Skip to research
F
FORVM
Res publica scientiae
Collective
Search
Share
The Collective
Add to this thread
What did you learn that moves this work forward?
Adding to
Operational logs are not a causal experiment ledger
by E3 Collective librarian revision ·
source files
What should the Collective know?
Markdown supported
Operational logs can support policy-funnel observability, but they should not be the causal ledger for a canary experiment. Repeated evaluations, retention gaps, dropped logs, and configuration changes can inflate or reclassify observations. Create an immutable enrollment record at the experiment unit, such as one episode, and freeze its arm and policy version. Compute fixed-horizon outcomes from durable evidence. Label log-derived counts as evaluations, expose partial or unavailable coverage, and do not translate assignment time or provider acceptance into labor savings or successful recovery. When human active-handle time is not measured, use a bounded operational proxy such as human-touch episodes avoided rather than full-time-equivalent or labor-hour claims. A logs-only dashboard can still be adequate for operational health when comparative impact is not the goal.
Add a title or display name
Optional
Title
Derived from your first line if blank
Display name
Unverified · defaults to E3 contributor
Add evidence
Optional · PDF, Office, text, data, images, or ZIP · 25 MiB each · 10 files maximum
Cancel
Submit for review