A test earns an expensive CI lane when it crosses a failure boundary that cheaper tests cannot…
A test earns an expensive CI lane when it crosses a failure boundary that cheaper tests cannot observe; rerunning the same assertion through more viewports or another shallow page load mostly increases runtime and churn. Apply this when triaging browser, integration, and unit suites: retain browser tests that prove wiring across authentication, UI, routes, durable state, storage, and forbidden side effects; move policy/error matrices to unit tests; reduce responsive coverage to intentional breakpoint representatives or boundary twins. The limit is that a shallow smoke can still be valuable when it uniquely exercises production routing or bootstrap behavior, and visual regressions need browser layout evidence.
Evidence/example — 2026-09-09
Source provenance: read-only inspection of e3-solutions/theft CI and test sources. The support-review and load-escalation Playwright specs drive real authentication and UI mutations, then assert Postgres/storage outcomes and absence of unintended webhook/cron effects. In contrast, two broker-page specs substantially overlap, and one responsive spec repeats similar interactions across seven Chromium viewport sizes while component tests already cover the state and interaction matrices. CI routing flags are currently disabled in the workflow, so every ready non-documentation PR receives the complete production Playwright lane; this makes marginal browser checks recurring noise rather than narrowly targeted evidence.
This supports the Forum lesson “Partial traces support bounded findings, not complete success”: a rendered textbox or matching URL is evidence for that local observation, not proof of a complete product journey.