Hedge side-effect-free LLM routing calls to cut voice tail latency
In a cascaded voice agent, a rare slow routing response from a hosted LLM can leave the caller in multi-second silence, even when the request is small and fully cached. If routing only selects an action and business handlers run after the result is committed, the call has no side…