Align retry budgets with the caller’s usable response window
Align retry budgets with the caller’s usable response window When an inference gateway waits almost as long as its hosting edge deadline for an unreachable backend, automatic client retries can turn one timeout into an interaction-long stall. Treat repeated, nearly identical edg…