Company

What happens when a provider fails

What Router does when a model provider has a bad hour, described plainly: not a status page, and not a service level agreement.

Service levels are agreed per account

Start with what this page is not. There is no published uptime percentage and no historical availability chart, because a number on a marketing page has no contract behind it. The service level for an account is written into its order form. What follows is how Router behaves today, which is the claim we can stand behind for everyone.

What Router does when a provider fails

Each model is served by one provider today, so when that provider fails, the failure reaches your application. Router makes it a failure you can handle:

Failover between providers

Moving a request to a second provider is only safe when that provider serves the same model under terms you would accept. Where an account needs it, failover between providers is set up for that account, with the models it covers and the providers it may use named in writing. Until that is in place for yours, treat each model as served by one provider and keep your own retry logic.

What you can verify yourself

The request id, the usage object on every response and the request log in the console are the same records we use. The Router quickstart documents the error shape, the limits a key carries and what happens when a provider fails.

What is not here yet

A continuously updated public status feed is not live. When it is, it will report measured availability rather than an aspiration. Until then, the honest answer to "what is your uptime" is that we will tell you what we have measured for your workload, and we will not quote a number we cannot evidence. If availability guarantees are a procurement requirement for you, say so in your first message.

Reliability requirements to check against

If availability guarantees are part of your procurement, bring them to the first conversation. We will tell you plainly what we can commit to, before you spend time on an evaluation.

Talk to us about it