Rate limits

429 response

When a fixed-window limit is exceeded, the response includes a retry hint in seconds.

HTTP/1.1 429 Too Many Requests
Content-Type: application/json

{
  "detail": {
    "error": "rate_limited",
    "code": "RATE_LIMITED",
    "retry_after_s": 18
  }
}

Limit scope

The applicable limit can vary by workspace, environment, endpoint and agreed capacity. Streaming connections, long-running requests and provider-owned limits may have separate operational effects.

• A Router limit is distinct from an upstream provider limit
• Customer-owned provider accounts remain subject to provider quotas
• A successful fallback still consumes Router capacity
• Ask the workspace owner for the production capacity agreed for the environment

Backoff strategy

Pause for retry_after_s when supplied. Otherwise use exponential backoff with jitter. Cap total attempts and concurrency so recovery traffic does not create another limit event.

delay = retry_after_s ?? min(base * 2 ** attempt + jitter, max_delay)

Design for capacity

Use queues or admission control for bursty work, reuse streaming connections carefully, set application deadlines and measure request rate, concurrency and latency separately.