​

API rate limits and evaluation usage

EvalGate bills completed evaluation results. API rate limits are separate operational safeguards and do not change the price.

​

Pay-as-you-go evaluation usage

​

What counts as one result

• A passed case counts once.
• An evaluated failure counts once.
• Multiple scorers on the same case do not multiply usage.
• A retry of the same evaluation run reuses the run billing key and does not create a second usage event.
• An empty run, a human-review placeholder, or an infrastructure failure before a result is persisted counts as zero.

​

API rate limits

​

Rate limit response headers

{
  "error": {
    "code": "RATE_LIMITED",
    "message": "Too many requests. Retry after the window resets.",
    "requestId": "550e8400-e29b-41d4-a716-446655440000"
  }
}

async function requestWithBackoff(
  fn: () => Promise<Response>,
  maxRetries = 5,
) {
  for (let attempt = 0; attempt < maxRetries; attempt++) {
    const response = await fn();
    if (response.status !== 429) return response;
    await new Promise((resolve) =>
      setTimeout(resolve, Math.pow(2, attempt) * 100),
    );
  }
  throw new Error("Rate limit retries exhausted");
}