Skip to main content

Ask the Copilot

The EvalGate Copilot is an AI assistant that drafts changes inside EvalGate. It never publishes or silently changes protected state — it only proposes, and a human accepts or rejects.

Step 1 — Start a thread

Open /copilot, or click the Copilot button on a supported surface (a Prompt, Dataset, Scorer, Monitor, Dashboard, Deployment, or Evals-as-Code page). The thread retains up to 12 resources and bounds each context snapshot to 32 KiB.

Step 2 — Ask in plain English

Describe what you want, for example: “Tighten this scorer so it fails on off-topic answers.” The Copilot reads the retained, redacted context and returns a proposal.

Step 3 — Read the proposal

A proposal includes:
  • the before and after state (redacted),
  • the evidence references it used,
  • its rationale and any warnings,
  • the expected cost of the change,
  • the Model Gateway call ID that produced it.

What the Copilot will not do

  • It will not publish a prompt, scorer, or deployment.
  • It will not change protected state without your explicit accept.
  • It will not act on stale, expired, or permission-lost context. If anything is wrong, it tells you and stops.

Up next

Accept or reject the proposal.