LLM quality gates: turn evaluations into release decisions

The operating model

Four layers, one release decision#

1. 01

   Tests

   Schemas, policy rules, fixtures, and invariants catch failures that do not require interpretation.

2. 02

   Judge

   A rubric evaluates qualities such as groundedness or task completion and returns a verdict, evidence, and an explicit uncertainty state.

3. 03

   Gate

   A policy combines signals, handles uncertainty, and produces PROMOTE, HOLD, or ROLLBACK.

4. 04

   Release

   A named owner accepts the evidence, records the decision, and monitors the real outcome.

Judge contract

Ask for a verdict you can audit#

A judge prompt is not a quality system. Treat the judge as a versioned component with a narrow criterion, anchored examples, a structured output, and an abstain path. Store the rubric version beside each result.

The minimum useful result is not a bare number. Keep the verdict, the supporting evidence, an uncertainty state whose meaning is defined by the rubric, and enough execution context to reproduce the case. G-Eval is an early public example of using explicit evaluation steps and a form-filling structure instead of an unstructured opinion.

{
  "policy_version": "release-policy@1",
  "required": ["schema", "critical_safety", "task_completion"],
  "hard_blockers": ["schema", "critical_safety"],
  "on_missing_evidence": "HOLD",
  "allowed_verdicts": ["PROMOTE", "HOLD", "ROLLBACK"]
}

{
  "verdict": "HOLD",
  "failed": ["critical_safety"],
  "missing": [],
  "policy_version": "release-policy@1"
}

Gate policy

Thresholds are policy, not truth#

Do not hide several risks inside one average. A release can have a healthy aggregate score and still fail a critical security or factuality invariant. Define hard blockers separately from soft signals, and document what happens near a threshold.

Use PROMOTE when required invariants pass and the evidence is within the validated operating range. Use HOLD when evidence is missing, conflicting, or uncertain. Use ROLLBACK when production evidence crosses a predefined safety or reliability boundary. No universal cutoff works for every product; calibrate against labeled cases and the cost of each error.

Judge the judge

LLM judges need their own tests#

MT-Bench documents position, verbosity, and self-enhancement biases in LLM-based judging. Counter them with position swaps, length-controlled cases, blinded model identity, adversarial examples, and periodic comparison with human labels.

Track disagreement and abstention, not only pass rate. A judge that always sounds certain can be more dangerous than one that exposes its uncertainty. When the rubric, judge model, or prompt changes, replay a stable calibration set before promotion.

Evidence trail

Make failures replayable without collecting everything#

Connect evaluation records to the run, model and prompt versions, tool outcomes, latency, cost, and relevant retrieval context. Common semantic conventions help teams correlate evidence across services, but conventions evolve—pin the version you implement.

Do not record prompts and responses by default. OpenTelemetry explicitly warns that GenAI message attributes can contain sensitive information. Apply redaction, access controls, retention limits, and opt-in content capture before storing payloads.

Dogfooding loop

Turn real friction into the next regression case#

Before users find the failure, run the product through its own critical journeys: the awkward prompt, the failed tool call, the partial answer, the language switch, the recovery path. Convert every confirmed failure into a minimal replayable case.

This closes the loop: production and dogfooding produce evidence; triage produces labels; labels extend the evaluation set; the set protects the next release. A gate is useful when it learns from failure without quietly changing the meaning of success.

Release checklist

A small gate worth operating#

• ✓Version the dataset, rubric, judge, prompt, and policy.
• ✓Run deterministic invariants before probabilistic evaluation.
• ✓Return verdict, evidence, a defined uncertainty state, and abstention.
• ✓Validate with labeled cases and test known judge biases.
• ✓Separate critical blockers from aggregate indicators.
• ✓Redact sensitive trace content and set retention rules.
• ✓Assign a release owner and record the decision.
• ✓Replay production failures before the next promotion.