All docs
ConceptsScores, checks and statusesdashboard

Scores, checks and statuses

Dimensions, categories, weights and checks; the bars that flag an answer; and what Healthy, Needs attention, Not configured and Not applicable mean.

Dimensions, categories and checks

What it is. A dimension is one thing scored from 0 to 1 (49 in all). Dimensions fall into six categories: Grounding, Safety, Semantic, Coherence, Quality and Depth. Overall is the weighted combination of the categories. A check is a yes/no comparison of exact values (document version, hand-off fields, SQL rules, expected answer, posting rules and more) with a place to correct.

Why it matters. Scores show how good an answer is; checks show what is wrong and where.

How it relates. Category weights are percentages that must total 100%. Many checks need a data definition.

Where you see it. Evaluation policy › Checks & weights; an answer's Scores and Checks tabs.

Example. Weights 40 / 20 / 15 / 10 / 10 / 5: Grounding counts most toward Overall.

Per-dimension bars

What it is. Optional bars on single dimensions: Needs attention below flags an answer whose value is under it; Release minimum is the bar a dataset run's mean must reach for the release gate.

Why it matters. Hold one dimension that matters to you to a stricter standard.

How it relates. Bars never change a score. For Safety dimensions the bar is on safety (1 − risk): "needs attention below 0.9" on toxicity flags toxicity above 0.1.

Where you see it. Checks & weights › Dimension bars. See Checks & weights.

Example. Faithfulness: needs attention below 0.85; release minimum 0.9.

Healthy, Needs attention, Not configured, Not applicable

What it is. An answer is Healthy when every check that applies passed, and Needs attention when at least one failed. A check is Not configured when it needs a data definition you haven't given, and Not applicable when it doesn't apply (a SQL check on an answer with no query). Warn means worth a look, not proven wrong.

Why it matters. Not configured is never counted as a pass, so a missing setup can't look like good quality.

How it relates. Not configured checks appear as Setup issues in Issues.

Where you see it. Status pills in Live events; an answer's Checks tab.

Example. No SQL schema set: SQL follows the rules shows Not configured. Add it under Data definitions and publish.

Safety

What it is. Harm in the answer: toxicity, bias, harmful content, privacy, inappropriate language, violence and adult content.

Why it matters. A wrong fact is a grounding problem, not harm. Keeping them apart makes both readable.

How it relates. Wrong facts are reported by Grounding and No contradictions. Misinformation counts toward Safety only for an answer sent without documents.

Where you see it. An answer's Summary and Scores.

Example. "$6,500" where the plan says $6,000: Grounding fails, Safety unaffected. An answer exposing a member's SSN: Safety fails (privacy).