All docs
Get startedFind your way arounddashboard

Find your way around

What each item in the navigation is for, and which page to open for the job in front of you.

variA/Bly has one navigation on the left. This page says what each item is for, so you know where to go for the job in front of you. Words in bold are the labels you see on screen. Any term you don't know is in the Glossary.

The navigation

The navigation and the top barThe navigation and the top bar

SectionItemsUse it to
ProjectOverviewSee how the project is doing, and where to look first.
EvaluationLive events · Sessions · Issues · Evaluation policy · Human review · Alerts · Datasets & runs · Prompt monitoring · AnalyticsLook at answers, find and fix problems, change how scoring works, have people review answers, get alerted, and test a release.
ExperimentationExperiments · Prompt registryCompare prompts or models on live traffic; keep every version of a prompt.
Feature managementFeature gates · Dynamic configs · SegmentsTurn features on for some users and not others.
AdministrationProject configuration · Organization · Members & roles · Settings · API keys · Plan & usage · Help & supportKeys, project settings, people and roles, usage and billing, the audit log, and how to reach us.
Getting startedCreate a projectStart a new project.

Every item opens inside the same frame, with this navigation still on the left. Prompt monitoring, Analytics, Prompt registry, the feature-management pages, Settings, API keys, Plan & usage and Help & support are older pages: they have their own layout inside the frame, but you never leave the app.

Help & supportHelp & support

  • Search events… searches the questions and answers in Live events. Press Enter to see the results there.
  • ◐ switches between light and dark.
  • The organisation menu has Organization settings and Sign out.
  • The project switcher (under the organisation name) lists your projects and Create a project. A badge next to the project name shows its domain, for example Insurance.
  • The footer shows Policy in force with the version number, for example v4. Click it to open the policy.

Which page do I need?

I want to…Go to
Send my app's answers to variA/BlyProject configuration › Integration & keys, then Connect your app
See whether things are getting better or worseOverview (Overview)
Find one answer and see why it scored as it didLive events, then click the row (Event details)
Follow one conversation or multi-agent workflowSessions (Sessions)
Know what is going wrong most often, and where to fix itIssues (Issues)
Change how answers are scoredEvaluation policy (How the evaluation policy works)
Teach variA/Bly my codes, documents, limits and rulesEvaluation policy › Advanced settings ▸ › Data definitions (Data definitions)
Have a colleague check answers by handHuman review (Human review)
Be told when quality dropsAlerts (Alerts)
Test a release before it shipsDatasets & runs (Datasets, Runs and the release gate)
Compare two prompts on real trafficExperiments (Experiments)
Invite a colleague, or change what they may doMembers & roles (Members & roles)
Check usage and the billOrganization › Usage & billing (Organization)
Get helpHelp & support: the community on Discord, GitHub, or email to our support team

Hover for a definition

Most labels, column headings and tab names show a short definition when you hover over them. The same definitions are collected in the Glossary.

Buttons you can't click

If your role does not allow an action, its button is greyed out and the reason is shown next to it, for example that publishing the policy needs the Policy admin role. Ask an Owner or Admin of your organisation to change your role. See Members & roles.