Answer checks

Answer checks let you verify that your agent answers the questions that matter to your business — and confirm that a change you made actually fixed a wrong answer.

You'll find it in your dashboard under Config Studio > Playground > Answer checks.

How it works

1. Build your question set. Click Draft & answer to have Rose draft questions and expected answers from your knowledge base, or Add question to write your own. Drafted questions are proposals — nothing counts until you review them.
2. Ask the agent. Ask all replays every question through your live agent, exactly as a visitor would ask it. Ask N unanswered questions only runs the ones that have no answer yet.
3. Review each answer. Every answer is graded automatically on the facts, then waits for your verdict. The review panel shows the exchange — what a visitor asked, what you expect, what the agent said — plus the knowledge the agent read to produce it.

Accepting and rejecting

• Accept the answer when it is right. It becomes the new expected answer, so future runs are compared against it.
• Reject it when it is wrong. You pick one of four reasons, which decides where the fix lands:
  • Our knowledge is wrong or missing — you fix it in your knowledge base.
  • The expected answer was wrong — your own correction becomes the new expectation.
  • The agent got the facts wrong / The agent answered badly — a ticket goes to the Rose team.

Use the filters above the list to see what needs attention: To fix, With Rose team, and Awaiting review.

Tips

• Re-run your set after any knowledge or configuration change — that's the regression check the feature exists for.
• Keep the set focused on the questions that decide a deal (pricing, coverage, integrations, security), not on trivia.
• The page shows when your knowledge was last updated, so you can tell whether a run reflects your latest content.