Answer quality

How we measure answer quality

This page used to publish quality scores for our assistants and for three named competitors. Those numbers were not the result of a measurement we could show you, so we removed them. Here is what is actually true today.

What exists now

Every answer is already scored, for the customer who owns it

The platform reviews its own answers as they are given: each one is scored for factuality and flagged when it states something the retrieved content does not support. Those results are visible to each customer for their own site, alongside the questions the assistant could not answer at all.

That is a real measurement, and it is the one that matters to a buyer: how the assistant performs on your content, not an average across nine industries.

What does not exist yet

A published benchmark

A number worth publishing needs a fixed set of questions, a written rubric, and a run that someone outside this company could repeat and check. We are building that. Until it has run, there is nothing here to show, and we would rather show nothing than restate figures we cannot stand behind.

We will not score a competitor's product on our own question set and publish the result as though it were neutral. Where we compare, we compare on facts you can verify against a vendor's own published terms: price, channels, languages, compliance posture.

Judge it on your own content

The free tier gives you 100 resolutions a month against your own material. That will tell you more than any scoreboard.

Frequently asked questions

Do you publish quality scores?
Not at the moment. This page previously carried per-vertical scores and a comparison against named competitors. Those numbers were not produced by a measurement we could show you, so they have been removed rather than restated.
What are you doing instead?
Building the measurement first. Answers built on retrieved content are scored for factuality and checked for unsupported statements, and those results are visible to each customer for their own site. Turning that into something publishable means a fixed question set, a written rubric and a run anyone can repeat.
Can I evaluate it myself?
Yes, and that is the honest alternative to a scoreboard. The free tier gives you 100 resolutions a month against your own content, which tells you more about your own case than any average across nine industries would.
Will you compare yourself to other vendors?
Only on facts that can be checked against their published terms - pricing, channels, languages, compliance posture. Scoring a competitor's product on our own question set and publishing the result is not something we can do fairly, and we will not present it as if we had.