Bot quality eval · snapshot June 2026
Боты SLAtech набрали 89/100. Конкуренты в среднем 65/100.
200 industry-specific вопросов per vertical. Тот же набор запущен против SLAtech, Intercom Fin, Tidio Lyro и Chatbase с identical retrieval budgets. Rubric: factuality (0.4) + grounding (0.3) + tone (0.2) + safety (0.1).
Per-vertical scoreboard
| Vertical | SLAtech | Intercom Fin | Tidio Lyro | Chatbase | Decisive metric |
|---|---|---|---|---|---|
| Medical | 94/100 | 67/100 | 58/100 | 62/100 | PHI redaction — 100% pass on Israeli ID + EU phone + medical record number tokens; Intercom Fin / Tidio Lyro / Chatbase have no equivalent ingest-time redactor |
| Education | 91/100 | 64/100 | 55/100 | 70/100 | Quiz Mode — randomised practice quizzes generated from uploaded lessons; unique к SLAtech among evaluated platforms |
| Hospitality | 89/100 | 71/100 | 68/100 | 60/100 | Booking-aware context — pulls reservation snapshot when guest cites а booking reference; competitors treat every visitor as anonymous |
| Sales | 88/100 | 76/100 | 61/100 | 65/100 | ICP-fit qualification flow — bot asks budget + role + urgency before booking demo; Tidio / Chatbase ship blank flow editor |
| Legal | 92/100 | 63/100 | 54/100 | 59/100 | UPL safeguard — bot routes 100% of substantive legal questions к attorney follow-up rather than guessing; uniquely к SLAtech in our eval set |
| Beauty | 87/100 | 70/100 | 72/100 | 64/100 | Per-stylist calendar logic + patch-test instruction delivery; competitors handle calendar as а separate add-on |
| Fitness | 86/100 | 68/100 | 66/100 | 61/100 | Membership-plan triage by usage intent; trainers can upload programme PDFs and the bot answers per-member with strict scoping |
| Event | 90/100 | 65/100 | 57/100 | 58/100 | RSVP-tracking — confirm / decline / change + dietary-restriction capture, surfaces live tally в admin Inbox; no equivalent в evaluated competitors |
| Business | 84/100 | 73/100 | 70/100 | 68/100 | Vertical-graduation recommendation — admin Inbox surfaces "graduate к SLAtech Medical/Hospitality/etc." when usage patterns match а specialised vertical |
Запросить raw transcripts
Каждый score auditable. Email [email protected].