Accuracy — how we check it

We will publish accuracy numbers only after a benchmark on 100 recordings with human transcripts and an open method. Until then — an honest account of how checking works.

Until the benchmark is done, the best way to check is to upload your own recordings: the first review is free.

How checking works

  • Every mark — “done”, “not done” or “not applicable” — comes with the model’s confidence.
  • Confident marks are set automatically, the rest go to a person as “needs review”. A disputed “not done” is sent to review by us.
  • The day’s score is shown as a “from – to” range until the disputed items are checked.

What we will publish

100 recordings in Kazakh, Russian and mixed — calls and in-store conversations; transcribed by two people; recognition errors by language and mark accuracy on a held-out set; the files and the comparison script.

Good to know

  • The quality of the marks depends on how the checklist is worded — the studio suggests how to phrase items so they can be checked.
  • The model answers “yes/no” based on what was said and doesn’t rate tone on a scale.
  • Speech recognition works for Kazakh and Russian today; English is coming soon.

Recognition compared with other systems

A comparison with Yandex SpeechKit and Google — after a benchmark on 100 recordings with human transcripts.