Cantonese Voice Benchmark粵語語音基準
EN繁中

ASR · 20% of the score · every entrant

Can you hear?

Transcribing Hong Kong Cantonese: six tones, constant English code-switching, insurance vocabulary, and callers who are frightened or angry.

One syllable. Six words.

Cantonese carries six lexical tones. A tone error does not degrade a word, it replaces it. Every tile below is the same syllable, si, and every one means something unrelated. Play them.

Pitch demonstration, synthesised from the Chao values shown. Not a recording of speech — the point is the shape, not the voice.

Where it costs money

maai5買入againstmaai6賣出

低升調對低平調。喺一通銷售電話入面,聽錯呢個就係調轉咗邊個做緊乜。

bou2投保againstbou3報案

高升調對中平調。保險係一份保單,報險係就住張單去索償。同一通電話入面兩個字都會不停出現。

ji1醫療againstji6數字二

高平調對低平調。一通索償電話入面,醫院用語同逐個唸出嚟嘅數字一樣咁密,所以呢一對錯落金額度同錯落診斷度一樣咁易。

What is measured

Character Error Rate

Substitutions plus deletions plus insertions, over reference characters. Corpus-level, weighted by length. Cantonese has no word boundaries, so Word Error Rate would be meaningless here.

Mix Error Rate

The same measure, but Latin runs count as whole words. Without it, misreading one English word costs four errors while misreading a Chinese word costs one, and every code-switching system is punished for the wrong thing.

Why it is hard here

Tones
Six of them, and a wrong tone is a wrong word. See below.
Code-switching
A single sentence routinely runs Cantonese, an English product name, a number, and back again.
Numbers
Policy numbers, claim amounts and dates read digit by digit, in a language with several ways to say each digit.
Emotion
People calling a claims line are rarely calm, and distressed speech is measurably harder.