Rules

Who can enter

Any company or research group with a working Cantonese speech system. There is no fee and no exclusivity. You do not need a complete voice stack: ASR and LLM are the baseline, and TTS and end-to-end are optional. An entrant with two pillars is ranked on the Core Score alongside everyone else.

Anonymity

You are identified on the leaderboard by a codename by default. Being named is opt-in, you choose it yourself, and you can change your mind up until results are published. We will never name you in the report without written consent. This is stated here rather than buried in terms because it is the first thing most entrants want to know.

How scoring works

Every published number carries a bootstrap confidence interval, and entries whose intervals overlap are reported as tied rather than ordered. The normalization applied before scoring is published as running code, not prose, so you can compute the same number we do. Full methodology.

A pillar you did not enter shows as “not entered”, never as a zero. A run where our platform failed does not count against you and does not consume your quota.

Integrity

• Response deadline. Each clip carries a deadline measured from the end of the audio to your first response byte. It is generous for a working system and far too short for a person to transcribe by hand. That is the point of it.
• Rotating clips. The subset changes between windows, drawn with a recorded seed so any historical draw can be reproduced during a dispute.
• Held-out verification. Final standing is confirmed against a set nobody has seen, over a live connection, whatever mode was used earlier.
• Three scored runs per window. Practice is unlimited and unscored.
• System description. One to two pages, required before final scoring. Undisclosed human involvement in a scored run is the one thing that ends an entry.

We do not claim the audio cannot be captured. It is streamed to your process, so of course it can. We claim something narrower and true: the response window precludes manual transcription, every dataset pack is issued to a named recipient and recorded, and the final set is fresh. We do not watermark the audio and do not claim to: attribution rests on the issue record, which names a person and is therefore enforceable.

Data

The evaluation audio is real Hong Kong contact-centre material with personal information removed. You may use it to produce your submissions during the edition. You may not redistribute it, publish it, or train on it. Access is logged. All copies you hold are to be deleted within thirty days of the edition closing.

Disputes

Scores are append-only: a correction is published as a new value with a note, never as a silent edit. If you believe a number is wrong, open a dispute and we will show you the per-item record behind it, including which failures we attributed to ourselves. Results enter a review window before publication so disagreements are settled privately first.

Withdrawing

You can withdraw at any time before publication and your results are removed. After publication, an anonymous entry stays anonymous, and a named entry can be un-named on request.

Request access · Methodology · About the dataset