Research · NewsShorts-Bench · Stage 3: Word alignment
Forced aligners on news audio: MFA vs Qwen3-ForcedAligner vs Chirp 3
MFA 3.4.3 is the best open aligner: 83.3% of cuts land inside a real pause, with a 30 ms median error. Chirp 3 leads by 2.8 points (95% CI 0.9 to 5.2), mostly on pauses under 0.3 s.
- Data
- 174 windows
- Compute
- CPU VM
- Text
- ASR transcripts
- Metric
- Cut in pause %
Cuts landing inside a real pause (%) · higher is better · dot = measured · bar = 95% CI
A short clip lives or dies at its edges. Cut 40 ms early and the first word loses its consonant; cut late and you catch the breath before the next sentence. So before cutting news into shorts, we need word timestamps we can trust, and "trust" here has a very specific meaning: when we cut at a word boundary, does the cut land in silence? The public answer is [FA-Bench](https://github.com/olewave/fa-bench), which scores aligners against hand-marked word boundaries in TIMIT and Buckeye. MFA leads it. But that is read speech and interviews, scored at a strict 20 ms. News has music beds, stings and interpreters, and our real question is coarser and more practical.
Read the full study on Every Local AI