A 29M-Parameter Model That Finishes Your Words Before You Do — and Knows When It's Guessing

Earlybird predicts spoken words 90ms before the speaker finishes them, flipping the latency equation for voice agents. At 16.8MB quantized, it's smaller than most app icons.

Imagine you're playing a cooperative word game where your partner is slowly spelling out a word, letter by letter. Most players wait until the last letter drops before writing their guess. The really good players — the annoying ones — write their answer before the last letter appears, because the partial pattern was enough. Earlybird is that annoying player, but for streaming speech recognition. It predicts words before the speaker finishes saying them, and crucially, it tells you how confident it is in each prediction. The core claim: a 29M-parameter streaming ASR model, quantized to 16.8MB at 4 bits, that outputs the median word correctly 90 milliseconds BEFORE the speaker finishes it. Standard streaming recognizers output words 90 to 400 milliseconds AFTER the speaker finishes. That's a swing of 180-490ms per word. For a voice agent deciding when to start its reply, that delta is the difference between feeling responsive and feeling laggy. The training trick is deceptively simple. Rather than training on complete utterances and then hoping the model generalizes to partial audio, Earlybird trains on audio randomly truncated mid-word. The model must predict every word that's due in full, plus guess the next two words. This forces the model to learn partial-word completion as a first-class skill, not a side effect. The raw token probabilities become a natural confidence measure — the model doesn't just guess early, it tells you how sure it is about each guess, with calibration errors (ECE) of 3.7 to 5.5%. The ladder placement is honest and detailed. On LibriSpeech test-clean, 69% of words are predicted correctly before the speaker finishes them, versus 3-25% for released streaming models. Earlybird is earliest on all six timing test sets covering audiobooks, TED talks, public speech, earnings calls, and synthetic speech. On the eight English Open ASR Leaderboard sets, it beats Moonshine Tiny on every set and roughly ties Whistle (a model of the same size). This isn't claiming to beat Whisper Large — it's claiming to be the fastest in its weight class while matching accuracy. The integrity picture is solid for a single-author paper. LibriSpeech is a community standard benchmark. The Open ASR Leaderboard is public. Six distinct timing test sets spanning different domains reduce the risk of benchmark shopping. The model weights are released on HuggingFace, so anyone can reproduce the timing measurements. The main gap is that calibration is evaluated on the same distribution as training (English, mostly read speech), and there's no pre-registration. But for a systems paper making a latency claim, releasing the model IS the validation — anyone can time it. The milestone that matters is voice-agent end-to-end latency. Current commercial voice assistants feel slow because the ASR→understanding→generation pipeline adds up. If the ASR stage can deliver confident partial transcripts 90-180ms earlier, the downstream planner or retriever can start working sooner. The practical threshold is total round-trip under 500ms for conversational feel. Earlybird's contribution shaves the ASR portion, but the pipeline bottleneck will shift to the LLM response generation — which is where the next constraint lives. The experiment not run: noisy real-world audio. All six timing sets are relatively clean — audiobooks, TED talks, earnings calls. The obvious next test is cocktail-party noise, accented speech, and far-field microphone capture where partial-word patterns are degraded. My read: this is a single-author project with limited compute, and the clean-audio results were strong enough to establish the claim. Noisy conditions would likely degrade the predictive advantage, and the author is probably saving that for a follow-up with noise-augmented training.