Skip to content
Merged
Changes from 1 commit
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
test(lang): keep es and du out of the German stopwords
`es` and `du` are German function words, but Spanish and French claim them
too, and a word two lists share names neither language. With them in the
German list, "que hora es en australia" and "baisse le volume du
haut-parleur" are left undecided and routed to the English checkpoint, and
the MASSIVE es-ES share routed to multilingual falls from 0.711 to 0.692
(0.488 to 0.447 with accents stripped; fr-FR 0.822 to 0.816).

Pin both so a later German addition cannot bring them back.
  • Loading branch information
Rish-it committed Sep 23, 2026
commit b22698ccf939375aaf12d7a073435ac325d090ef
3 changes: 3 additions & 0 deletions tests/test_router.py
Original file line number Diff line number Diff line change
Expand Up @@ -473,6 +473,9 @@ def check(name, got, want):
check("route/ascii german " + text, _r_lat.route(text).model, "multilingual")
check("route/english control for #54",
_r_lat.route("I would like to book a flight to Berlin tomorrow").model, "english")
# German words that Spanish (`es`) or French (`du`) also claim would stop naming those languages
check("latin_lang/spanish es stays evidence", guess_latin_language("que hora es en australia"), "es")
check("latin_lang/french du stays evidence", guess_latin_language("baisse le volume du haut-parleur"), "fr")


# --------------------------------------------------------------------- temperature clamp (#35)
Expand Down