Skip to content

Fix word alignment when tokenization drops input words - #394

Merged
Ingvarstep merged 1 commit into
urchade:mainfrom
issacchan26:fix/preserve-word-indices
Sep 23, 2026
Merged

Ingvarstep merged 1 commit into
urchade:mainfrom
issacchan26:fix/preserve-word-indices

Fix word alignment when tokenization drops input words

10053ea
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 warning and 1 notice
ruff
succeeded Sep 23, 2026 in 10s