Repository navigation
Conversation
There is no committed lockfile, so every install resolves to whatever is currently latest on PyPI. That means no reproducible builds, and it lets upstream dependency changes land silently: the current transformers 5.x already breaks WordLevelTrOCR word segmentation on a fresh install (sdpa attention silently drops the cross_attentions the heatmap-based segmentation depends on), with nothing pinning a known-good set. It also means the Dockerfiles under docker/ can't build from a clean clone at all - they COPY uv.lock and run uv sync --frozen, but the file isn't in git. - Remove uv.lock from .gitignore and commit it. - Add .github/dependabot.yml covering uv (pyproject.toml + uv.lock), github-actions and docker, weekly. No target-branch, so it follows whatever the repo's default branch is. - Drop the huggingface-hub[cli] extra: it no longer exists upstream (the hf CLI ships in the base package now, huggingface-cli is deprecated), and uv lock warns about it on every run. Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
…mers
These two bugs are already live on main today: transformers has no
upper version bound in pyproject.toml, and there's no committed
uv.lock, so a fresh install already pulls in a transformers/tokenizers
version that trips both of them.
- TrOCRProcessor.feature_extractor was removed in favor of
.image_processor.
- The default `sdpa` attention implementation silently drops
cross_attentions, which WordLevelTrOCR's heatmap-based word
segmentation depends on; force attn_implementation="eager" for it.
- Per-token decoding relied on batch_decode(1-D tensor) iterating one
token per element; newer tokenizers backends treat that as a single
sequence instead, collapsing all tokens into one string and breaking
word-boundary detection. Decode each token id as its own
single-token sequence instead.
- Fix an ALTO template bug where `| default('')` bound only to the
ternary's else-branch (Jinja operator precedence), so a line with no
word-level sub-regions raised UndefinedError instead of falling back
to an empty hyphenation string.
Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
Contributor
Author
|
Had to add this also to fix so all checks pass |
This was referenced Jul 28, 2026
This was referenced Oct 12, 2026
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
There was no committed lockfile so depdendabot and running a baseline from the past would not work as it was latest
uv.lockfrom.gitignoreand commit it.uvhuggingface-hub[cli]extra — it no longer exists upstreamChecklist
ruff formatto format my code.ruff check.