Skip to content

Upgrade arrow and parquet to 60 as one change - #6

Merged
CiprianFlorin-Ifrim merged 2 commits into
mainfrom
build/arrow-60
Oct 20, 2026
Merged

CiprianFlorin-Ifrim merged 2 commits into
mainfrom
build/arrow-60

Conversation

@CiprianFlorin-Ifrim

Copy link
Copy Markdown
Member

The arrow crates and parquet are released in lockstep, and each pins the exact version of the others, yet Dependabot proposed four separate pull requests, one for each crate, and every one of them failed to resolve, as each left the remaining crates at version 56. The group itself added a further cause, as on its first run the glob that was meant to gather the arrow crates appears not to have selected them, and only parquet entered the group.

The five crates now advance to 60 in a single change, which also replaces get_column_writers, removed in parquet 60, with the column writers that ArrowRowGroupWriterFactory provides. Version 60 raises the minimum supported Rust to 1.88, and the rust-version in Cargo.toml moves with the oldest entry of the test matrix. The Dependabot group now names all five crates explicitly and admits every update type, which lets the next release of the family arrive as one pull request.

Notes

Suite Tests
Rust 43 passed

The arrow crates and parquet are released in lockstep, and each pins the exact version of the others, which means that a single crate cannot be upgraded on its own. Dependabot nonetheless proposed four separate pull requests, one for each crate, and every one of them failed to resolve, as each left the remaining crates at version 56.

The relevant question is therefore not which of the four pull requests to merge, but how to move the whole family at once. The five crates now advance to 60 in a single change, which also replaces get_column_writers, removed in parquet 60, with the column writers that ArrowRowGroupWriterFactory provides.

Version 60 raises the minimum supported Rust to 1.88, and the rust-version declared in Cargo.toml moves with the oldest entry of the test matrix, which keeps the two in agreement. A shard of 203,982 rows, repacked under the new version, stores the same 163,704 rows as edits and rebuilds every row against its source. The file is 59 KB smaller, a difference that cannot be attributed to the edits, as their count is unchanged. Rather, it reflects the newer zstd release that version 60 brings with it.
The arrow group was intended to keep the arrow crates and parquet in one pull request, yet on its first run Dependabot placed parquet alone in the group and proposed each arrow crate separately. The failure cannot be attributed to the update types, as the same group admitted the major bump of parquet. Rather, the glob that was meant to match the arrow crates appears not to have selected them, and the group now names all five crates explicitly and admits every update type, which lets a future release of the family arrive as a single pull request that can resolve.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant