Repository navigation

feat: support native Iceberg Bloom writes on older runtimes - #7226

Draft

NikitaMatskevich wants to merge 45 commits into

apache:mainfrom

NikitaMatskevich:feat/iceberg-bloom-filter-writes-legacy

Draft

feat: support native Iceberg Bloom writes on older runtimes#7226
NikitaMatskevich wants to merge 45 commits into
apache:mainfrom
NikitaMatskevich:feat/iceberg-bloom-filter-writes-legacy

Commits on Nov 10, 2026
- feat: support bloom filters in native Iceberg writes
  NikitaMatskevich
  committed
  66070ea
- feat: support Iceberg bloom filter write settings
  NikitaMatskevich
  committed
  1d9cc5f
- fix: fall back for sanitized Iceberg bloom paths
  NikitaMatskevich
  committed
  7fbe2f1
- test: gate Iceberg bloom shape properties independently
  NikitaMatskevich
  committed
  c8bc951
- fix: match Iceberg-version bloom property support
  NikitaMatskevich
  committed
  5988d52
- fix: use Parquet 59 bloom filter APIs
  NikitaMatskevich
  committed
  aea5d10
- fix: satisfy formatting checks
  NikitaMatskevich
  committed
  6c8e05a
- docs: describe Parquet 59 bloom folding
  NikitaMatskevich
  committed
  20bde04
- fix: reject zero bloom filter FPP
  NikitaMatskevich
  committed
  3b96fa6
- fix: ignore unused bloom max byte caps
  NikitaMatskevich
  committed
  94a89fd
- test: document bloom folding after writes
  NikitaMatskevich
  committed
  9693fb3
- test: lock bloom sizing parity across runtimes
  NikitaMatskevich
  committed
  6823b6d
- refactor: group Iceberg bloom column settings
  NikitaMatskevich
  committed
  8b6de0a
- fix: match Iceberg bloom path resolution by version
  NikitaMatskevich
  committed
  59be1e7
- feat: make native Iceberg bloom folding opt-in
  NikitaMatskevich
  committed
  28f568b
- fix: integrate Bloom write opt-in with current Iceberg writer
  NikitaMatskevich
  committed
  fe5683d
- docs: clarify native Iceberg Bloom filter tradeoffs
  NikitaMatskevich
  committed
  a444bfa
- docs: simplify Bloom filter compatibility introduction
  NikitaMatskevich
  committed
  780f099
- docs: list exceptional Bloom filter fallback cases
  NikitaMatskevich
  committed
  14bffc5
- docs: remove upstream folding work from user guide
  NikitaMatskevich
  committed
  9310203
- docs: group Bloom write prerequisites under accepted divergences
  NikitaMatskevich
  committed
  1ab6fb2
- fix: fall back for floating-point Iceberg Bloom writes
  NikitaMatskevich
  committed
  e431811
- fix: ignore unconfigured columns in Iceberg Bloom path checks
  NikitaMatskevich
  committed
  74665a8
- fix: fall back for unidentified Iceberg Bloom naming conventions
  NikitaMatskevich
  committed
  4b1d10b
- docs: clarify Iceberg Bloom opt-in and unused caps
  NikitaMatskevich
  committed
  efb3500
- test: cover Iceberg Bloom parity across physical types
  NikitaMatskevich
  committed
  b3424a4
- fix: bound Iceberg Bloom synthetic NDV search
  NikitaMatskevich
  committed
  28a2d08
- bench: compare native Iceberg Bloom writes
  NikitaMatskevich
  committed
  51f79aa
- bench: remove one-off Bloom measurement runner
  NikitaMatskevich
  committed
  47da284
- fix: limit native Bloom writes to modern Iceberg runtimes
  NikitaMatskevich
  committed
  ed02405
- fix: remove redundant interpolation in Bloom write test
  NikitaMatskevich
  committed
  c07c70b
- fix: remove unused Bloom test callback parameters
  NikitaMatskevich
  committed
  a60972c
- docs: align Bloom eligibility with supported Spark profiles
  NikitaMatskevich
  committed
  c978871
- test: use physical Bloom names on Iceberg 1.5
  NikitaMatskevich
  committed
  1c3aeca
- fix: normalize legacy Iceberg Bloom paths
  NikitaMatskevich
  committed
  a1bc043
- fix: fall back for colliding legacy Bloom aliases
  NikitaMatskevich
  committed
  810faed
- fix: preserve legacy Bloom lookup validation
  NikitaMatskevich
  committed
  96a15e6
- fix: retain independent legacy Bloom FPP validation
  NikitaMatskevich
  committed
  7e6d4bd
- feat: enable safeguarded native Bloom writes on legacy Iceberg
  NikitaMatskevich
  committed
  35d0d3c
- test: cover legacy Bloom caps without NDV support
  NikitaMatskevich
  committed
  32f9ceb
- docs: describe native Bloom support on legacy Iceberg
  NikitaMatskevich
  committed
  f1a0b50
- docs: clarify Iceberg 1.6 and 1.7 Bloom properties
  NikitaMatskevich
  committed
  9bba89c
- refactor: share configured Bloom column discovery
  NikitaMatskevich
  committed
  9f3853e
- refactor: report Bloom path fallback reasons directly
  NikitaMatskevich
  committed
  b3d2822
- docs: document legacy Iceberg validation commands
  NikitaMatskevich
  committed
  333a123

Commits

Commits on Nov 10, 2026