Skip to content

Share table metadata across rows in each chunk - #272

Merged
serprex merged 1 commit into
mainfrom
split/row-tables
Nov 4, 2026
Merged

serprex merged 1 commit into
mainfrom
split/row-tables

Conversation

@serprex

@serprex serprex commented Oct 22, 2026 •

Copy link
Copy Markdown
Member

Each routed row held its own references to shared table metadata and
looked up its encoder by table key. This repeated reference counting
and hashing for every row.

Store metadata in each chunk and let rows refer to it by index. Look
up encoders once per chunk entry. Reuse table lookups during bootstrap
and WAL replay, and share deferred replay's memory permit across chunks.

@serprex
serprex force-pushed the split/row-chunks branch 3 times, most recently from 568d6b6 to 02947c2 Compare October 23, 2026 02:49
Base automatically changed from split/row-chunks to main October 23, 2026 21:31
@serprex
serprex requested a review from harshil-goel November 3, 2026 11:53
Each routed row held its own references to shared table metadata and
looked up its encoder by table key. This repeated reference counting
and hashing for every row.

Store metadata in each chunk and let rows refer to it by index. Look
up encoders once per chunk entry. Reuse table lookups during bootstrap
and WAL replay, and share deferred replay's memory permit across chunks.
@serprex serprex changed the title Index routed rows into per-chunk tables Share table metadata across rows in each chunk Nov 3, 2026
@serprex
serprex requested a review from iskakaushik November 3, 2026 12:06
@serprex
serprex merged commit e58abbb into main Nov 4, 2026
6 checks passed
@serprex
serprex deleted the split/row-tables branch November 4, 2026 04:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants