Skip to content

⚡ Bolt: Optimize bulk database inserts - #316

Open
crabcanon wants to merge 1 commit into
mainfrom
bolt-optimize-bulk-inserts-10202677007721395033
Open

crabcanon wants to merge 1 commit into
mainfrom
bolt-optimize-bulk-inserts-10202677007721395033

Conversation

@crabcanon

Copy link
Copy Markdown
Owner

💡 What: Replaced individual add() calls inside loops with add_many() for bulk inserts of DocumentArtifacts, DocumentTags, DocumentChunks, and SearchHits.
🎯 Why: To fix N+1 query patterns during bulk insertions. Using add() in a loop triggers per-record flush() and refresh(). add_many() executes a single session.flush() and skips session.refresh(), making it significantly faster for bulk operations.
📊 Impact: Reduces database query overhead and speeds up the parsing and knowledge search endpoints by eliminating unnecessary per-record flushes.
🔬 Measurement: Run the test suite and verify no regressions. Profile the parsing and knowledge search endpoints before and after to observe the reduction in database queries.


PR created automatically by Jules for task 10202677007721395033 started by @crabcanon

Replaced individual `session.add()` calls inside loops with `session.add_all()` wrapped in `add_many()` method on repositories to execute a single `await session.flush()` instead of triggering per-record flush and refresh.

Co-authored-by: crabcanon <3458947+crabcanon@users.noreply.github.com>
@google-labs-jules

Copy link
Copy Markdown

👋 Jules, reporting for duty! I'm here to lend a hand with this pull request.

When you start a review, I'll add a 👀 emoji to each comment to let you know I've read it. I'll focus on feedback directed at me and will do my best to stay out of conversations between you and other bots or reviewers to keep the noise down.

I'll push a commit with your requested changes shortly after. Please note there might be a delay between these steps, but rest assured I'm on the job!

For more direct control, you can switch me to Reactive Mode. When this mode is on, I will only act on comments where you specifically mention me with @jules. You can find this option in the Pull Request section of your global Jules UI settings. You can always switch back!

New to Jules? Learn more at jules.google/docs.


For security, I will only act on instructions from the user who triggered this task.

@vercel

vercel Bot commented Oct 20, 2026 •

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
cortex Ready Ready Preview Oct 20, 2026 8:02pm UTC

This branch was successfully deployed

1 active deployment
Preview — 5eda07af Deployed Oct 20, 2026 by vercel[bot]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant