Skip to content

Track peak memory in join benchmarks - #24731

Open
PointKernel wants to merge 2 commits into
NVIDIA:mainfrom
PointKernel:bench/join-memory-cpp-20261020
Open

PointKernel wants to merge 2 commits into
NVIDIA:mainfrom
PointKernel:bench/join-memory-cpp-20261020

Conversation

@PointKernel

@PointKernel PointKernel commented Oct 20, 2026 •

Copy link
Copy Markdown
Member

Description

This PR adds peak-memory tracking to the remaining join benchmarks, compiles the JIT filter benchmark as C++, and skips invalid multiplicity configurations.

Contributes to #10528; depends on #24730.

Checklist

  • I am familiar with the Contributing Guidelines.
  • New or existing tests cover these changes.
  • The documentation is up to date with these changes.

@copy-pr-bot

copy-pr-bot Bot commented Oct 20, 2026

Copy link
Copy Markdown

Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually.

Contributors can view more details about this message here.

@github-actions github-actions Bot added libcudf Affects libcudf (C++/CUDA) code. CMake CMake build issue labels Oct 20, 2026
@PointKernel PointKernel changed the title [BENCH] Track peak memory in join benchmarks Track peak memory in join benchmarks Oct 21, 2026
@PointKernel PointKernel added feature request New feature or request non-breaking Non-breaking change labels Oct 21, 2026
@PointKernel

Copy link
Copy Markdown
Member Author

/ok to test a504968

@PointKernel
PointKernel marked this pull request as ready for review October 21, 2026 18:25
@PointKernel
PointKernel requested review from a team as code owners October 21, 2026 18:25
@coderabbitai

coderabbitai Bot commented Oct 21, 2026 •

Copy link
Copy Markdown

Review in Change Stack →

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration
  • Configuration used: Repository: NVIDIA/cudf/.coderabbit.yaml
  • Review profile: CHILL
  • Plan: Enterprise
  • Run ID: d9fdd25f-572e-4b4a-922a-2e4e1e6f1a8e
📥 Commits

Reviewing files that changed from the base of the PR and between 8fc209e and a504968.

📒 Files selected for processing: 8
  • cpp/benchmarks/CMakeLists.txt
  • cpp/benchmarks/join/direct_join.cu
  • cpp/benchmarks/join/filter_join_indices_jit.cpp
  • cpp/benchmarks/join/join_common.hpp
  • cpp/benchmarks/join/join_heuristics.cpp
  • cpp/benchmarks/join/join_on_int32.cu
  • cpp/benchmarks/join/key_remap_build.cpp
  • cpp/benchmarks/join/sort_merge_join.cpp

Included review availability: This review used your included allowance. Your plan provides up to 12 included reviews per hour; 11 remain after this review.

📝 Summary

Summary by CodeRabbit

  • New Features

    • Join benchmarks now report peak GPU memory usage alongside existing performance metrics.
    • Memory tracking is available across direct join, filtered join, heuristic, INT32, key-remapping, and sort-merge join benchmarks.
  • Bug Fixes

    • Join benchmarks now skip invalid configurations where the requested multiplicity exceeds the available build-side rows.
  • Chores

    • Updated the JOIN benchmark build target to use the correct implementation source.

Join benchmarks now record peak memory usage. The shared join benchmark skips cases where multiplicity exceeds right_size. The JOIN benchmark target now compiles the JIT filter benchmark’s C++ source.

Changes: Join benchmark updates

Layer / File(s) Summary
Shared join validation and memory metrics
cpp/benchmarks/join/join_common.hpp, cpp/benchmarks/join/direct_join.cu
BM_join skips when multiplicity exceeds right_size. Both benchmarks record peak memory usage.
JIT filter benchmark source and metric
cpp/benchmarks/CMakeLists.txt, cpp/benchmarks/join/filter_join_indices_jit.cpp
The JOIN target uses the .cpp source. The filter benchmark records peak memory usage.
Additional join benchmark memory metrics
cpp/benchmarks/join/join_heuristics.cpp, cpp/benchmarks/join/join_on_int32.cu, cpp/benchmarks/join/key_remap_build.cpp, cpp/benchmarks/join/sort_merge_join.cpp
The heuristics, INT32 join, key remapping, and sort-merge benchmarks record peak memory usage.

Priority: ⬇️ Low

Estimated code review effort: 2 (Simple) | ~10 minutes

Change: Feature

Suggested reviewers: davidwendt, vyasr

Merge Risk: ⚪ Minimal · up to a5049

No merge-blocking risk is established by the reviewed changes.

Pre-merge checks: Passed 4 · Failed 1

Failed Failed checks: 1 warning

Check name Status Explanation Resolution
Docstring Coverage Warning Docstring coverage is 14.29% which is insufficient. The required threshold is 80.00%. Docstring coverage is scoped to functions touched by this diff. Analyzed 7 functions across 7 files. (1 skipped: 1… Write docstrings for the functions missing them to satisfy the coverage threshold.
Passed Passed checks: 4 passed
Check name Status Explanation
Title check Passed The title clearly and concisely describes the primary change: tracking peak memory in join benchmarks. It also covers the main objective of the pull request.
Linked Issues check Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check Passed Check skipped because no linked issues were found for this pull request.
Description check Passed The pull request description directly matches the changes. It covers peak-memory tracking, C++ compilation for the JIT filter benchmark, and invalid multiplicity handling.
Full details: Docstring Coverage

Explanation

Docstring coverage is 14.29% which is insufficient. The required threshold is 80.00%. Docstring coverage is scoped to functions touched by this diff. Analyzed 7 functions across 7 files. (1 skipped: 1 unsupported.)

Resolution

Write docstrings for the functions missing them to satisfy the coverage threshold.

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create a new PR
  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Comment @coderabbitai help to get the list of available commands.

rapids-bot Bot pushed a commit that referenced this pull request Oct 23, 2026
Closes #10528; depends on #24731.

This PR adds peak-memory tracking to the remaining non-join NVBench benchmarks. It also routes device pack, list scatter, and Thrust iterator allocations through the tracked resource, and excludes string replacement and repetition setup from memory tracking.

This also corrects two inherited benchmark inconsistencies: the Thrust iterator reductions now honor the configured RMM resource, and `replace` with `api=multi` constructs its target/replacement columns outside the timed callback. These changes alter existing runtime baselines, so lower timings across this PR should not be interpreted as libcudf algorithm speedups. Treat this commit as a baseline change for those cases; the [before/after measurements and allocator controls](#24786 (comment)) quantify the effect.

Authors:
  - Yunsong Wang (https://github.com/PointKernel)

Approvers:
  - Muhammad Haseeb (https://github.com/mhaseeb123)
  - Matt Gara (https://github.com/mattgara)

URL: #24786
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CMake CMake build issue feature request New feature or request libcudf Affects libcudf (C++/CUDA) code. non-breaking Non-breaking change

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants