Skip to content

Detect NVSHMEM static heap fallback to enable symmetric heap size hints. - #164

Merged
romerojosh merged 3 commits into
mainfrom
detect_nvshmem_vmm_fallback
Oct 7, 2026
Merged

romerojosh merged 3 commits into
mainfrom
detect_nvshmem_vmm_fallback

Conversation

@romerojosh

Copy link
Copy Markdown
Collaborator

On platforms that do not support GDRDMA with VMM memory (e.g. NVIDIA Spark GB10), NVSHMEM will fallback to using a static symmetric heap, even if NVSHMEM_DISABLE_CUDA_VMM is unset. However, cuDecomp's useful warning messages on allocation failures due to an incorrectly sized heap are only active when a user explicitly forces NVSHMEM to use a static heap via NVSHMEM_DISABLE_CUDA_VMM.

This PR attempts to detect systems where NVSHMEM will fallback to a static heap, based on the current implementation, to enable these useful error messages.

Signed-off-by: Josh Romero <joshr@nvidia.com>
@romerojosh

Copy link
Copy Markdown
Collaborator Author

/build

@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown

🚀 Build workflow triggered! View run

Signed-off-by: Josh Romero <joshr@nvidia.com>
@github-actions

github-actions Bot commented Oct 7, 2026

Copy link
Copy Markdown

✅ Build workflow passed! View run

@romerojosh
romerojosh merged commit 15db402 into main Oct 7, 2026
4 checks passed
@romerojosh
romerojosh deleted the detect_nvshmem_vmm_fallback branch October 7, 2026 17:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant