Skip to content

fix: use hardware concurrency for automatic CPU threads - #71

Merged
zhenghaoz merged 3 commits into
mainfrom
fix/physical-core-threads
Nov 7, 2026
Merged

zhenghaoz merged 3 commits into
mainfrom
fix/physical-core-threads

Conversation

@zhangzhenghao

@zhangzhenghao zhangzhenghao commented Nov 7, 2026 •

Copy link
Copy Markdown
Collaborator

Summary

  • Use std::thread::hardware_concurrency() for automatic CPU inference threads, guarded to at least one thread and without the previous eight-thread cap.
  • Preserve explicit positive thread overrides and existing Python/Node/CLI API capabilities.
  • Python/Node tests and examples, and documented CLI examples, omit explicit thread arguments.
  • Delete the requested README paragraph without replacement.
  • Remove tests/cpu-threads-runtime-test.cpp and its CMake registration as requested.

Verification

  • Latest update: reconfigured and rebuilt the Linux Release static build; CTest 33/33 passed.
  • Earlier revision: shared CTest 32/32 passed, actual published-model Python/Node tests passed, and all nine remote CI checks passed.
  • CI for the latest test-removal commit is pending; earlier CI results do not verify the new head.

@zhangzhenghao zhangzhenghao changed the title fix: default CPU inference to physical core count fix: use hardware concurrency for automatic CPU threads Nov 7, 2026
@zhenghaoz
zhenghaoz merged commit c285c46 into main Nov 7, 2026
9 checks passed
@zhenghaoz
zhenghaoz deleted the fix/physical-core-threads branch November 7, 2026 01:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants