Repository navigation
Apple Silicon host support + generous startup timeout - #43
Merged
Merged
Conversation
Apple/Metal hosts: doctor detects vendor=apple via system_profiler+sysctl, budgets 65% of unified memory as the GPU working set (no discrete VRAM), resolves the bare darwin/arm64 runtime (Metal, no backend suffix), and adds 'apple' to the heartbeat gpu_vendor enum (was closed to nvidia/amd/unknown — would have rejected every Apple heartbeat). Verified live on an M4. Runtime startup timeout raised 30s -> 5min: cold-loading a model on Metal (shader compilation + GBs into unified memory) exceeded 30s and the node errored while the model was still loading fine. Crashes still fail fast via process-exit detection. Found on the first real Apple host.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Un-gates macOS/Metal as a host, verified end to end on a real M4 (16GB): doctor detects vendor=apple, budgets 65% of unified memory (16GB→7B, 64GB→32B), resolves the bare darwin/arm64 Metal runtime, adds 'apple' to the heartbeat gpu_vendor enum (was closed — would have rejected every Apple heartbeat; D-115). Plus a startup-timeout fix found on the first Apple host: 30s health-check gave up while a 7B cold-loaded on Metal — raised to 5min, crashes still fail fast (2 new launcher tests). Verified live: doctor, auto-select, run-local Metal generation, node AVAILABLE serving Qwen. Full matrix green, no new migration.