Skip to content

Apple Silicon host support + generous startup timeout - #43

Merged
anianroid merged 1 commit into
mainfrom
feat/apple-silicon-host
Aug 4, 2026
Merged

anianroid merged 1 commit into
mainfrom
feat/apple-silicon-host

Conversation

@anianroid

Copy link
Copy Markdown
Collaborator

Un-gates macOS/Metal as a host, verified end to end on a real M4 (16GB): doctor detects vendor=apple, budgets 65% of unified memory (16GB→7B, 64GB→32B), resolves the bare darwin/arm64 Metal runtime, adds 'apple' to the heartbeat gpu_vendor enum (was closed — would have rejected every Apple heartbeat; D-115). Plus a startup-timeout fix found on the first Apple host: 30s health-check gave up while a 7B cold-loaded on Metal — raised to 5min, crashes still fail fast (2 new launcher tests). Verified live: doctor, auto-select, run-local Metal generation, node AVAILABLE serving Qwen. Full matrix green, no new migration.

Apple/Metal hosts: doctor detects vendor=apple via system_profiler+sysctl,
budgets 65% of unified memory as the GPU working set (no discrete VRAM),
resolves the bare darwin/arm64 runtime (Metal, no backend suffix), and adds
'apple' to the heartbeat gpu_vendor enum (was closed to nvidia/amd/unknown —
would have rejected every Apple heartbeat). Verified live on an M4.

Runtime startup timeout raised 30s -> 5min: cold-loading a model on Metal
(shader compilation + GBs into unified memory) exceeded 30s and the node
errored while the model was still loading fine. Crashes still fail fast via
process-exit detection. Found on the first real Apple host.
@anianroid
anianroid merged commit f12bf6c into main Aug 4, 2026
8 checks passed
@anianroid
anianroid deleted the feat/apple-silicon-host branch August 5, 2026 05:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant