diff --git a/public/llms.txt b/public/llms.txt index f38d40a..1324f78 100644 --- a/public/llms.txt +++ b/public/llms.txt @@ -79,6 +79,7 @@ Current packages: crates.io Traverse at 0.14.0; npm `traverse-embedder-web@0.14. - [How do hosts trust signed models?](https://traverse-framework.com/questions/how-do-hosts-trust-signed-models.html): discover → execute → trace; one shared `runtime.wasm`; host-owned trust roots gate `register_package`; pin by digest + `model.sig.json`; test-only digits-mlp key; published exact-ref execute is native+web+Swift ExactModelHost (`swift-host-v0.14.0-4`); Kotlin and .NET ExactModelHost are on main, not in the published 0.14.0 packages (#1651) — no claimed ONNX generic runner. - [Which hosts run signed exact-ref models?](https://traverse-framework.com/questions/which-hosts-run-signed-exact-ref-models.html) · [Is production model signing ready?](https://traverse-framework.com/questions/is-production-model-signing-ready.html) · [Can Kotlin or .NET run exact-ref yet?](https://traverse-framework.com/questions/can-kotlin-or-dotnet-embedders-run-exact-ref-yet.html): discover → execute → trace; one shared `runtime.wasm`; published exact-ref is native + web 0.14.0 + Swift `swift-host-v0.14.0-4`; Kotlin and .NET ExactModelHost are on main (#1580, #1602 closed) and not in Maven/NuGet 0.14.0 (#1651); test-only key ≠ prod (#1567). - [What is ExactModelHost?](https://traverse-framework.com/questions/what-is-exact-model-host.html): host-side connector for governed exact-ref model packages (Spec 138). Register a signed package under host-owned trust roots, then execute under discover → execute → trace. Not a second runtime. Published: native connector + web `ExactModelBrowserHost` in 0.14.0 + Swift `ExactModelHost` on `swift-host-v0.14.0-4`. Kotlin/.NET ExactModelHost code is on main, not in Maven/NuGet 0.14.0 (#1651). Test-only digits-mlp key; prod signing #1567. Not catalog `model.execute`. Not Hugging Face. +- [Can Traverse run models on a GPU or the Apple Neural Engine?](https://traverse-framework.com/questions/can-traverse-run-models-on-a-gpu-or-neural-engine.html): not in a published release; v0.14.0 exact-ref models run on `wasm-cpu` in the one shared runtime. Unreleased on main (Decision 112, traverse#1667): host policy lists ordered placements (default `wasm-cpu`), on-device self-check against the variant's conformance vector, memory ceiling, fail-closed `placement_unavailable`, placement evidence in every result. No real accelerator adapter yet: Core ML conversion spike #1663, iPhone evidence #1630; no web/Android/desktop GPU adapter. - [What is digits-mlp?](https://traverse-framework.com/questions/what-is-digits-mlp.html): first trained exact-ref package in v0.14.0 (UCI digits MLP, 96.10% held-out, bit-identical); test-only signing; not a general LLM. - [Does the website use the latest traverse-embedder-web?](https://traverse-framework.com/questions/does-the-website-use-the-latest-traverse-embedder.html): site pins `^0.14.0` (matching npm) and `/discover` admits its signed demo fixture through `registerPackage`; the site can lag future releases, so product apps pin published packages, not the website demo. - [How does Traverse complement Hugging Face?](https://traverse-framework.com/questions/how-does-traverse-complement-hugging-face.html): Hub = provenance; Traverse = pinned signed client-first capability; not Transformers.js/Hub replacement; no defer promise until a second executor exists. diff --git a/src/pages/questions/can-traverse-run-models-on-a-gpu-or-neural-engine.astro b/src/pages/questions/can-traverse-run-models-on-a-gpu-or-neural-engine.astro new file mode 100644 index 0000000..42fe02f --- /dev/null +++ b/src/pages/questions/can-traverse-run-models-on-a-gpu-or-neural-engine.astro @@ -0,0 +1,52 @@ +--- +import QuestionLayout from '@layouts/QuestionLayout.astro'; + +const jsonLd = JSON.stringify({ + '@context': 'https://schema.org', + '@type': 'FAQPage', + mainEntity: [{ + '@type': 'Question', + name: 'Can Traverse run models on a GPU or the Apple Neural Engine?', + acceptedAnswer: { + '@type': 'Answer', + text: 'Not in a published release. In Traverse v0.14.0, governed exact-ref models run on the wasm-cpu path inside the one shared runtime. On traverse main (unreleased), the runtime now has a generic native accelerator adapter framework (Decision 112, Spec 138 FR-060 to FR-065): the host policy lists ordered placements, default wasm-cpu; a placement is chosen only if the host supports it, the signed package carries a variant for it, the variant passes an on-device self-check against its conformance vector, and it fits the host memory ceiling. If nothing qualifies, the call fails closed with placement_unavailable before the input is consumed, and the result records which placement ran. The real Core ML adapter is not landed yet: the conversion spike is #1663 and the iPhone evidence is #1630.', + }, + }], +}); + +const relatedLinks = [ + { href: '/questions/what-is-exact-model-host.html', label: 'What is ExactModelHost?' }, + { href: '/questions/what-is-exact-ref-model-execution.html', label: 'What is exact-ref model execution?' }, + { href: '/questions/which-hosts-run-signed-exact-ref-models.html', label: 'Which hosts run signed exact-ref models?' }, + { href: '/questions/what-happens-when-a-capability-runs-out-of-fuel-or-memory.html', label: 'What happens when a capability runs out of fuel or memory?' }, + { href: '/questions/is-there-a-performance-cost-to-running-the-same-binary-on-every-os.html', label: 'Is there a performance cost to running the same binary on every OS?' }, +]; +--- + +

Short answer: not in a published release. In Traverse v0.14.0, governed exact-ref models run on the wasm-cpu path inside the one shared runtime. Hardware acceleration is being built on traverse main, and the part that has landed is the policy and evidence layer, not a working GPU or Neural Engine adapter.

+ +

What is on main today (unreleased)

+

As of October 13, 2026, traverse-runtime on main has a generic native accelerator adapter framework (Decision 112, Spec 138 FR-060 to FR-065, traverse#1667). It is not in any published crate or package yet.

+ + +

What is not done yet

+

No real accelerator adapter has landed. The first one planned is Core ML on Apple devices, called from Rust. An earlier converter wrapped ONNX in a way Core ML could only run on the CPU, so it is being replaced through a spike-gated ONNX to Core ML route (#1663), with on-device iPhone timing evidence tracked in #1630. There is no GPU adapter for the web, Android, or desktop, and no date for one.

+ +

Why it is built this way

+

An accelerator is an implementation detail of the host, not a second runtime. The contract, the signed package, and discover → execute → trace stay the same. The adapter only runs a variant the package already signed, only after it matched the wasm-cpu reference on that device, and the trace records which path produced the answer. An agent or app can ask for speed, but the runtime decides whether the faster path is trustworthy on this hardware.

+ +

This is a different thing from capability placement targets (local, browser, and so on), which decide where a capability can be placed. Model placements decide which compute path runs a signed model inside a host.

+ diff --git a/src/pages/questions/index.astro b/src/pages/questions/index.astro index a1920b1..51ab71c 100644 --- a/src/pages/questions/index.astro +++ b/src/pages/questions/index.astro @@ -58,6 +58,7 @@ const groups = [ ['what-is-one-shared-runtime-wasm.html', 'What is one shared runtime.wasm in Traverse?'], ['does-the-rust-embedder-use-the-same-runtime-wasm.html', 'Does the Rust embedder use the same runtime.wasm?'], ['what-is-exact-model-host.html', 'What is ExactModelHost?'], + ['can-traverse-run-models-on-a-gpu-or-neural-engine.html', 'Can Traverse run models on a GPU or the Apple Neural Engine?'], ['how-does-traverse-execute-wasm.html', 'How does Traverse execute WASM?'], ['can-traverse-run-without-wasm.html', 'Can Traverse run without WASM?'], ['what-is-the-capability-registry.html', 'What is the capability registry?'], diff --git a/src/pages/questions/what-is-exact-model-host.astro b/src/pages/questions/what-is-exact-model-host.astro index 986c9d0..b9cdd0b 100644 --- a/src/pages/questions/what-is-exact-model-host.astro +++ b/src/pages/questions/what-is-exact-model-host.astro @@ -20,6 +20,7 @@ const relatedLinks = [ { href: '/questions/how-do-hosts-trust-signed-models.html', label: 'How do hosts trust signed models?' }, { href: '/questions/is-production-model-signing-ready.html', label: 'Is production model signing ready?' }, { href: '/questions/can-kotlin-or-dotnet-embedders-run-exact-ref-yet.html', label: 'Can Kotlin or .NET run exact-ref yet?' }, + { href: '/questions/can-traverse-run-models-on-a-gpu-or-neural-engine.html', label: 'Can Traverse run models on a GPU or Neural Engine?' }, ]; ---