Repository navigation
feat(runtime-iree-android): IreeModuleRunner — a generic single-shot runner for batch modules - #513
Merged
Merged
Conversation
libskainet_iree_module.so (arm64-v8a, armeabi-v7a; local-task and vulkan) runs one compiled module's function: one float32 tensor in, one out, with weights optionally bound from an .irpa (scope "model") through io_parameters. IreeModuleRunner and FloatTensor wrap it; nothing in it is model-specific. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
IreeModuleRunnerDeviceTest (connectedAndroidTest) fetches cases.json and its files from the host over adb reverse, runs each case and compares it with the reference (rtol/atol), logging max |delta| and p50/p95 latency. Skips when no server is reachable. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
michalharakal
force-pushed
the
feature/iree-module-runner
branch
from
October 21, 2026 21:00
8407c2b to
2699285
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
A generic single-shot runner for one compiled IREE module: one float32 tensor in, one float32 tensor
out, weights from an optional
.irpa(scopemodel). Two commits, rebased onto develop (post-0.62.2).What it is
IreeModuleRunner(Kotlin) +libskainet_iree_module.so(arm64-v8a,armeabi-v7a; CPUlocal-taskand Vulkan drivers): open a.vmfb(+ optional parameter archive), invoke one entryfunction,
FloatTensor(data + shape) in/out.detection-yolov8-ireeblueprint extracts the.sofrom this AAR(same pattern as Moonshine) and binds
YoloV8Cartridgeover the runner.IreeModuleRunnerDeviceTest: an instrumentation check over served module cases (host serves thecases,
adb reverse), exercising both drivers.Verification
Vulkan; the YOLOv8n head 0/705,600 values outside rtol/atol 1e-2 vs ONNX Runtime
(max|Δ| CPU 0.0018, Vulkan 0.0032); head p50 CPU 2000 ms, Vulkan 205 ms.
1 bus with identical scores; app-level p50 269 ms (Vulkan) / 2205 ms (CPU).
🤖 Generated with Claude Code