Repository navigation
test: validate four ATOM models over HTTP with device and host cache - #216
Draft
gspark-etri wants to merge 2 commits into
Draft
gspark-etri wants to merge 2 commits into
gspark-etri wants to merge 2 commits into
Conversation
This was referenced Oct 23, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Background
The GPU HTTP matrix did not establish ATOM request lifecycle or cache behavior. Extend the same production-factory harness to the four selected models: Qwen3-0.6B, Qwen3-4B, KONI-8B and Gemma3-1B.
Changes
Add an isolated ATOM backend option, artifact KV-block configuration and explicit host-cache checks. Publish measured results and limitations. Stacked on #213; engine prerequisite #210. The two
fixedevidence files include the independent HTTP disconnect fix in #215.Verification
opt_prime/examples/pd/http_matrix/experiments/2026-10-23-atom-http211.mdand JSON in evidence/.Compatibility and limits
GPU remains the default. ATOM precision comes from its artifact. Gemma uses corrected causal-prefill graphs and #210; hybrid prefix/host/PD restoration remains unsupported. KONI uses one KV block because the three-block graph does not compile. No general throughput claim from single bursts, no complete RNGD/heterogeneous validation, and no real compute/transfer overlap claim.
Related Issue
Related to #211, #201, #207 and #208. Full matrix remains ongoing.
AI-assisted implementation and verification with Codex; maintainer review and merge required.