Conversation
AngeLouCN
force-pushed
the
codex/infra-execution-smoke-pr
branch
from
September 30, 2026 20:38
cd4e17b to
3d48583
Compare
ZhiningLiu1998
marked this pull request as ready for review
October 1, 2026 01:02
AngeLouCN
force-pushed
the
codex/infra-execution-smoke-pr
branch
from
October 1, 2026 06:41
3d48583 to
77db932
Compare
Route text, media and prefix forwards through the existing adapter contract. Keep sequence hidden states in their native dtype and cast only the pointer readout vectors. Validate cache behavior and exact BF16 output/gradient parity; the CPU regression suite passes 303 tests.
Handle existing delimiter token schemas, expose frozen-weight precision and direct-token smoke, and reject incompatible direct-mode flags. Use tiny GLM dimensions validated for BF16 SDPA training and checkpoint reload on A100.
AngeLouCN
force-pushed
the
codex/infra-execution-smoke-pr
branch
from
October 1, 2026 07:00
77db932 to
95139d2
Compare
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Ordinary decision scoring retains unused generation caches and casts the entire sequence of hidden states to FP32, although the pointer head reads only selected vectors. Route text, media and prefix execution through
BackboneAdapter.forward, retain the backbone's native hidden-state dtype, and cast only the vectors needed by the pointer head. Ordinary scoring defaults touse_cache=False; explicit prefix reuse continues to request a cache.Extend the backbone smoke CLI with separate frozen-weight precision and decision-mode options. Handle tokenizers that reuse existing delimiter tokens without requiring
jevany_token_schemametadata, reject incompatible direct-token training flags, and use a tiny GLM fixture with dimensions previously verified for BF16 SDPA on A100.Validation on the restored two-commit branch:
python -m pytest tests -m 'not server' -q -ra --strict-config --strict-markers— 432 passed, 37 skipped, 7 deselected.python -m build --no-isolation— source distribution and wheel both built successfully.Base:
mainat625aed9.Candidate-token latency optimization and its accuracy/latency results are reviewed separately in #9.