Repository navigation
feat(gateway): opt in to live cloud model discovery (#628) - #1236
Draft
oxa-agent[bot] wants to merge 5 commits into
Draft
oxa-agent[bot] wants to merge 5 commits into
oxa-agent[bot] wants to merge 5 commits into
Conversation
added 5 commits
November 17, 2026 23:47
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Owner decision requested for #628. May an unknown provider price be admitted only when the owner supplies conservative prices for reservation and settlement? Which authenticated owner entry point should expose the merged HTTP catalog, given that #688's guest listener intentionally exposes only the guest allowlist?
Feature F · Rust product · T3
Refs #628, #1214 and the Python port ledger entry for
oxc/src/oxc/runtime/cloud_prices.py. Incorporates the archived #876 catalog cache work fromarchive/pr-960.The native gateway discovers the key-scoped OpenRouter, OpenAI and Anthropic catalogs when the owner opts in. The picker and
--list-modelsuse the merged results. Configured metadata supplies limits and prices the provider omits. Unknown prices and limits are reported. Provider requests and cache refresh stay off the inference path.OpenCode Go uses the same bounded, private, credential-scoped cache. Cached payloads are authenticated, validated against the current key and replaced atomically. The archived file and runtime controls were adapted to the new key scope and the reused mock endpoints.
The draft still needs the owner HTTP listing and an explicit unknown-price admission decision. The current gateway requires a budget-enforceable price for paid inference.
Verification
dfcc2d83, covering the archived cache adaptation and Go path.c3e0cfa5, with synthetic loopback CLI controls for OpenRouter, OpenAI and Anthropic.The price overlay preserves configured long-context tiers and keeps a zero live rate from lowering a configured rate. OpenRouter cache read and write prices use the same validated pricing path. Hosted control 44199480550 reproduced the lost tiers at
45f209f5. Hosted lane 44201059399 passed at428eaa4f02dddd8f9969365d1d862187c1136412for the selected oxa and oxc-rs jobs on x86_64 and ARM64.Integration after #1237 landed
A normal merge of main
3b6719cdresolved actual dispatch and engine-selection conflicts. The interactive session retains the landed shared native engine and effective timeout, and the picker and--list-modelsstill receive discovery notices. All 18 discovery, cache, documentation and integration-test files outside the three composition files match the last qualified head byte-for-byte. The shared-engine unit uses the combined return type and checks that a local-only selection produces no cloud notices. Exact head3aada4d3f2c43bc7456b3864b4b7de8397ce4c2apassed hosted lane 44211824063 on x86_64 and ARM64. Both oxa jobs passed 3,222 tests, with three skips, and passed the share-feature CLI controls. The selector coveredoxa-cli,oxa-core,oxa-engine,oxa-interactive,oxa-parity,oxa-rpc,oxc-gatewayandoxc-local; bothoxcjobs passed too.