Skip to content

feat(gateway): opt in to live cloud model discovery (#628) - #1236

Draft
oxa-agent[bot] wants to merge 5 commits into
mainfrom
agent/628-live-cloud-models
Draft

oxa-agent[bot] wants to merge 5 commits into
mainfrom
agent/628-live-cloud-models

Conversation

@oxa-agent

@oxa-agent oxa-agent Bot commented Nov 17, 2026 •

Copy link
Copy Markdown
Contributor

Owner decision requested for #628. May an unknown provider price be admitted only when the owner supplies conservative prices for reservation and settlement? Which authenticated owner entry point should expose the merged HTTP catalog, given that #688's guest listener intentionally exposes only the guest allowlist?

Feature F · Rust product · T3

Refs #628, #1214 and the Python port ledger entry for oxc/src/oxc/runtime/cloud_prices.py. Incorporates the archived #876 catalog cache work from archive/pr-960.

The native gateway discovers the key-scoped OpenRouter, OpenAI and Anthropic catalogs when the owner opts in. The picker and --list-models use the merged results. Configured metadata supplies limits and prices the provider omits. Unknown prices and limits are reported. Provider requests and cache refresh stay off the inference path.

OpenCode Go uses the same bounded, private, credential-scoped cache. Cached payloads are authenticated, validated against the current key and replaced atomically. The archived file and runtime controls were adapted to the new key scope and the reused mock endpoints.

The draft still needs the owner HTTP listing and an explicit unknown-price admission decision. The current gateway requires a budget-enforceable price for paid inference.

Verification

  • Hosted lane 44193456342 passed on x86_64 and ARM64 at dfcc2d83, covering the archived cache adaptation and Go path.
  • Hosted lane 44195367344 passed on x86_64 and ARM64 at c3e0cfa5, with synthetic loopback CLI controls for OpenRouter, OpenAI and Anthropic.

The price overlay preserves configured long-context tiers and keeps a zero live rate from lowering a configured rate. OpenRouter cache read and write prices use the same validated pricing path. Hosted control 44199480550 reproduced the lost tiers at 45f209f5. Hosted lane 44201059399 passed at 428eaa4f02dddd8f9969365d1d862187c1136412 for the selected oxa and oxc-rs jobs on x86_64 and ARM64.

Integration after #1237 landed

A normal merge of main 3b6719cd resolved actual dispatch and engine-selection conflicts. The interactive session retains the landed shared native engine and effective timeout, and the picker and --list-models still receive discovery notices. All 18 discovery, cache, documentation and integration-test files outside the three composition files match the last qualified head byte-for-byte. The shared-engine unit uses the combined return type and checks that a local-only selection produces no cloud notices. Exact head 3aada4d3f2c43bc7456b3864b4b7de8397ce4c2a passed hosted lane 44211824063 on x86_64 and ARM64. Both oxa jobs passed 3,222 tests, with three skips, and passed the share-feature CLI controls. The selector covered oxa-cli, oxa-core, oxa-engine, oxa-interactive, oxa-parity, oxa-rpc, oxc-gateway and oxc-local; both oxc jobs passed too.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants