Skip to content

feat(inference): support workload identity federation - #306

Merged
danielkov merged 7 commits into
mainfrom
feat/inference-workload-federation
Oct 24, 2026
Merged

danielkov merged 7 commits into
mainfrom
feat/inference-workload-federation

Conversation

@danielkov

@danielkov danielkov commented Oct 23, 2026 •

Copy link
Copy Markdown
Contributor

Summary

Add provider-scoped workload identity authentication for OpenRouter and Speakeasy inference. CLI configuration selects an explicit completion endpoint and an RFC 7523 JWT-bearer or RFC 8693 token-exchange grant backed by a rotating assertion file.

Technical details

Configured providers use the shared workload-token session through asynchronous request authentication, without API-key or browser fallback. Streaming and nonstreaming inference disable automatic replay and redact upstream refusal details; legacy API-key behavior is preserved. Runtime sessions, model changes, and forks retain the provider-specific authentication configuration.

Speakeasy's ordinary-workload inference path requires speakeasy-api/gram#8012; this does not replace managed assistant credentials.

@kit-code-agent kit-code-agent Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Federated inference ignores configured request budgets, retains refused cached tokens, and hides safe local authentication diagnostics. Two additional issues affect request-header conformance and mixed-credential catalog refreshes.

Took 23 min

Comment thread src/provider/adapter.rs
Comment thread src/provider/inference.rs
Comment thread src/provider/inference.rs
Comment thread src/provider/adapter.rs Outdated
Comment thread src/provider/adapter.rs
Comment thread docs/user/getting-started-and-configuration.md Outdated
Comment thread docs/user/getting-started-and-configuration.md

@kit-code-agent kit-code-agent Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No issues found. The changes look good to merge.

Took 10 min

kit-code-agent[bot]
kit-code-agent Bot previously approved these changes Oct 23, 2026

@kit-code-agent kit-code-agent Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No issues found. The changes look good to merge.

Took 5 min 45 sec

@danielkov
danielkov force-pushed the feat/inference-workload-federation branch from ee050e2 to 7589544 Compare October 24, 2026 09:19
@danielkov
danielkov changed the base branch from feat/mcp-token-exchange to main October 24, 2026 09:19
@danielkov
danielkov dismissed kit-code-agent[bot]鈥檚 stale review October 24, 2026 09:19

The base branch was changed.

@kit-code-agent kit-code-agent Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No issues found. The changes look good to merge.

Took 10 min

@danielkov
danielkov merged commit 6f15787 into main Oct 24, 2026
7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant