Skip to content

perf(qwen27 cuda): reduce TTFT with prompt caching and state reuse - #2

Open
jregan-beasley-smc wants to merge 4 commits into
machinegenieorg:see-4347-qwen27-cudafrom
jregan-beasley-smc:perf/qwen27-exact-prompt-cache
Open

jregan-beasley-smc wants to merge 4 commits into
machinegenieorg:see-4347-qwen27-cudafrom
jregan-beasley-smc:perf/qwen27-exact-prompt-cache

Commits

  1. Commits on Oct 11, 2026