Skip to content

server/llama: honor per-request speculative.n_max, per-sequence snapshot budget, honest rollback refusal (multi-slot decode with MTP) - #208

Open
alenizy361 wants to merge 15 commits into
PrismML-Eng:prismfrom
alenizy361:server-spec-multislot
Open

server/llama: honor per-request speculative.n_max, per-sequence snapshot budget, honest rollback refusal (multi-slot decode with MTP)#208
alenizy361 wants to merge 15 commits into
PrismML-Eng:prismfrom
alenizy361:server-spec-multislot

speculative: no rollback snapshot planes in the draft context

3ed7c43
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 warning
labeler
succeeded Sep 19, 2026 in 15s