Skip to content

perf(phi4_multimodal): prefill and decode over the cached prefix, not the whole KV allocation - #2202

Merged
chaofengw-nv merged 2 commits into
NVIDIA:mainfrom
chaofengw-nv:perf/phi4mm-prefill-cache-rows
Nov 11, 2026
Merged

chaofengw-nv merged 2 commits into
NVIDIA:mainfrom
chaofengw-nv:perf/phi4mm-prefill-cache-rows

perf(phi4_multimodal): decode over the cached prefix, not the whole K…

d8d899f
Select commit
Loading
Failed to load commit list.