Skip to content

llama: in-place recurrent (GDN) state update for multi-sequence decode + lazily zeroed RS buffer - #207

Open
alenizy361 wants to merge 4 commits into
PrismML-Eng:prismfrom
alenizy361:gdn-inplace-state
Open

alenizy361 wants to merge 4 commits into
PrismML-Eng:prismfrom
alenizy361:gdn-inplace-state

memory-recurrent: lazily zeroed anonymous-mmap RS buffer on the CPU host

c875ea4
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 warning
labeler
succeeded Sep 19, 2026 in 26s