Skip to content

qwen27 CUDA: a pre-sm_90 decode matmul, ~52% faster serving on an RTX 3090 (exact; stacked on #3) - #4

Closed
CanadaApollo6 wants to merge 6 commits into
machinegenieorg:see-4347-qwen27-cudafrom
CanadaApollo6:sm86-qmm-lane
Closed

qwen27 CUDA: a pre-sm_90 decode matmul, ~52% faster serving on an RTX 3090 (exact; stacked on #3)#4
CanadaApollo6 wants to merge 6 commits into
machinegenieorg:see-4347-qwen27-cudafrom
CanadaApollo6:sm86-qmm-lane

qwen27 CUDA: a pre-sm_90 decode matmul (qmm_lane), one launch for wei…

083532c
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs