Skip to content

[OMNIML-6227] Convert GGML checkpoints to INT8 compressed-tensors for vLLM - #2903

Merged
cjluo-nv merged 7 commits into
mainfrom
chenjiel/ggml-int8-export
Oct 21, 2026
Merged

[OMNIML-6227] Convert GGML checkpoints to INT8 compressed-tensors for vLLM#2903
cjluo-nv merged 7 commits into
mainfrom
chenjiel/ggml-int8-export

Run the converter with sys.executable in the vLLM example test

d1dad23
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Oct 21, 2026 in 0s

DCO

All commits are signed off!

View more details on DCO