Skip to content
#

weight-compression

Star

Here are 3 public repositories matching this topic...

Language: All
Filter by language
All 3 Rust 2 Cuda 1

VeyrForge / GreenCompress

Star 1

Post-training weight compression for low-RAM machines: Q4/Q8 quantization, green-format repair, AVX2 CPU inference, optional CUDA. ~45% less RAM at ~99.9% quality.

rust inference simd transformer neural-networks avx2 quantization int8 model-compression memory-optimization model-quantization post-training-quantization cpu-inference int4 llm gguf green-compression weight-compression low-memory-inference greencompress
  • Updated Jul 31, 2026
  • Rust

Add this topic to your repo

To associate your repository with the weight-compression topic, visit your repo's landing page and select "manage topics."

Learn more