Training models with ternary quantized weights using PyTorch
-
Updated
Jun 12, 2019 - Python
Training models with ternary quantized weights using PyTorch
n0x CLI is my go-to Claude Code alternative when I’m on a budget.
Pre-quantized ternary models for VLMs, multimodal, and audio — the models GGUF can't touch
1.58-bit ternary Mamba LLM for Indian languages. Weights are {-1,0,+1} — inference uses only add/sub. 3B model fits in 750MB, runs 20+ tok/s on mobile.
Selective ternary compression of Qwen3.6 MoE expert projections on Apple Silicon, with matched-control functional, routing, and perplexity evaluation.
Research implementation of activation-aware ternary and mixed-bit quantization for Qwen3.8-27B, targeting 7-9 GB text inference on 16 GB GPUs.
Colab-friendly BitNet distillation engine: collect KD traces from a teacher, train a ternary Mini-BitNet, and dry-run 7B memory. Multi-provider + Drive/S3
Anonymous paper release for TRACE-Q, a topology-aware ternary quantization framework for heterogeneous language models.
PILON (Primitive-Induced Linear Operator Network) explores a compositional weight parameterization for transformer FFN layers. The goal is to replace dense FFN matrices with shared low-rank primitives plus learned composition weights.
Apple Silicon MLX low-bit ternary (BitNet b1.58 {-1,0,+1}) quantization, Metal GPU kernels, perplexity benchmarking, the cogito corpus pipeline
Add a description, image, and links to the ternary-quantization topic page so that developers can more easily learn about it.
To associate your repository with the ternary-quantization topic, visit your repo's landing page and select "manage topics."