Deterministic Local LLM Infrastructure & Anti-Cheat Evaluation
| Project |
Stack |
Purpose |
| Vibe Bench |
Python · Cloudflare D1 · Rust |
Deterministic 18-pillar & anti-cheat evaluation suite for Dense & MoE local LLMs (IQ1–Q8_0). |
| Vibe Router |
Rust |
High-throughput local & hybrid LLM gateway with schema enforcement and intelligent routing. |
| Vibe Local |
Rust · llama.cpp |
Zero-bloat local inference runtime tuned for consumer GPUs and unified memory. |
| Vibe Assembly |
Rust · Android / Desktop |
Native agentic workspace with deterministic file patching (FNV-1a). |
- Measure the Cliff, Not Just the Peak: Full quantization profiling down to
IQ1 and Q2 to expose tool-suppression, syntax failures, and infinite <think> loops before deployment.
- Zero-Contamination Verification: Procedural state-machine tracing and private multi-constraint evaluations paired with deterministic code/AST graders.
- Hardware-Aware Telemetry: Real
PP/TG tok/s, KV-Cache quantization impact, and VRAM budgets across Dense and MoE architectures.