expert-prefetch

Here are 2 public repositories matching this topic...

SuperMarioYL / xpref

v0.2.0: live attach now measures real next-token recall (was always 0.000); every prediction is prefetched exactly once (was doubled); n-gram prior fixed from inert exact-set matching to per-expert transitions — sample recall@16 0.7405→0.8154; quickstart attach command fixed; version bump across all surfaces + CHANGELOG.

inference moe nvme llm deepseek ai-radar kimi-k3 expert-prefetch router-logit moe-runtime

Updated Sep 8, 2026
Python

andreyivan4enkov / moe-orbit-prefetch

Star

Object A: MoE orbit prefetch — source+math+215KB trajectories+plots+sparse DeepSeek runtime (Apache-2.0). Analyze without weights; credit on substantial use.

pytorch moe memory-efficient mixture-of-experts huggingface dynamic-inference safetensors llm-inference deepseek sparse-moe expert-prefetch expert-offload

Updated Jul 29, 2026
Python

Add this topic to your repo

To associate your repository with the expert-prefetch topic, visit your repo's landing page and select "manage topics."

Learn more