Skip to content
#

expert-streaming

Here are 6 public repositories matching this topic...

Language: All
Filter by language

Run Kimi K3.1 Pro and DeepSeek V4.1 Flash 1017 locally with Argodrive DS4: NVIDIA CUDA or Apple silicon Metal, NVMe expert streaming, caches and weight preparation. Setup and measured RTX PRO 6000 / M5 Max results included. Based on antirez/ds4; no separate Argodrive app required.

  • Updated Nov 19, 2026
  • C

Pure-PyTorch DeepSeek-V3/K3-style LLM stack where every serving optimization ships with a bit-exactness oracle: disk-tier expert streaming, KV prefix pool, MTP break-even telemetry, oracle-gated config evolution. 60 tests, all CPU-verified.

  • Updated Nov 17, 2026
  • Python

Add this topic to your repo

To associate your repository with the expert-streaming topic, visit your repo's landing page and select "manage topics."

Learn more