Skip to content

Popular repositories Loading

  1. pegainfer pegainfer Public

    Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

    Rust 746 121

  2. kern kern Public

    A model-agnostic GPU runtime for shipping models as verified programs.

    Rust 206 15

  3. pega-omni pega-omni Public

    OpenAI-compatible speech serving in Rust: streaming TTS and full-duplex voice over GPT-Live. 128 concurrent PersonaPlex sessions on one GPU.

    Rust 51 5

  4. kern-k31 kern-k31 Public

    Kimi-K3.1 Pro on the kern runtime: the manifest generator, kernels and pinned hashes for its P/D stack

    Cuda 7 1

  5. kern-k3-pp-prefill kern-k3-pp-prefill Public

    Kimi-K3 prefill as pipeline-parallel stages for kern: manifests, kernel sources, build recipes

    Cuda 6 1

  6. website website Public

    Documentation website for openinfer — Astro Starlight on Cloudflare Workers

    MDX 4 1

Repositories

Showing 10 of 13 repositories

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Top languages

Loading…

Most used topics

Loading…