Skip to content
@OrbitInfra

OrbitInfra

Open infrastructure for high-performance AI inference.

Pinned Loading

  1. OrbitKV OrbitKV Public

    OrbitKV is a High Performance KV Cache System for LLM Inference.

    Rust 284 19

  2. OrbiTE OrbiTE Public

    OrbiTE is a High Performance Transfer Engine for LLM Inference.

    Rust 2 1

  3. OrbitInfer OrbitInfer Public

    An extensible inference runtime with a Rust scheduler, explicit cache ownership, and pluggable model runners.

    Python 1

Repositories

Showing 5 of 5 repositories

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Top languages

Loading…

Most used topics

Loading…