C++20 GPU compute runtime with CUDA-like ergonomics.
-
Updated
Jul 24, 2026 - C++
C++20 GPU compute runtime with CUDA-like ergonomics.
CUDA-equivalent tensor-core acceleration for Apple Silicon. C-ABI kernel library wrapping simdgroup_matrix (M1+) and mpp::tensor_ops (M5+): GEMM, FlashAttention, Conv2D, Q4_0/Q8_0 quantized inference, GGUF reader, full transformer training kernels. One binary, M1 → M5.
Environment diagnostics, compatibility resolver, and a live-tracked map of the Python AI ecosystem on AMD ROCm.
Native Apple Silicon Metal port of mumax3, extending CUDA based micromagnetic simulation to macOS with MPSGraph FFT and validated physics compatibility.
Native C++/HIP Qwen3.8-27B inference engine for 4x AMD MI50 (gfx906), with chained MTP speculative decoding.
Système d'exploitation Exokernel "Bare-Metal" et langage dédié (Neuro-Lang) pour l'IA. Élimination de la "Taxe d'Abstraction" : exécution Ring-0, mémoire unifiée SASOS et accès GPU direct sans latenc
Run a local LLM on a Mac with an NVIDIA eGPU: custom DriverKit driver (no CUDA runtime), RTX 3090 over Thunderbolt — Qwen3.8-27B at 75.81 tok/s decode @100k ctx, bit-exact, OpenAI-compatible API.
Full local AI stack on AMD ROCm — no NVIDIA, no CUDA. Self-hosted LLM chat, image generation, web search & agent tools on one GPU.
GPU-accelerated Sobel edge detection using OpenCL. Features a high-performance "Universal Tiling" implementation with local memory (SRAM) caching and strided loading, achieving a 138x speedup on NVIDIA K20 hardware.
From-scratch LLM inference engine for Apple Silicon: hand-written Metal kernels (simdgroup_matrix GEMM, FlashAttention prefill, paged-attention decode), paged KV cache, continuous batching, OpenAI-compatible server. C++17, no PyTorch/llama.cpp/MLX.
An open, vendor-neutral compute language — CUDA's grid-of-threads model without the lock-in. One language for AI, hashing and graphics; targets Apple Metal today, FPGA/custom silicon next.
To associate your repository with the cuda-alternative topic, visit your repo's landing page and select "manage topics."