Skip to content
View Torchit1's full-sized avatar

Achievements

Achievement: Pair ExtraordinaireAchievement: Pull Shark

Achievements

Achievement: Pair ExtraordinaireAchievement: Pull Shark

Block or report Torchit1

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
Torchit1/README.md

Hi, I'm Jesse

I build software in Wollongong: fast local AI on Intel Arc GPUs, planning tools, and a train game.

Intel Arc + local AI

  • llama.cpp on Intel Arc (SYCL): XMX flash attention for quantized KV caches (up to 2.6x faster generation at long context on a B580), XMX prompt GEMMs for the default fp32 build (~3x faster prompt processing), and a faster GATED_DELTA_NET kernel for Qwen3.5-style models. Sent to Intel's SYCL maintainer for upstreaming. Branches: sycl-fa-q4-xmx, sycl-xmx-prompt-gemm, sycl-gdn-blocked
  • Bonsai 2 27B on Intel Arc B580: SYCL kernels that run PrismML's ternary 27B model on a 12 GB Arc B580 with the full 128K context, ~85 t/s with speculative decoding.
  • TernSYCL (contributor, 4 merged PRs): int4/int8 DPAS helpers and fixes for ternary GEMM kernels on Xe GPUs.
  • wayfinder: lets an AI agent point at things on your Windows screen instead of clicking for you.

Other projects

  • Next Stop NSW: a browser train game built on the real NSW rail network.
  • AusDatum: NSW site and planning analysis: zoning, hazards and development pathways for any lot.
  • PyAtlasPro: a free pyRevit extension for faster Revit drafting.

Best way to reach me is LinkedIn.

Pinned Loading

  1. llama.cpp llama.cpp Public

    Forked from ggml-org/llama.cpp

    Bonsai 2 27B ternary on Intel Arc B580: SYCL + XMX, 128K context

    C++ 7

  2. PyAtlasPro PyAtlasPro Public

    pyRevit extension focusing on speeding up drafting.

    Python 1