Repository navigation

Unify weight and attention sparsity under mts.sparsify - #3073

Open

rohansjoshi wants to merge 5 commits into

mainfrom

rohjoshi/unify-sparsity-api

Open

Unify weight and attention sparsity under mts.sparsify#3073
rohansjoshi wants to merge 5 commits into
mainfrom
rohjoshi/unify-sparsity-api

Commits on Oct 27, 2026
- Calibrate sparse attention through a mode searcher and allow it after weight sparsity
  
  rohansjoshi
  and
  claude
  committed
  80df9cb
- Unify weight and attention sparsity under mts.sparsify
  
  rohansjoshi
  and
  claude
  committed
  cd58ab3
Commits on Nov 2, 2026
- Validate sparsify inputs up front and keep per-module training modes
  
  rohansjoshi
  and
  claude
  committed
  31a1393
- Merge origin/main into rohjoshi/unify-sparsity-api
  
  rohansjoshi
  and
  claude
  committed
  bac92ab
Commits on Nov 3, 2026
- Check sparse attention method and backend mixes before sparsify changes the model
  
  rohansjoshi
  and
  claude
  committed
  66ebff4