Skip to content

[OMNIML-6061] Load the dense part sharded, and size the load warmup to each rank - #2742

Open
shengliangxu wants to merge 21 commits into
shengliangx/hfep-6a2-ep-loader-corefrom
shengliangx/hfep-6b-ep-dense-sharding
Open

[OMNIML-6061] Load the dense part sharded, and size the load warmup to each rank#2742
shengliangxu wants to merge 21 commits into
shengliangx/hfep-6a2-ep-loader-corefrom
shengliangx/hfep-6b-ep-dense-sharding

Say so when transformers has no warmup sizing hook to replace

7ea4ac7
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Oct 31, 2026 in 1s

DCO

All commits are signed off!

View more details on DCO