Skip to content
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
52 commits
Select commit Hold shift + click to select a range
04fcda0
refactor(runtime)!: adopt modern Infini stack
voltjia Jul 16, 2026
e9496ca
docs: define Infini stack repository boundaries
voltjia Jul 16, 2026
05c92ba
refactor: own Infini stack integration build
voltjia Jul 16, 2026
bca98df
docs: document the InfiniLM stack build
voltjia Jul 16, 2026
f46c074
ci: validate the modern NVIDIA stack
voltjia Jul 16, 2026
dab847b
fix: keep static graph cache metadata dynamic
voltjia Jul 24, 2026
d78dacb
refactor(ops): use canonical InfiniOps APIs
voltjia Aug 11, 2026
d49427f
fix(build): select required linked InfiniOps providers
voltjia Aug 11, 2026
f128747
fix(build): limit compiled models to Qwen3
voltjia Aug 11, 2026
0cbc125
feat(distributed): add eager point-to-point wrappers
voltjia Aug 11, 2026
9f40398
feat(ops): restore prepacked linear execution
voltjia Aug 11, 2026
28cc18b
fix(ops): match canonical Gemm call schema
voltjia Aug 11, 2026
7dd8ac6
fix(sampling): support scalar sample outputs
voltjia Aug 11, 2026
80af271
fix(nn): pass RoPE output handles by value
voltjia Aug 11, 2026
3af4355
fix(attention): include variable-length MHA declaration
voltjia Aug 11, 2026
0cb41af
fix(engine): use local static graph assertions
voltjia Aug 11, 2026
6fcd5b7
fix(config): reject unsupported Qwen3 linear bias
voltjia Aug 11, 2026
4e36168
test: cover modern runtime contracts
voltjia Aug 11, 2026
354372a
docs: update modern Qwen3 support boundary
voltjia Aug 11, 2026
1a89775
refactor(build): select InfiniOps implementations from JSON
voltjia Aug 13, 2026
2c2d94b
style: format InfiniOps attention adapters
voltjia Aug 13, 2026
baf3315
fix(graph): update paged replay metadata through tensors
voltjia Aug 13, 2026
1551767
fix(graph): fall back to eager paged decode under tensor parallelism
voltjia Aug 13, 2026
c76b105
fix: restore modern InfiniCore API compatibility
voltjia Aug 18, 2026
9d64e14
fix(runtime): sync post-migration InfiniCore updates
voltjia Aug 25, 2026
5964127
style: format migrated sources
voltjia Aug 25, 2026
e4a549b
fix(runtime): keep receive buffers mutable
voltjia Aug 25, 2026
1ed454f
fix(build): exclude unsupported MXFP4 path
voltjia Aug 25, 2026
33f0409
fix(packaging): preload Torch shared libraries
voltjia Aug 25, 2026
89a0fdb
refactor(runtime): replace deprecated causal softmax backend
voltjia Aug 26, 2026
df6f2a3
style: format causal softmax adapter
voltjia Aug 26, 2026
8c2d3f5
feat(runtime): unlock validated InfiniOps capabilities
voltjia Aug 26, 2026
57e9d01
fix(runtime): select available InfiniOps implementations
voltjia Aug 26, 2026
24f9d46
fix(runtime): enable available Moore InfiniOps paths
voltjia Aug 27, 2026
7f958b7
fix(runtime): accept native MetaX device name
voltjia Aug 27, 2026
1de38df
fix(core): validate Cat inputs against tensor rank
voltjia Aug 27, 2026
63147e7
feat(models): enable validated MiniCPM Eagle path
voltjia Aug 27, 2026
9eb004a
style(runtime): group ModelRunner imports
voltjia Aug 27, 2026
dcfbebc
fix(graph): enable safe paged decode capture under TP
voltjia Aug 31, 2026
5e9be02
feat(moore): enable modern flash attention
voltjia Sep 2, 2026
d2766a2
style(moore): format attention integration
voltjia Sep 2, 2026
4093b0b
build(moore): configure the modern stack
voltjia Sep 2, 2026
bae5a89
feat(cambricon): enable tensor-parallel flash attention
baominghelly Sep 2, 2026
5de9a02
fix(distributed): avoid transient runtime teardown
voltjia Sep 2, 2026
88e4c6e
Merge pull request #556 from InfiniTensor/feat/cambricon-tp-flash-att…
voltjia Sep 3, 2026
7c39376
feat(iluvatar): enable modern Infini stack inference (#557)
gongchensu Sep 8, 2026
64fac2f
feat(hygon): enable the modern Infini stack (#564)
gongchensu Sep 9, 2026
6966281
feat(ascend): enable InfiniOps flash attention (#558)
baominghelly Sep 9, 2026
3faa1db
perf(nvidia): reduce refactored inference overhead (#565)
voltjia Sep 9, 2026
b6fbf94
fix(ascend): use CommInitAll for single-node TP (#566)
baominghelly Sep 10, 2026
62d48c2
fix(ascend): keep unsafe operators out of device graphs (#568)
baominghelly Sep 11, 2026
f21b8f9
fix(allocator): reuse pinned free blocks (#569)
voltjia Sep 11, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
74 changes: 74 additions & 0 deletions .github/ci_config_nvidia.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,74 @@
repo:
url: https://github.com/InfiniTensor/InfiniLM.git
branch: main

github:
status_context_prefix: "ci/infinilm"

platforms:
nvidia:
image:
dockerfile: images/nvidia/
build_args:
BASE_IMAGE: nvcr.io/nvidia/pytorch:25.12-py3
CUDA_ARCH: sm_80,sm_86,sm_89,sm_90
APT_MIRROR: https://mirrors.tuna.tsinghua.edu.cn/ubuntu
PIP_INDEX_URL: https://pypi.org/simple
InfiniCore_BRANCH: __Branch_Name__
docker_args:
- "--user=root"
- "--network=host"
- "--privileged"
- "--cap-add=ALL"
- "--pid=host"
- "--ipc=host"
- "--workdir=/workspace"
volumes:
- /data:/data
- /data-aisoft:/data-aisoft
- /data-aisoft/artifacts/CI_nvidia_test/__WORKSPACE__:/artifacts
setup: pip install .[dev] --no-build-isolation
jobs:
gpu_inferencetest:
type: inferencetest
resources:
ngpus: [1, 4]
gpu_style: nvidia
shm_size: 64g
timeout: 3600
stages:
- name: test
run: python InfiniLM/examples/test_infer.py --device nvidia --model=/data-aisoft/mechdancer/models/9g_8b_thinking/
gpu_benchtest:
type: benchtest
resources:
gpu_style: nvidia
shm_size: 64g
timeout: 3600
env:
TEST_PARAM: ['default']
stages:
- name: test
run: python InfiniLM/examples/bench.py --device nvidia --model=/data-aisoft/mechdancer/models/9g_8b_thinking/ --input-len=256,1024 --output-len=256,1024 --batch-size=8 <TEST_PARAM>
gpu_accuracytest:
type: accuracytest
resources:
gpu_style: nvidia
shm_size: 64g
timeout: 3600
env:
TEST_PARAM: ['--bench mmlu']
stages:
- name: test
run: python InfiniLM/test/bench/test_benchmark.py --device nvidia --model /data-aisoft/mechdancer/models/9g_8b_thinking/ --bench mmlu --backend cpp --max-new-tokens 5 --cache-dir /data-aisoft/pepe/datasets/ --split=val <TEST_PARAM>
gpu_servicetest:
type: servicetest
resources:
shm_size: 64g
env:
MODEL_LIST: 9g_8b_thinking
ENGINE: InfiniLM
TEST_PARAM: ['default']
stages:
- name: test
run: python InfiniLM/scripts/test_perf.py --verbose
6 changes: 3 additions & 3 deletions .github/workflows/ci_test.yml
Original file line number Diff line number Diff line change
Expand Up @@ -41,9 +41,9 @@ jobs:
ci:
if: github.event_name == 'workflow_dispatch'
needs: check-format
uses: InfiniTensor/ci/.github/workflows/infinilm-ci.yml@infiniCore_ci
uses: InfiniTensor/ci/.github/workflows/infinilm-ci.yml@refactor/adopt-modern-infini-stack
with:
config_path: .github/ci_config.yaml
ci_ref: infiniCore_ci
config_path: .github/ci_config_nvidia.yaml
ci_ref: refactor/adopt-modern-infini-stack
infinicore_branch: ${{ github.event.inputs.infinicore_branch || 'main' }}
secrets: inherit
24 changes: 23 additions & 1 deletion CONTRIBUTING.md
Original file line number Diff line number Diff line change
Expand Up @@ -58,7 +58,29 @@ Existing branch names may use the legacy format `issue/###`, followed by a suffi

# Development Guide

Refer to [ReadMe](README.md) and [Adapt New Models](MODELS.md)
Refer to [ReadMe](README.md) and [Adapt New Models](MODELS.md).

Run the migrated stack-builder unit tests with:

```shell
python -m unittest test/scripts/test_build_infini_stack.py -v

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

直接指定 stack-builder unittest 文件的方式在 Python 3.13 下存在解析歧义

python -m unittest test/scripts/test_build_infini_stack.py -v 可能把 test 解析成标准库的 test 包,然后报 ModuleNotFoundError: No module named 'test.scripts'。改用测试发现机制是稳定的:

python -m unittest discover -s test/scripts -p 'test_build_infini_stack.py' -v

建议把文档命令改为测试发现形式。在本次审查环境中,该形式下 24 个测试全部通过。

```

Check the Core-backed build commands without creating build output:

```shell
python scripts/build_infini_stack.py --infinicore-root ../InfiniCore --dry-run --jobs 1 --cuda-arch sm_80
```

Run the static migration contracts with:

```shell
python -m unittest discover -s test/static -p "test_*.py" -v
```

Native stack changes must be validated in the owning component repository
first. After validation, update the corresponding submodule pin in InfiniCore
before validating InfiniLM.

## Troubleshooting

Expand Down
Loading
Loading