请问如何不使用vLLM进行推理呢 #21

Open

opened

on Jan 26, 2026

请问如何不使用vLLM进行推理呢，可否开源一份相关代码，借鉴参考下

to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Assignees

No one assigned

Labels

No labels

No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests