Merge 853ad9cbf5c838b30bc221b5851276cfdcf77625 into 95aaec702f4bf183e18da90545e26c094cedcf6d

This commit is contained in:
Peter Pan 2025-02-24 13:56:07 +08:00 committed by GitHub
commit e1ab64bd3f
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194

View File

@ -176,6 +176,8 @@ For instance, you can easily start a service using [vLLM](https://github.com/vll
```shell
vllm serve deepseek-ai/DeepSeek-R1-Distill-Qwen-32B --tensor-parallel-size 2 --max-model-len 32768 --enforce-eager
```
With `vllm` >= v0.7.1, you can additionally append `--enable-reasoning --reasoning-parser deepseek_r1` to above shell command, for reasoning output parsing.
You can also easily start a service using [SGLang](https://github.com/sgl-project/sglang)