Merge a55ff348c988f3c6d3c5646297fb07a164569bb8 into 45b89c6cb13cf6b01da05ef9a7379f13f8d3baf2

This commit is contained in:
Didier Durand 2025-02-18 22:57:22 +07:00 committed by GitHub
commit 1f6970967d
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194

View File

@ -180,7 +180,7 @@ vllm serve deepseek-ai/DeepSeek-R1-Distill-Qwen-32B --tensor-parallel-size 2 --m
You can also easily start a service using [SGLang](https://github.com/sgl-project/sglang) You can also easily start a service using [SGLang](https://github.com/sgl-project/sglang)
```bash ```bash
python3 -m sglang.launch_server --model deepseek-ai/DeepSeek-R1-Distill-Qwen-32B --trust-remote-code --tp 2 python3 -m sglang.launch_server --model deepseek-ai/DeepSeek-R1-Distill-Qwen-32B --trust-remote-code --tensor-parallel-size 2
``` ```
### Usage Recommendations ### Usage Recommendations