Merge a55ff348c988f3c6d3c5646297fb07a164569bb8 into 95aaec702f4bf183e18da90545e26c094cedcf6d

This commit is contained in:
Didier Durand 2025-02-24 15:21:00 +05:30 committed by GitHub
commit e62e6f9ac4
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194

View File

@ -180,7 +180,7 @@ vllm serve deepseek-ai/DeepSeek-R1-Distill-Qwen-32B --tensor-parallel-size 2 --m
You can also easily start a service using [SGLang](https://github.com/sgl-project/sglang) You can also easily start a service using [SGLang](https://github.com/sgl-project/sglang)
```bash ```bash
python3 -m sglang.launch_server --model deepseek-ai/DeepSeek-R1-Distill-Qwen-32B --trust-remote-code --tp 2 python3 -m sglang.launch_server --model deepseek-ai/DeepSeek-R1-Distill-Qwen-32B --trust-remote-code --tensor-parallel-size 2
``` ```
### Usage Recommendations ### Usage Recommendations