biggy/DeepSeek-R1
1
0
Fork 0
mirror of https://github.com/deepseek-ai/DeepSeek-R1.git synced 2025-04-29 02:19:22 +00:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity

Compare commits

base: biggy:e1ab64bd3fa5cdaa8b3dd99761614ed29691d91b
Branches Tags
biggy:main
...
compare: biggy:a7564cabb21b5d9ed463c543e3804f8781e3f5f0
Branches Tags
biggy:main

2 Commits
e1ab64bd3f ... a7564cabb2

Author SHA1 Message Date
Peter Pan
a7564cabb2
Merge 853ad9cbf5c838b30bc221b5851276cfdcf77625 into 45b89c6cb13cf6b01da05ef9a7379f13f8d3baf2 2025-02-18 22:57:22 +07:00
Peter Pan
853ad9cbf5 docs: add vLLM new feature(>-v0.7.1) supporting DeepSeek-R1 
refer to https://github.com/vllm-project/vllm/releases/tag/v0.7.1
 2025-02-05 15:58:36 +08:00
1 changed files with 2 additions and 0 deletions
Show Stats Expand all files Collapse all files

2
README.md
View File

@ -176,6 +176,8 @@ For instance, you can easily start a service using [vLLM](https://github.com/vll
```shell
vllm serve deepseek-ai/DeepSeek-R1-Distill-Qwen-32B --tensor-parallel-size 2 --max-model-len 32768 --enforce-eager
```
With `vllm` >= v0.7.1, you can additionally append `--enable-reasoning --reasoning-parser deepseek_r1` to above shell command, for reasoning output parsing.
You can also easily start a service using [SGLang](https://github.com/sgl-project/sglang)