biggy/DeepSeek-V3
1
0
Fork 0
mirror of https://github.com/deepseek-ai/DeepSeek-V3.git synced 2025-04-28 18:09:22 +00:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity

Compare commits

base: biggy:57d7bd45df205460eeefea2ef92e9df99d77f3ce
Branches Tags
biggy:main
...
compare: biggy:4cc6253d5c225e2c5fea32c54573449c1c46470a
Branches Tags
biggy:main

2 Commits
57d7bd45df ... 4cc6253d5c

Author SHA1 Message Date
Xingkai Yu
4cc6253d5c
Merge pull request #666 from codinglover222/deepseek-doc-fix
Some checks failed
Mark and close stale issues / stale (push) Has been cancelled
Details 
fix an args description.
 2025-04-09 09:50:40 +08:00
oyzh
4a65fd9221 fix an args description. 2025-02-15 11:02:28 +08:00
1 changed files with 1 additions and 1 deletions
Show Stats Expand all files Collapse all files

2
inference/kernel.py
View File

@ -87,7 +87,7 @@ def weight_dequant(x: torch.Tensor, s: torch.Tensor, block_size: int = 128) -> t
Args: Args:
x (torch.Tensor): The quantized weight tensor of shape (M, N). x (torch.Tensor): The quantized weight tensor of shape (M, N).
s (torch.Tensor): The scale tensor of shape (M, N). s (torch.Tensor): The scale tensor of shape (M//block_size, N//block_size).
block_size (int, optional): The block size to use for dequantization. Defaults to 128. block_size (int, optional): The block size to use for dequantization. Defaults to 128.
Returns: Returns: