biggy/DeepSeek-V3
1
0
Fork 0
mirror of https://github.com/deepseek-ai/DeepSeek-V3.git synced 2025-05-03 13:46:29 +02:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity

Merge 4a65fd9221103ff03864337453c238e65d1f4a1b into f09f5fa321f5a421704136c0463b1eaca6557712

Browse Source
This commit is contained in:
codlifedz22 2025-02-18 20:50:19 +08:00 committed by GitHub
commit 05be48bd93
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
inference/kernel.py
View File

@ -87,7 +87,7 @@ def weight_dequant(x: torch.Tensor, s: torch.Tensor, block_size: int = 128) -> t
Args: Args:
x (torch.Tensor): The quantized weight tensor of shape (M, N). x (torch.Tensor): The quantized weight tensor of shape (M, N).
s (torch.Tensor): The scale tensor of shape (M, N). s (torch.Tensor): The scale tensor of shape (M//block_size, N//block_size).
block_size (int, optional): The block size to use for dequantization. Defaults to 128. block_size (int, optional): The block size to use for dequantization. Defaults to 128.
Returns: Returns: