biggy/DeepSeek-V3
1
0
Fork 0
mirror of https://github.com/deepseek-ai/DeepSeek-V3.git synced 2025-05-01 21:16:29 +02:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity

Merge 4a65fd9221103ff03864337453c238e65d1f4a1b into 592fd5daf8177b205af11651bbb31a1834a8b0e0

Browse Source
This commit is contained in:
codlifedz22 2025-02-24 00:59:58 -05:00 committed by GitHub
commit b612a1cc10
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
inference/kernel.py
View File

@ -87,7 +87,7 @@ def weight_dequant(x: torch.Tensor, s: torch.Tensor, block_size: int = 128) -> t
Args:
x (torch.Tensor): The quantized weight tensor of shape (M, N).
s (torch.Tensor): The scale tensor of shape (M, N).
s (torch.Tensor): The scale tensor of shape (M//block_size, N//block_size).
block_size (int, optional): The block size to use for dequantization. Defaults to 128.
Returns: