biggy/DeepSeek-V3
1
0
Fork 0
mirror of https://github.com/deepseek-ai/DeepSeek-V3.git synced 2025-04-29 02:19:22 +00:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity

Compare commits

base: biggy:4cc6253d5c225e2c5fea32c54573449c1c46470a
Branches Tags
biggy:main
..
compare: biggy:57d7bd45df205460eeefea2ef92e9df99d77f3ce
Branches Tags
biggy:main

No commits in common. "4cc6253d5c225e2c5fea32c54573449c1c46470a" and "57d7bd45df205460eeefea2ef92e9df99d77f3ce" have entirely different histories.
4cc6253d5c ... 57d7bd45df

1 changed files with 1 additions and 1 deletions
Show Stats Expand all files Collapse all files

2
inference/kernel.py
View File

@ -87,7 +87,7 @@ def weight_dequant(x: torch.Tensor, s: torch.Tensor, block_size: int = 128) -> t
Args: Args:
x (torch.Tensor): The quantized weight tensor of shape (M, N). x (torch.Tensor): The quantized weight tensor of shape (M, N).
s (torch.Tensor): The scale tensor of shape (M//block_size, N//block_size). s (torch.Tensor): The scale tensor of shape (M, N).
block_size (int, optional): The block size to use for dequantization. Defaults to 128. block_size (int, optional): The block size to use for dequantization. Defaults to 128.
Returns: Returns: