huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-06-19 15:52:08 +00:00
Code Issues Packages Projects Releases Wiki Activity

Fix crash

Browse Source 
Signed-off-by: yuanwu <yuan.wu@intel.com>
This commit is contained in:
yuanwu 2025-06-11 02:34:09 +00:00
parent 512eca7f8f
commit 91c40e6c58
1 changed files with 0 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
backends/gaudi/server/text_generation_server/models/custom_modeling/flash_qwen3_moe_modeling.py
View File

@ -185,7 +185,6 @@ class Qwen3MoeAttention(nn.Module):
seqlen=seqlen, seqlen=seqlen,
softmax_scale=self.scaling, softmax_scale=self.scaling,
window_size_left=self.max_past, window_size_left=self.max_past,
num_key_value_groups=self.num_key_value_groups,
) )
# Decode # Decode
else: else: