huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-09-09 19:34:53 +00:00
Code Issues Packages Projects Releases Wiki Activity

minor fix

Browse Source 
Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>
This commit is contained in:
Wang, Yi A 2025-06-26 22:19:38 -07:00
parent 8c988de92c
commit 800281113f
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
backends/gaudi/server/text_generation_server/models/mllama_causal_lm.py
View File

@ -226,7 +226,7 @@ def generate_cross_attention_states(
cross_attention_states, image_indices, input_lengths, pad_seq_len, prefilling cross_attention_states, image_indices, input_lengths, pad_seq_len, prefilling
): ):
if cross_attention_states is None: if cross_attention_states is None:
return None, None, None return None, None
indices_list = [] indices_list = []
if prefilling: if prefilling:
for i in image_indices: for i in image_indices: