huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-09-09 03:14:53 +00:00
Code Issues Packages Projects Releases Wiki Activity

Fix the image-to-text accuray issue

Browse Source 
Signed-off-by: yuanwu <yuan.wu@intel.com>
This commit is contained in:
yuanwu 2025-05-11 15:21:15 +00:00
parent 1a5ff1dc5f
commit a27039bc51
2 changed files with 478 additions and 347 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

822
backends/gaudi/server/text_generation_server/models/custom_modeling/flash_llama4_modeling.py
View File

File diff suppressed because it is too large Load Diff

3
backends/gaudi/server/text_generation_server/models/flash_vlm_causal_lm.py
View File

@ -338,6 +338,9 @@ class FlashVlmCausalLMBatch(FlashCausalLMBatch):
image_id += 1 image_id += 1
full_text = image_text_replacement_fixup(config, full_text) full_text = image_text_replacement_fixup(config, full_text)
log_master(
logger.debug, f"full_text: {full_text}"
)
input_ids = tokenizer( input_ids = tokenizer(
full_text, full_text,
truncation=True, truncation=True,