huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-21 23:12:07 +00:00
Code Issues Packages Projects Releases Wiki Activity
fe7594e369
text-generation-inference/server/text_generation_server/models
History
Yuan Wu fe7594e369
Fix the warmup issue of prefill batch_size (#268) 
Signed-off-by: yuanwu <yuan.wu@intel.com>
2025-01-23 17:26:17 +01:00
..
custom_modeling Mllama flash version (#2585) 2024-10-27 04:03:57 +00:00
__init__.py Fix startcode issue 2024-11-26 08:55:42 +00:00
bloom.py Make Gaudi adapt to the tgi 2.3.0 2024-09-26 06:04:55 +00:00
causal_lm.py Fix the warmup issue of prefill batch_size (#268) 2025-01-23 17:26:17 +01:00
flash_causal_lm.py Update ROCM libs and improvements (#2579) 2024-10-25 09:01:04 +00:00
galactica.py feat: add ruff and resolve issue (#2262) 2024-09-25 05:46:24 +00:00
globals.py Use the default value in globals.py (#265) 2025-01-21 10:10:23 +01:00
idefics_causal_lm.py Mllama flash version (#2585) 2024-10-27 04:03:57 +00:00
mamba.py Fixing exl2 and other quanize tests again. (#2419) 2024-09-25 06:08:38 +00:00
mllama_causal_lm.py Mllama flash version (#2585) 2024-10-27 04:03:57 +00:00
model.py Pass the max_batch_total_tokens to causal_lm 2024-10-23 08:28:26 +00:00
pali_gemma.py feat: add ruff and resolve issue (#2262) 2024-09-25 05:46:24 +00:00
seq2seq_lm.py Fixing exl2 and other quanize tests again. (#2419) 2024-09-25 06:08:38 +00:00
starcoder.py Make Gaudi adapt to the tgi 2.3.0 2024-09-26 06:04:55 +00:00
types.py feat: add ruff and resolve issue (#2262) 2024-09-25 05:46:24 +00:00
vlm_causal_lm.py Fix the issues of tgi-gaudi for v.2.3.1 2024-10-27 20:40:36 +00:00