huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-21 23:12:07 +00:00
Code Issues Packages Projects Releases Wiki Activity
1fff6746ab
text-generation-inference/server/text_generation_server/models
History
Victor SANH 1fff6746ab
Fix position ids logic instantiation of idefics vision part (#1064) 
Problem and fix is described here:
https://huggingface.co/HuggingFaceM4/idefics-9b/discussions/9

---------

Co-authored-by: Nicolas Patry <patry.nicolas@protonmail.com>
2023-09-26 15:41:15 +02:00
..
custom_modeling Fix position ids logic instantiation of idefics vision part (#1064) 2023-09-26 15:41:15 +02:00
__init__.py Add AWQ quantization inference support (#1019) (#1054) 2023-09-25 15:31:27 +02:00
bloom.py enable bfloat16 for cpu (#1034) 2023-09-19 17:19:28 +02:00
causal_lm.py enable bfloat16 for cpu (#1034) 2023-09-19 17:19:28 +02:00
flash_causal_lm.py Rebased #617 (#868) 2023-08-28 11:43:47 +02:00
flash_llama.py Add AWQ quantization inference support (#1019) (#1054) 2023-09-25 15:31:27 +02:00
flash_neox.py feat(server): Using quantize_config.json instead of GPTQ_BITS env variables. (#671) 2023-07-25 13:00:27 +02:00
flash_rw.py Fix Falcon weight mapping for H2O.ai checkpoints (#953) 2023-08-31 21:15:14 +02:00
flash_santacoder.py feat(server): Using quantize_config.json instead of GPTQ_BITS env variables. (#671) 2023-07-25 13:00:27 +02:00
galactica.py Fix missing arguments in Galactica's from_pb (#1022) 2023-09-21 08:15:59 +02:00
gpt_neox.py enable bfloat16 for cpu (#1034) 2023-09-19 17:19:28 +02:00
idefics_causal_lm.py enable bfloat16 for cpu (#1034) 2023-09-19 17:19:28 +02:00
idefics.py enable bfloat16 for cpu (#1034) 2023-09-19 17:19:28 +02:00
model.py Fix typing in Model.generate_token (#733) 2023-07-31 14:35:14 +02:00
mpt.py enable bfloat16 for cpu (#1034) 2023-09-19 17:19:28 +02:00
opt.py enable bfloat16 for cpu (#1034) 2023-09-19 17:19:28 +02:00
rw.py enable bfloat16 for cpu (#1034) 2023-09-19 17:19:28 +02:00
santacoder.py enable bfloat16 for cpu (#1034) 2023-09-19 17:19:28 +02:00
seq2seq_lm.py enable bfloat16 for cpu (#1034) 2023-09-19 17:19:28 +02:00
t5.py enable bfloat16 for cpu (#1034) 2023-09-19 17:19:28 +02:00
types.py Rebased #617 (#868) 2023-08-28 11:43:47 +02:00