huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-21 23:12:07 +00:00
Code Issues Packages Projects Releases Wiki Activity
7ccb8eefdc
text-generation-inference/server/text_generation_server/models
History
Nicolas Patry 7ccb8eefdc TMP.
2023-05-15 16:43:32 +02:00
..
custom_modeling TMP. 2023-05-15 16:43:32 +02:00
__init__.py Hotfixes for santacoder/bigcode. (#294) 2023-05-15 10:35:20 +02:00
bloom.py Lifting check_unitialized. (#325) 2023-05-15 11:32:25 +02:00
causal_lm.py feat(server): GPTQ quantization (step1) (#277) 2023-05-12 14:46:41 +02:00
flash_causal_lm.py feat(server): GPTQ quantization (step1) (#277) 2023-05-12 14:46:41 +02:00
flash_llama.py TMP. 2023-05-15 16:43:32 +02:00
flash_neox.py TMP. 2023-05-15 16:43:32 +02:00
flash_santacoder.py TMP. 2023-05-15 16:43:32 +02:00
galactica.py Lifting check_unitialized. (#325) 2023-05-15 11:32:25 +02:00
gpt_neox.py Lifting check_unitialized. (#325) 2023-05-15 11:32:25 +02:00
model.py Lifting check_unitialized. (#325) 2023-05-15 11:32:25 +02:00
opt.py Lifting check_unitialized. (#325) 2023-05-15 11:32:25 +02:00
santacoder.py feat(server): GPTQ quantization (step1) (#277) 2023-05-12 14:46:41 +02:00
seq2seq_lm.py feat(server): GPTQ quantization (step1) (#277) 2023-05-12 14:46:41 +02:00
t5.py Single place for TP layers + Dropout Layer Norm + FastLinear 2023-05-15 15:02:19 +02:00
types.py feat(router): drop requests when client closes the channel (#202) 2023-04-20 11:07:40 +02:00