huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-24 00:12:08 +00:00
Code Issues Packages Projects Releases Wiki Activity
8d42e1d191
text-generation-inference/server/text_generation_server/models
History
Nicolas Patry 8d42e1d191 More.
2023-05-15 15:13:59 +02:00
..
custom_modeling More. 2023-05-15 15:13:59 +02:00
__init__.py Hotfixes for santacoder/bigcode. (#294) 2023-05-15 10:35:20 +02:00
bloom.py Lifting check_unitialized. (#325) 2023-05-15 11:32:25 +02:00
causal_lm.py feat(server): GPTQ quantization (step1) (#277) 2023-05-12 14:46:41 +02:00
flash_causal_lm.py feat(server): GPTQ quantization (step1) (#277) 2023-05-12 14:46:41 +02:00
flash_llama.py Lifting check_unitialized. (#325) 2023-05-15 11:32:25 +02:00
flash_neox.py Lifting check_unitialized. (#325) 2023-05-15 11:32:25 +02:00
flash_santacoder.py Lifting check_unitialized. (#325) 2023-05-15 11:32:25 +02:00
galactica.py Lifting check_unitialized. (#325) 2023-05-15 11:32:25 +02:00
gpt_neox.py Lifting check_unitialized. (#325) 2023-05-15 11:32:25 +02:00
model.py Lifting check_unitialized. (#325) 2023-05-15 11:32:25 +02:00
opt.py Lifting check_unitialized. (#325) 2023-05-15 11:32:25 +02:00
santacoder.py feat(server): GPTQ quantization (step1) (#277) 2023-05-12 14:46:41 +02:00
seq2seq_lm.py feat(server): GPTQ quantization (step1) (#277) 2023-05-12 14:46:41 +02:00
t5.py Single place for TP layers + Dropout Layer Norm + FastLinear 2023-05-15 15:02:19 +02:00
types.py feat(router): drop requests when client closes the channel (#202) 2023-04-20 11:07:40 +02:00