huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-26 20:42:06 +00:00
Code Issues Packages Projects Releases Wiki Activity
a86e4bf713
text-generation-inference/server/text_generation_server/models
History
Ubuntu a86e4bf713 Working version.
2023-05-11 12:05:35 +00:00
..
custom_modeling Working version. 2023-05-11 12:05:35 +00:00
__init__.py [WIP] Adding GPTQ support for llama 2023-05-11 12:05:35 +00:00
bloom.py feat(server): use float16 (#304) 2023-05-10 15:51:10 +02:00
causal_lm.py feat(server): use float16 (#304) 2023-05-10 15:51:10 +02:00
flash_causal_lm.py feat(server): shard token decode (#303) 2023-05-10 15:48:21 +02:00
flash_llama.py Dump. 2023-05-11 12:05:35 +00:00
flash_neox.py feat(server): shard token decode (#303) 2023-05-10 15:48:21 +02:00
flash_santacoder.py feat(server): shard token decode (#303) 2023-05-10 15:48:21 +02:00
galactica.py feat(server): use float16 (#304) 2023-05-10 15:51:10 +02:00
gpt_neox.py feat(server): use float16 (#304) 2023-05-10 15:51:10 +02:00
model.py feat(server): shard token decode (#303) 2023-05-10 15:48:21 +02:00
opt.py feat(server): use float16 (#304) 2023-05-10 15:51:10 +02:00
santacoder.py feat(server): use float16 (#304) 2023-05-10 15:51:10 +02:00
seq2seq_lm.py feat(server): use float16 (#304) 2023-05-10 15:51:10 +02:00
t5.py feat(server): use float16 (#304) 2023-05-10 15:51:10 +02:00
types.py feat(router): drop requests when client closes the channel (#202) 2023-04-20 11:07:40 +02:00