huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-05-11 04:22:08 +00:00
Code Issues Packages Projects Releases Wiki Activity
model_compat_log
text-generation-inference/server/text_generation_server/models/custom_modeling
History
OlivierDehaene ab96b9aec3
feat(server): support new falcon config ()
2023-07-27 18:38:57 +02:00
..
__init__.py feat(server): flash santacoder () 2023-04-03 19:06:42 +02:00
bloom_modeling.py feat: better errors for warmup and TP () 2023-07-10 14:47:15 +02:00
flash_llama_modeling.py feat(server): Add exllama GPTQ CUDA kernel support () 2023-07-21 10:59:00 +02:00
flash_neox_modeling.py feat(server): flash attention v2 () 2023-07-18 16:21:18 +02:00
flash_rw_modeling.py feat(server): support new falcon config () 2023-07-27 18:38:57 +02:00
flash_santacoder_modeling.py feat(server): Using quantize_config.json instead of GPTQ_BITS env variables. () 2023-07-25 13:00:27 +02:00
mpt_modeling.py feat: better errors for warmup and TP () 2023-07-10 14:47:15 +02:00
neox_modeling.py feat: better errors for warmup and TP () 2023-07-10 14:47:15 +02:00
opt_modeling.py feat(server): Using quantize_config.json instead of GPTQ_BITS env variables. () 2023-07-25 13:00:27 +02:00
t5_modeling.py fix(server): Adding logger import to t5_modeling.py () 2023-07-12 10:40:32 +02:00