huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-23 16:02:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
cacaba64c3
text-generation-inference/server/text_generation_server/layers/gptq
History
Nicolas Patry 849d8821ab
QuantLinear is rocm compatible.
2024-10-23 18:02:50 +08:00
..
__init__.py QuantLinear is rocm compatible. 2024-10-23 18:02:50 +08:00
cuda.py CI job. Gpt awq 4 (#2665) 2024-10-18 17:55:53 +02:00
custom_autotune.py Some small fixes for the Torch 2.4.0 update (#2304) 2024-07-25 13:34:44 +02:00
exllama.py Fix GPTQWeight import (#2020) 2024-06-05 14:49:15 +02:00
exllamav2.py Upgrading exl2. (#2415) 2024-08-14 11:58:08 +02:00
ipex.py CI job. Gpt awq 4 (#2665) 2024-10-18 17:55:53 +02:00
quantize.py CI job. Gpt awq 4 (#2665) 2024-10-18 17:55:53 +02:00
utils.py feat: add ruff and resolve issue (#2262) 2024-07-26 10:29:09 -04:00