huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-05-01 23:12:09 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,314 Commits 230 Branches 59 Tags 25 MiB
0a55bd3db9
Commit Graph

2 Commits

Author SHA1 Message Date
Adrien Gallouët
0a55bd3db9
Quantize without llama-quantize 
Signed-off-by: Adrien Gallouët <angt@huggingface.co>
 2025-03-05 11:08:17 +00:00
Adrien Gallouët
2d4aa25b9c
Make --model-gguf optional 
Signed-off-by: Adrien Gallouët <angt@huggingface.co>
 2025-03-05 11:08:17 +00:00