mirror of
https://github.com/huggingface/text-generation-inference.git
synced 2025-04-24 16:32:12 +00:00
* Add more representative Llama GPTQ test The Llama GPTQ test is updated to use a model with the commonly-used quantizer config format and activation sorting. The old test is kept around (but renamed) since it tests the format produced by `text-generation-server quantize`. * Add support for manually triggering a release build |
||
---|---|---|
.. | ||
test_server_gptq_quantized_all_params.json | ||
test_server_gptq_quantized_load.json | ||
test_server_gptq_quantized.json |