mirror of
https://github.com/huggingface/text-generation-inference.git
synced 2025-04-21 23:12:07 +00:00
* Add more representative Llama GPTQ test The Llama GPTQ test is updated to use a model with the commonly-used quantizer config format and activation sorting. The old test is kept around (but renamed) since it tests the format produced by `text-generation-server quantize`. * Add support for manually triggering a release build |
||
---|---|---|
.. | ||
test_flash_llama_gptq_all_params.json | ||
test_flash_llama_gptq_load.json | ||
test_flash_llama_gptq.json |