Daniël de Kok ee56266044 Use symmetric quantization in the quantize subcommand (#2120) ... Packing of asymmetric quantization is broken, all (q)zeros values of `0` get reset to `1`, resulting in a loss of accuracy. So instead use symmetric quantization. To be able to distinguish models with symmetric and asymmetric quantization, a new config tensor `gptq_sym` is added. If this tensor is not present, we assume `sym=False`.		2024-09-25 05:27:40 +00:00
..
merges	Enable multiple LoRa adapters (#2010)	2024-09-24 03:55:04 +00:00
__init__.py	Aligin the source code with main branch 2.0.4	2024-09-24 03:06:55 +00:00
adapter.py	Enable multiple LoRa adapters (#2010)	2024-09-24 03:55:04 +00:00
chunks.py	server: use chunked inputs	2024-09-24 03:42:29 +00:00
convert.py	Force weights_only (before fully breaking pickle files anyway). (#1710)	2024-04-25 15:10:53 +03:00
dist.py	Removing IPEX_AVAIL. (#2115)	2024-09-24 03:52:23 +00:00
hub.py	Enable multiple LoRa adapters (#2010)	2024-09-24 03:55:04 +00:00
import_utils.py	refine get xpu free memory/enable Qwen2/gemma2/gemma/phi in intel platform (#2132)	2024-09-24 03:57:32 +00:00
log.py	v1.3.4	2024-04-22 09:08:34 +03:00
logits_process.py	Aligin the source code with main branch 2.0.4	2024-09-24 03:06:55 +00:00
peft.py	Enable multiple LoRa adapters (#2010)	2024-09-24 03:55:04 +00:00
quantization.py	Move quantized weight handling out of the Weights class (#2194)	2024-09-25 05:27:40 +00:00
segments.py	Enable multiple LoRa adapters (#2010)	2024-09-24 03:55:04 +00:00
sgmv.py	Enable multiple LoRa adapters (#2010)	2024-09-24 03:55:04 +00:00
speculate.py	chore: formatting	2024-04-18 16:26:00 +03:00
tokens.py	Aligin the source code with main branch 2.0.4	2024-09-24 03:06:55 +00:00
watermark.py	Aligin the source code with main branch 2.0.4	2024-09-24 03:06:55 +00:00
weights.py	Use symmetric quantization in the quantize subcommand (#2120)	2024-09-25 05:27:40 +00:00