fxmarty 5e035063cf ROCm and sliding windows fixes (#2033) ... * update vllm commit & fix models using sliding window * update * update commit * fix bug where tunableop is bound to cuda graph even when cuda graph are disabled * enable tunableop by default * fix sliding window * address review * dead code * precise comment * is it flaky?		2024-09-24 03:42:29 +00:00
..
attention	ROCm and sliding windows fixes (#2033)	2024-09-24 03:42:29 +00:00
awq	Refactor layers. (#1866)	2024-07-17 05:36:58 +00:00
gptq	Fix GPTQWeight import (#2020)	2024-09-24 03:34:15 +00:00
__init__.py	MLPSpeculator. (#1865)	2024-07-17 05:36:58 +00:00
bnb.py	Update torch import reference in bnb quantization (#1902)	2024-07-17 05:36:58 +00:00
conv.py	Refactor layers. (#1866)	2024-07-17 05:36:58 +00:00
eetq.py	Refactor layers. (#1866)	2024-07-17 05:36:58 +00:00
exl2.py	Add support for exl2 quantization	2024-09-24 03:19:39 +00:00
fp8.py	Refactor layers. (#1866)	2024-07-17 05:36:58 +00:00
layernorm.py	MI300 compatibility (#1764)	2024-07-17 05:36:58 +00:00
linear.py	Add support for Marlin-quantized models	2024-09-24 03:38:05 +00:00
marlin.py	Add support for Marlin-quantized models	2024-09-24 03:38:05 +00:00
medusa.py	fix: use path inside of speculator config (#1935)	2024-07-17 05:36:58 +00:00
mlp.py	MLPSpeculator. (#1865)	2024-07-17 05:36:58 +00:00
rotary.py	reenable xpu for tgi (#1939)	2024-07-17 05:36:58 +00:00
speculative.py	MLPSpeculator. (#1865)	2024-07-17 05:36:58 +00:00
tensor_parallel.py	Add support for Marlin-quantized models	2024-09-24 03:38:05 +00:00