Daniël de Kok db922eb77e Update to attention-kernels 0.2.0 (#2950) ... This version removes our patches/custom API. Makes it simpler to get changes from upstream. One of which is that we can enable FP8 KV cache for paged attention as well.		2025-01-27 11:42:36 +01:00
..
attention	Update to attention-kernels 0.2.0 (#2950)	2025-01-27 11:42:36 +01:00
awq	fix incorrect output of Qwen2-7B-Instruct-GPTQ-Int4 and Qwen2-7B-Inst… (#2717)	2024-11-04 16:07:51 +01:00
compressed_tensors	Do not convert weight scale to e4m3fnuz on CUDA (#2917)	2025-01-16 13:44:32 +01:00
gptq	Flash Transformers modeling backend support (#2913)	2025-01-21 10:01:51 +01:00
marlin	Clarify FP8-Marlin use on capability 8.9 (#2940)	2025-01-22 18:18:11 +01:00
moe	fix moe in quantization path (#2935)	2025-01-22 14:36:15 +01:00
__init__.py	feat: add ruff and resolve issue (#2262)	2024-07-26 10:29:09 -04:00
bnb.py	feat: add ruff and resolve issue (#2262)	2024-07-26 10:29:09 -04:00
conv.py	Refactor layers. (#1866)	2024-05-13 12:44:30 +02:00
eetq.py	feat(fp8): use fbgemm kernels and load fp8 weights directly (#2248)	2024-07-20 19:02:04 +02:00
exl2.py	Add support for Deepseek V2 (#2224)	2024-07-19 17:23:20 +02:00
fp8.py	Clarify FP8-Marlin use on capability 8.9 (#2940)	2025-01-22 18:18:11 +01:00
layernorm.py	Update vllm kernels for ROCM (#2826)	2024-12-18 12:44:42 +01:00
linear.py	Update vllm kernels for ROCM (#2826)	2024-12-18 12:44:42 +01:00
lora.py	feat: add ruff and resolve issue (#2262)	2024-07-26 10:29:09 -04:00
medusa.py	Prefix caching (#2402)	2024-08-20 11:15:30 +02:00
mlp.py	Tied embeddings in MLP speculator. (#2473)	2024-08-29 17:44:54 +02:00
rotary.py	Update vllm kernels for ROCM (#2826)	2024-12-18 12:44:42 +01:00
speculative.py	feat: add ruff and resolve issue (#2262)	2024-07-26 10:29:09 -04:00
tensor_parallel.py	feat: add ruff and resolve issue (#2262)	2024-07-26 10:29:09 -04:00