Daniël de Kok 29a93b78ba Move to moe-kernels package and switch to common MoE layer (#2511) ... * Move to moe-kernels package and switch to common MoE layer This change introduces the new `moe-kernels` package: - Add `moe-kernels` as a dependency. - Introduce a `SparseMoELayer` module that can be used by MoE models. - Port over Mixtral and Deepseek. * Make `cargo check` pass * Update runner		2024-09-25 06:18:05 +00:00
..
custom_modeling	Move to moe-kernels package and switch to common MoE layer (#2511)	2024-09-25 06:18:05 +00:00
__init__.py	feat: support lora revisions and qkv_proj weights (#2482)	2024-09-25 06:13:11 +00:00
bloom.py	Refactor dead code - Removing all flash_xxx.py files. (#2166)	2024-09-25 05:20:28 +00:00
causal_lm.py	Fixing exl2 and other quanize tests again. (#2419)	2024-09-25 06:08:38 +00:00
flash_causal_lm.py	hotfix : enable intel ipex cpu and xpu in python3.11 (#2517)	2024-09-25 06:15:35 +00:00
galactica.py	feat: add ruff and resolve issue (#2262)	2024-09-25 05:46:24 +00:00
globals.py	Lots of improvements (Still 2 allocators) (#2449)	2024-09-25 06:13:11 +00:00
idefics_causal_lm.py	Upgrading exl2. (#2415)	2024-09-25 06:07:40 +00:00
idefics.py	Upgrading exl2. (#2415)	2024-09-25 06:07:40 +00:00
mamba.py	Fixing exl2 and other quanize tests again. (#2419)	2024-09-25 06:08:38 +00:00
model.py	feat: add ruff and resolve issue (#2262)	2024-09-25 05:46:24 +00:00
pali_gemma.py	feat: add ruff and resolve issue (#2262)	2024-09-25 05:46:24 +00:00
seq2seq_lm.py	Fixing exl2 and other quanize tests again. (#2419)	2024-09-25 06:08:38 +00:00
types.py	feat: add ruff and resolve issue (#2262)	2024-09-25 05:46:24 +00:00
vlm_causal_lm.py	Prefix test - Different kind of load test to trigger prefix test bugs. (#2490)	2024-09-25 06:14:07 +00:00