mirror of
https://github.com/huggingface/text-generation-inference.git
synced 2025-04-27 04:52:07 +00:00
* Move to moe-kernels package and switch to common MoE layer This change introduces the new `moe-kernels` package: - Add `moe-kernels` as a dependency. - Introduce a `SparseMoELayer` module that can be used by MoE models. - Port over Mixtral and Deepseek. * Make `cargo check` pass * Update runner |
||
---|---|---|
.. | ||
autodocs.yaml | ||
build_documentation.yaml | ||
build_pr_documentation.yaml | ||
build.yaml | ||
ci_build.yaml | ||
client-tests.yaml | ||
integration_tests.yaml | ||
load_test.yaml | ||
nix_tests.yaml | ||
stale.yaml | ||
tests.yaml | ||
trufflehog.yaml | ||
upload_pr_documentation.yaml |