mirror of
https://github.com/huggingface/text-generation-inference.git
synced 2025-04-19 22:02:06 +00:00
cb747b33da
* Add fp8 support moe models add deepseekv3 format codfe' update dockerfile update doc * Small modifications. * Moe kernels 0.8.1 * Upgrade to 0.8.1 * Fixing moe import. * Black. * Apply suggestions from code review Co-authored-by: Mohit Sharma <mohit21sharma.ms@gmail.com> * Fixing Mixtral + Nits. * Put link to ref. * Fix other call locations. * Scoring func `softmax` is the only one that works. --------- Co-authored-by: Mohit Sharma <mohit21sharma.ms@gmail.com> |
||
|---|---|---|
| .. | ||
| backends | ||
| basic_tutorials | ||
| conceptual | ||
| reference | ||
| _toctree.yml | ||
| architecture.md | ||
| index.md | ||
| installation_amd.md | ||
| installation_gaudi.md | ||
| installation_inferentia.md | ||
| installation_intel.md | ||
| installation_nvidia.md | ||
| installation_tpu.md | ||
| installation.md | ||
| multi_backend_support.md | ||
| quicktour.md | ||
| supported_models.md | ||
| usage_statistics.md | ||