mirror of
https://github.com/huggingface/text-generation-inference.git
synced 2025-04-22 23:42:06 +00:00
bdc47394d2
* feat: support phi3.5 moe model loading * fix: prefer llama base model and improve rotary logic * feat: return reasonable generation and add integration test * fix: run lint and update docs * fix: rerun lint for openapi docs * fix: prefer do_sample false unless temp is set by user, and update chat tests * fix: small typo adjustments * fix: consolidate long rope paths * fix: revert greedy by default and test changes * Vendor configuration so that we don't have to `trust_remote_code` * Use SparseMoELayer * Add support for dense MoE * Some type annotations * Add the usual model tests * Ruff. --------- Co-authored-by: Daniël de Kok <me@danieldk.eu> Co-authored-by: Nicolas Patry <patry.nicolas@protonmail.com> |
||
|---|---|---|
| .. | ||
| basic_tutorials | ||
| conceptual | ||
| reference | ||
| _toctree.yml | ||
| architecture.md | ||
| index.md | ||
| installation_amd.md | ||
| installation_gaudi.md | ||
| installation_inferentia.md | ||
| installation_intel.md | ||
| installation_nvidia.md | ||
| installation.md | ||
| quicktour.md | ||
| supported_models.md | ||
| usage_statistics.md | ||