drbh bdc47394d2 feat: support phi3.5 moe (#2479) ... * feat: support phi3.5 moe model loading * fix: prefer llama base model and improve rotary logic * feat: return reasonable generation and add integration test * fix: run lint and update docs * fix: rerun lint for openapi docs * fix: prefer do_sample false unless temp is set by user, and update chat tests * fix: small typo adjustments * fix: consolidate long rope paths * fix: revert greedy by default and test changes * Vendor configuration so that we don't have to `trust_remote_code` * Use SparseMoELayer * Add support for dense MoE * Some type annotations * Add the usual model tests * Ruff. --------- Co-authored-by: Daniël de Kok <me@danieldk.eu> Co-authored-by: Nicolas Patry <patry.nicolas@protonmail.com>		2024-10-25 09:12:03 +00:00
..
images	Pali gemma modeling (#1895)	2024-07-17 05:36:58 +00:00
models	feat: support phi3.5 moe (#2479)	2024-10-25 09:12:03 +00:00
conftest.py	Adding a test for FD. (#2516)	2024-09-25 06:17:09 +00:00
poetry.lock	Prefix test - Different kind of load test to trigger prefix test bugs. (#2490)	2024-09-25 06:14:07 +00:00
pyproject.toml	Prefix test - Different kind of load test to trigger prefix test bugs. (#2490)	2024-09-25 06:14:07 +00:00
pytest.ini	chore: add pre-commit (#1569)	2024-04-24 15:32:02 +03:00
requirements.txt	Prefix test - Different kind of load test to trigger prefix test bugs. (#2490)	2024-09-25 06:14:07 +00:00