drbh c1cf36c0dc Improve qwen vl impl (#2943) ... * feat: refactor model, improve startup and re enable tests * fix: improve multimodal rotary embed caching * fix: limit vision flop calc to qwen2 vl models and update config typing * fix: include clippy lint * feat: refactor position ids in warmup and bump tests * fix: prefer default dtype * fix: enable all cuda graphs and bump snapshots * fix: adjust rotaty init path * fix: simplify get position ids and remove usused vision config * fix: update position ids so first dim is batch, simplify rotary and bump vlm default token limit * fix: improve position id init during cuda warmup for mrope and simplfy rotary forward * fix: check existance before accessing rope type in cuda warmup * fix: check key before access * fix: improve mrope check in cuda graph warmup * fix: remove check for default rope type * fix: add more test and improve model generation * fix: improve and simplify get_cos_sin, refactors and cleanup get_position_ids * fix: adjust signatures with types		2025-02-04 12:44:18 -05:00
..
images	Pali gemma modeling (#1895)	2024-05-16 06:58:47 +02:00
models	Improve qwen vl impl (#2943)	2025-02-04 12:44:18 -05:00
conftest.py	Trying to avoid the random timeout. (#2929)	2025-01-21 11:06:10 +01:00
poetry.lock	Prefix test - Different kind of load test to trigger prefix test bugs. (#2490)	2024-09-11 18:10:40 +02:00
pyproject.toml	nix: add black and isort to the closure (#2619)	2024-10-09 11:08:02 +02:00
pytest.ini	chore: add pre-commit (#1569)	2024-02-16 11:58:58 +01:00
requirements.txt	Prefix test - Different kind of load test to trigger prefix test bugs. (#2490)	2024-09-11 18:10:40 +02:00