mirror of
https://github.com/huggingface/text-generation-inference.git
synced 2025-10-09 15:05:24 +00:00
* Basic flashinfer 0.2 support This change does not use any of the new features yet, but makes some small compatibility changes. * Update to flashinfer 0.2.0.post1 * flashinfer: remove `contiguous` calls * Fix flashinfer install * flashinfer: fixup kv cache dtype * Fix some annoying perturbations * More output changes |
||
---|---|---|
.. | ||
images | ||
models | ||
conftest.py | ||
poetry.lock | ||
pyproject.toml | ||
pytest.ini | ||
requirements.txt |