huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-23 16:02:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
77dca4dfbe
text-generation-inference/integration-tests/models/__snapshots__/test_flash_starcoder2
History
Daniël de Kok a9c7d2e3b6
Basic flashinfer 0.2 support (#2862) 
* Basic flashinfer 0.2 support

This change does not use any of the new features yet, but makes
some small compatibility changes.

* Update to flashinfer 0.2.0.post1

* flashinfer: remove `contiguous` calls

* Fix flashinfer install

* flashinfer: fixup kv cache dtype

* Fix some annoying perturbations

* More output changes
2025-01-09 16:25:00 +01:00
..
test_flash_starcoder2_default_params.json Basic flashinfer 0.2 support (#2862) 2025-01-09 16:25:00 +01:00
test_flash_starcoder2_load.json Auto max prefill (#2797) 2024-12-06 05:52:00 +01:00
test_flash_starcoder2.json Auto max prefill (#2797) 2024-12-06 05:52:00 +01:00