huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-24 16:32:12 +00:00
Code Issues Packages Projects Releases Wiki Activity
213acc6e34
text-generation-inference/launcher/src
History
Daniël de Kok 5bbe1ce028
Support e4m3fn KV cache (#2655) 
* Support `e4m3fn` KV cache

* Make check more obvious
2024-10-17 10:42:16 +02:00
..
env_runtime.rs add intel xpu support for TGI (#1475) 2024-04-26 15:48:58 +02:00
gpu.rs Remove compute capability lazy cell (#2580) 2024-09-30 08:48:47 +02:00
main.rs Support e4m3fn KV cache (#2655) 2024-10-17 10:42:16 +02:00