huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-22 23:42:06 +00:00
Code Issues Packages Projects Releases Wiki Activity
30cd3cf510
text-generation-inference/backends/llamacpp/src
History
Adrien Gallouët 30cd3cf510
Enable mmap, offload_kqv & flash_attention by default 
Signed-off-by: Adrien Gallouët <angt@huggingface.co>
2025-03-05 11:08:17 +00:00
..
backend.rs [Backend] Add Llamacpp backend (#2975) 2025-02-14 13:40:57 +01:00
main.rs Enable mmap, offload_kqv & flash_attention by default 2025-03-05 11:08:17 +00:00