huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-26 04:22:08 +00:00
Code Issues Packages Projects Releases Wiki Activity
352 Commits 230 Branches 59 Tags 24 MiB
simpler_exllama
Commit Graph

4 Commits

Author SHA1 Message Date
OlivierDehaene
31e2253ae7
feat(server): use latest flash attention commit (#543) 
@njhill FYI
 2023-07-04 20:23:55 +02:00
OlivierDehaene
5ce89059f8
feat(server): pre-allocate past key values for flash causal LM (#412) 2023-06-12 18:30:29 +02:00
OlivierDehaene
53ee09c0b0
fea(dockerfile): better layer caching (#159) 2023-04-14 10:12:21 +02:00
OlivierDehaene
1883d8ecde
feat(docker): improve flash_attention caching (#160) 2023-04-09 19:59:16 +02:00