huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-20 06:12:07 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,320 Commits 227 Branches 59 Tags 47 MiB
b447f7e821
Commit Graph

4 Commits

Author SHA1 Message Date
OlivierDehaene
c4bb5264ac
fix(server): decrease memory fragmentation (#557) 2023-07-06 14:28:33 +02:00
OlivierDehaene
e74bd41e0f
feat(server): add paged attention to flash models (#516) 
Closes #478
 2023-06-30 19:09:59 +02:00
OlivierDehaene
f000068944
feat(server): clear cache on error (#143) 2023-03-28 11:29:35 +02:00
OlivierDehaene
3fef90d50f
feat(clients): Python client (#103) 2023-03-07 18:52:22 +01:00