huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-20 14:22:08 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,293 Commits 227 Branches 59 Tags 47 MiB
zstd
Commit Graph

207 Commits

Author SHA1 Message Date
OlivierDehaene
db4cb5e4ed
fix(server): fix past key values logic (#216) 
@njhill fyi
 2023-04-21 15:59:18 +02:00
OlivierDehaene
e14ae3b5e9
feat(server): support quantization for flash models (#200) 
closes #197
 2023-04-19 12:51:11 +02:00
OlivierDehaene
880a76eed5
feat(server): support sharded santacoder (#167) 2023-04-12 17:18:08 +02:00
OlivierDehaene
299217c95c
feat(server): add flash attention llama (#144) 2023-04-11 16:38:22 +02:00
OlivierDehaene
9987960062
feat(router): make router input validation optional (#164) 2023-04-09 20:22:27 +02:00
OlivierDehaene
3f2542bb6a
fix(server): fix escape characters in stop sequence (#155) 2023-04-05 19:37:41 +02:00
OlivierDehaene
c0aeb32583
feat(server): flash santacoder (#153) 2023-04-03 19:06:42 +02:00