huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-10-09 15:05:24 +00:00
Code Issues Packages Projects Releases Wiki Activity
149 Commits 240 Branches 66 Tags 36 MiB
1dd2c24b9c
Commit Graph

6 Commits

Author SHA1 Message Date
OlivierDehaene
47e93409f3 optional rust validation 2023-04-06 13:45:08 +02:00
OlivierDehaene
45eacb782d patch qkv_rot 2023-04-06 13:45:08 +02:00
OlivierDehaene
cd5d0a96ba feat(server): add flash attention llama 2023-04-06 13:45:08 +02:00
OlivierDehaene
71402ed4c7 wip 2023-04-06 13:45:08 +02:00
OlivierDehaene
3f2542bb6a
fix(server): fix escape characters in stop sequence (#155) 2023-04-05 19:37:41 +02:00
OlivierDehaene
c0aeb32583
feat(server): flash santacoder (#153) 2023-04-03 19:06:42 +02:00