huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-10-09 15:05:24 +00:00
Code Issues Packages Projects Releases Wiki Activity
149 Commits 240 Branches 66 Tags 36 MiB
1dd2c24b9c
Commit Graph

4 Commits

Author SHA1 Message Date
OlivierDehaene
47e93409f3 optional rust validation 2023-04-06 13:45:08 +02:00
OlivierDehaene
45eacb782d patch qkv_rot 2023-04-06 13:45:08 +02:00
OlivierDehaene
cd5d0a96ba feat(server): add flash attention llama 2023-04-06 13:45:08 +02:00
OlivierDehaene
71402ed4c7 wip 2023-04-06 13:45:08 +02:00