huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-10-13 17:05:24 +00:00
Code Issues Packages Projects Releases Wiki Activity
168 Commits 240 Branches 66 Tags 36 MiB
e4ad3066bc
Commit Graph

9 Commits

Author SHA1 Message Date
OlivierDehaene
e4ad3066bc fmt 2023-04-06 20:09:21 +02:00
OlivierDehaene
1111125092 better docker layer caching 2023-04-06 20:08:46 +02:00
OlivierDehaene
26fc232afb fix tp 2023-04-06 17:27:32 +02:00
OlivierDehaene
7816a47697 fix llama tokenizer 2023-04-06 17:07:58 +02:00
OlivierDehaene
01ab5df180 update transformers 2023-04-06 13:45:08 +02:00
OlivierDehaene
47e93409f3 optional rust validation 2023-04-06 13:45:08 +02:00
OlivierDehaene
45eacb782d patch qkv_rot 2023-04-06 13:45:08 +02:00
OlivierDehaene
cd5d0a96ba feat(server): add flash attention llama 2023-04-06 13:45:08 +02:00
OlivierDehaene
71402ed4c7 wip 2023-04-06 13:45:08 +02:00