huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-10-10 07:25:23 +00:00
Code Issues Packages Projects Releases Wiki Activity
165 Commits 240 Branches 66 Tags 36 MiB
26fc232afb
Commit Graph

7 Commits

Author SHA1 Message Date
OlivierDehaene
26fc232afb fix tp 2023-04-06 17:27:32 +02:00
OlivierDehaene
7816a47697 fix llama tokenizer 2023-04-06 17:07:58 +02:00
OlivierDehaene
01ab5df180 update transformers 2023-04-06 13:45:08 +02:00
OlivierDehaene
47e93409f3 optional rust validation 2023-04-06 13:45:08 +02:00
OlivierDehaene
45eacb782d patch qkv_rot 2023-04-06 13:45:08 +02:00
OlivierDehaene
cd5d0a96ba feat(server): add flash attention llama 2023-04-06 13:45:08 +02:00
OlivierDehaene
71402ed4c7 wip 2023-04-06 13:45:08 +02:00