huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-21 23:12:07 +00:00
Code Issues Packages Projects Releases Wiki Activity
696 Commits 228 Branches 59 Tags 47 MiB
a1b65e5919
Commit Graph

3 Commits

Author SHA1 Message Date
OlivierDehaene
a1b65e5919 fix: fix CohereForAI/c4ai-command-r-plus (#1707) 
@Narsil @drbh this will update flash attention v2 and vllm.
You will need to re-install them.
 2024-04-25 17:51:35 +03:00
OlivierDehaene
79f268f95a chore: formatting 2024-04-18 16:26:00 +03:00
OlivierDehaene
12590fdcce
feat: paged attention v2 (#1183) 2023-10-23 12:29:25 +02:00