huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-25 03:52:08 +00:00
Code Issues Packages Projects Releases Wiki Activity
678 Commits 229 Branches 59 Tags 24 MiB
ff5e16b0e2
Commit Graph

7 Commits

Author SHA1 Message Date
fxmarty
ff5e16b0e2 working tunable 2024-05-02 13:29:20 +00:00
fxmarty
2677bf856a wip fix tunableop 2024-05-02 08:15:52 +00:00
fxmarty
17f5c3078b working & cached tunableop 2024-04-29 14:55:59 +00:00
Nicolas Patry
f9ee2c41b9
Upgrading all versions. (#1759) 2024-04-18 17:17:40 +02:00
OlivierDehaene
ad9d6288c8
fix: fix CohereForAI/c4ai-command-r-plus (#1707) 
@Narsil @drbh this will update flash attention v2 and vllm.
You will need to re-install them.
 2024-04-10 17:20:25 +02:00
OlivierDehaene
72ee382ded chore: formatting 2023-12-11 14:49:52 +01:00
OlivierDehaene
12590fdcce
feat: paged attention v2 (#1183) 2023-10-23 12:29:25 +02:00