huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-21 23:12:07 +00:00
Code Issues Packages Projects Releases Wiki Activity
675 Commits 228 Branches 59 Tags 47 MiB
17f5c3078b
Commit Graph

5 Commits

Author SHA1 Message Date
fxmarty
17f5c3078b working & cached tunableop 2024-04-29 14:55:59 +00:00
Nicolas Patry
f9ee2c41b9
Upgrading all versions. (#1759) 2024-04-18 17:17:40 +02:00
OlivierDehaene
ad9d6288c8
fix: fix CohereForAI/c4ai-command-r-plus (#1707) 
@Narsil @drbh this will update flash attention v2 and vllm.
You will need to re-install them.
 2024-04-10 17:20:25 +02:00
OlivierDehaene
72ee382ded chore: formatting 2023-12-11 14:49:52 +01:00
OlivierDehaene
12590fdcce
feat: paged attention v2 (#1183) 2023-10-23 12:29:25 +02:00