huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-05-29 18:22:08 +00:00
Code Issues Packages Projects Releases Wiki Activity
725 Commits 234 Branches 61 Tags 30 MiB
1023de8048
Commit Graph

6 Commits

Author SHA1 Message Date
abhishek thakur
d9dcfe4521 Update libraries (#1713) 
Co-authored-by: Nicolas Patry <patry.nicolas@protonmail.com>
 2024-04-25 17:53:45 +03:00
OlivierDehaene
da4199ed97 feat: cohere (#1660) 2024-04-25 12:39:14 +03:00
OlivierDehaene
2ac1b55c95 v1.4.1 (#1568) 2024-04-24 15:42:59 +03:00
OlivierDehaene
efd4b97d15 v1.4.0 (#1494) 2024-04-22 15:47:42 +03:00
OlivierDehaene
a95e6d603d feat: relax mistral requirements (#1351) 
Close #1253
Close #1279
 2024-04-19 14:50:24 +03:00
fxmarty
b2b5df0e94
Add RoCm support (#1243) 
This PR adds support for AMD Instinct MI210 & MI250 GPUs, with paged
attention and FAv2 support.

Remaining items to discuss, on top of possible others:
* Should we have a
`ghcr.io/huggingface/text-generation-inference:1.1.0+rocm` hosted image,
or is it too early?
* Should we set up a CI on MI210/MI250? I don't have access to the
runners of TGI though.
* Are we comfortable with those changes being directly in TGI, or do we
need a fork?

---------

Co-authored-by: Felix Marty <felix@hf.co>
Co-authored-by: OlivierDehaene <olivier@huggingface.co>
Co-authored-by: Your Name <you@example.com>
 2023-11-27 14:08:12 +01:00