huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-24 00:12:08 +00:00
Code Issues Packages Projects Releases Wiki Activity
658 Commits 229 Branches 59 Tags 23 MiB
add-quickstart-script
Commit Graph

7 Commits

Author SHA1 Message Date
Nicolas Patry
f9ee2c41b9
Upgrading all versions. (#1759) 2024-04-18 17:17:40 +02:00
abhishek thakur
10d9083b2d
Update libraries (#1713) 
Co-authored-by: Nicolas Patry <patry.nicolas@protonmail.com>
 2024-04-11 10:37:35 +02:00
OlivierDehaene
1e9bcd9dd8
feat: cohere (#1660) 2024-03-22 17:59:25 +01:00
OlivierDehaene
4139054b82
v1.4.1 (#1568) 2024-02-16 17:50:57 +01:00
OlivierDehaene
c2d4a3b5c7
v1.4.0 (#1494) 2024-01-26 19:04:57 +01:00
OlivierDehaene
9b56d3fbf5
feat: relax mistral requirements (#1351) 
Close #1253 
Close #1279
 2023-12-15 12:52:24 +01:00
fxmarty
b2b5df0e94
Add RoCm support (#1243) 
This PR adds support for AMD Instinct MI210 & MI250 GPUs, with paged
attention and FAv2 support.

Remaining items to discuss, on top of possible others:
* Should we have a
`ghcr.io/huggingface/text-generation-inference:1.1.0+rocm` hosted image,
or is it too early?
* Should we set up a CI on MI210/MI250? I don't have access to the
runners of TGI though.
* Are we comfortable with those changes being directly in TGI, or do we
need a fork?

---------

Co-authored-by: Felix Marty <felix@hf.co>
Co-authored-by: OlivierDehaene <olivier@huggingface.co>
Co-authored-by: Your Name <you@example.com>
 2023-11-27 14:08:12 +01:00