text-generation-inference/.github/workflows
fxmarty b2b5df0e94
Add RoCm support (#1243)
This PR adds support for AMD Instinct MI210 & MI250 GPUs, with paged
attention and FAv2 support.

Remaining items to discuss, on top of possible others:
* Should we have a
`ghcr.io/huggingface/text-generation-inference:1.1.0+rocm` hosted image,
or is it too early?
* Should we set up a CI on MI210/MI250? I don't have access to the
runners of TGI though.
* Are we comfortable with those changes being directly in TGI, or do we
need a fork?

---------

Co-authored-by: Felix Marty <felix@hf.co>
Co-authored-by: OlivierDehaene <olivier@huggingface.co>
Co-authored-by: Your Name <you@example.com>
2023-11-27 14:08:12 +01:00
..
autodocs.yml Automatic docs for TGI (#1045) 2023-09-27 16:01:38 +02:00
build_documentation.yml fix: remove useless token (#1179) 2023-10-19 14:04:44 +02:00
build_pr_documentation.yml [docs] Build docs only when doc files change (#812) 2023-08-11 07:07:53 +02:00
build.yaml Add RoCm support (#1243) 2023-11-27 14:08:12 +01:00
client-tests.yaml feat(server): add watermarking tests (#248) 2023-04-27 19:16:35 +02:00
delete_doc_comment.yml Setup for doc-builder and docs for TGI (#740) 2023-08-10 10:24:52 +02:00
load_test.yaml chore: migrate ci region for more availability. (#581) 2023-07-12 10:01:01 +02:00
tests.yaml Local gptq support. (#738) 2023-07-31 10:32:52 +02:00
upload_pr_documentation.yml Setup for doc-builder and docs for TGI (#740) 2023-08-10 10:24:52 +02:00