Add section about TGI on Gaudi in README

This commit is contained in:
regisss 2023-07-27 22:40:53 +02:00
parent 9f18f4c006
commit eba543222b

View File

@ -273,3 +273,9 @@ make rust-tests
# integration tests
make integration-tests
```
## Other supported hardware
TGI is also supported on the following AI hardware accelerators:
- *Habana first-gen Gaudi and Gaudi2:* checkout [here](https://github.com/huggingface/optimum-habana/tree/main/text-generation-inference) how to serve models with TGI on Gaudi and Gaudi2 with [Optimum Habana](https://huggingface.co/docs/optimum/habana/index)