From 801c7df18bb962468e494365fba6c07371143114 Mon Sep 17 00:00:00 2001 From: Merve Noyan Date: Fri, 4 Aug 2023 22:40:08 +0300 Subject: [PATCH] Update docs/source/supported_models.md Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com> --- docs/source/supported_models.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/source/supported_models.md b/docs/source/supported_models.md index 3024691b..c0a80f87 100644 --- a/docs/source/supported_models.md +++ b/docs/source/supported_models.md @@ -19,7 +19,7 @@ The following models are optimized and can be served with TGI: - [MPT](https://huggingface.co/mosaicml/mpt-30b) - [Llama V2](https://huggingface.co/meta-llama) -If the above list lacks the model you would like to serve, depending on the model's pipeline type, you can try to initialize and serve the model on best-effort basis like below: +If the above list lacks the model you would like to serve, depending on the model's pipeline type, you can try to initialize and serve the model anyways to see how well it performs but performance isn't guaranteed for non-optimized models: `AutoModelForCausalLM.from_pretrained(, device_map="auto")`