From 62b05f2ccf95c7b528f0f8a3ea19cf2cd9eae733 Mon Sep 17 00:00:00 2001 From: Merve Noyan Date: Tue, 12 Sep 2023 12:27:16 +0200 Subject: [PATCH] Update docs/source/supported_models.md Co-authored-by: Nicolas Patry --- docs/source/supported_models.md | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) diff --git a/docs/source/supported_models.md b/docs/source/supported_models.md index 5c4219d1..77041f75 100644 --- a/docs/source/supported_models.md +++ b/docs/source/supported_models.md @@ -28,7 +28,9 @@ AutoModelForCausalLM.from_pretrained(, device_map="auto")` AutoModelForSeq2SeqLM.from_pretrained(, device_map="auto") ``` -If you wish to serve a supported model that already exists on a local folder, you can use `weight-cache-override` flag like below. Otherwise, it will be downloaded to Hugging Face Hub cache. +If you wish to serve a supported model that already exists on a local folder, Just point to the local folder. + +text-generation-launcher --model-id ```bash text-generation-launcher --model-id bigscience/bloom --weights-cache-override