diff --git a/docs/source/supported_models.md b/docs/source/supported_models.md index 5c4219d1..77041f75 100644 --- a/docs/source/supported_models.md +++ b/docs/source/supported_models.md @@ -28,7 +28,9 @@ AutoModelForCausalLM.from_pretrained(, device_map="auto")` AutoModelForSeq2SeqLM.from_pretrained(, device_map="auto") ``` -If you wish to serve a supported model that already exists on a local folder, you can use `weight-cache-override` flag like below. Otherwise, it will be downloaded to Hugging Face Hub cache. +If you wish to serve a supported model that already exists on a local folder, Just point to the local folder. + +text-generation-launcher --model-id ```bash text-generation-launcher --model-id bigscience/bloom --weights-cache-override