diff --git a/docs/source/supported_models.md b/docs/source/supported_models.md index d997c8d8..f18e7397 100644 --- a/docs/source/supported_models.md +++ b/docs/source/supported_models.md @@ -28,6 +28,10 @@ AutoModelForCausalLM.from_pretrained(, device_map="auto")` AutoModelForSeq2SeqLM.from_pretrained(, device_map="auto") ``` +If you wish to serve a different version of a model that exists in a local folder, you can use `weight-cache-override` flag like below 👇 +```bash +text-generation-launcher --model-id bigscience/bloom --weights-cache-override +``` ## Supported Hardware