From c48c2cc1fe2d6235f762adc8d243f244ccaeeece Mon Sep 17 00:00:00 2001 From: Merve Noyan Date: Wed, 9 Aug 2023 21:35:47 +0300 Subject: [PATCH] Add gated docs (#797) Added a section on private & gated model access. --------- Co-authored-by: Omar Sanseviero --- docs/source/_toctree.yml | 2 ++ docs/source/basic_tutorials/gated_model_access.md | 5 +++++ 2 files changed, 7 insertions(+) create mode 100644 docs/source/basic_tutorials/gated_model_access.md diff --git a/docs/source/_toctree.yml b/docs/source/_toctree.yml index 52e2af02..598e439e 100644 --- a/docs/source/_toctree.yml +++ b/docs/source/_toctree.yml @@ -13,4 +13,6 @@ title: Consuming TGI - local: basic_tutorials/preparing_model title: Preparing Model for Serving + - local: basic_tutorials/gated_model_access + title: Serving Private & Gated Models title: Tutorials diff --git a/docs/source/basic_tutorials/gated_model_access.md b/docs/source/basic_tutorials/gated_model_access.md new file mode 100644 index 00000000..f5858dc4 --- /dev/null +++ b/docs/source/basic_tutorials/gated_model_access.md @@ -0,0 +1,5 @@ +# Serving Private & Gated Models + +If the model you wish to serve is behind gated access or the model repository on Hugging Face Hub is private, and you have access to the model, you can provide your Hugging Face Hub access token. You can generate and copy a read token from [Hugging Face Hub tokens page](https://huggingface.co/settings/tokens) + +If you're using the CLI, set the `HUGGING_FACE_HUB_TOKEN` environment variable.