diff --git a/docs/source/reference/launcher.md b/docs/source/reference/launcher.md index 2d9b58d9..6505a08d 100644 --- a/docs/source/reference/launcher.md +++ b/docs/source/reference/launcher.md @@ -477,6 +477,15 @@ Options: [env: ENABLE_PREFILL_LOGPROBS=] +``` +## GRACEFUL_TERMINATION_TIMEOUT +```shell + -g, --graceful-termination-timeout + Change timeout of graceful termination of the TGI server + + [env: GRACEFUL_TERMINATION_TIMEOUT=] + [default: 90] + ``` ## HELP ```shell