From 7c030f0618335f69ef0e0cdcc588474b46ddd9a6 Mon Sep 17 00:00:00 2001 From: Nicolas Patry Date: Wed, 19 Mar 2025 15:03:47 +0100 Subject: [PATCH] Updating documentation. --- docs/source/reference/launcher.md | 9 +++++++++ 1 file changed, 9 insertions(+) diff --git a/docs/source/reference/launcher.md b/docs/source/reference/launcher.md index 2d9b58d9..6505a08d 100644 --- a/docs/source/reference/launcher.md +++ b/docs/source/reference/launcher.md @@ -477,6 +477,15 @@ Options: [env: ENABLE_PREFILL_LOGPROBS=] +``` +## GRACEFUL_TERMINATION_TIMEOUT +```shell + -g, --graceful-termination-timeout + Change timeout of graceful termination of the TGI server + + [env: GRACEFUL_TERMINATION_TIMEOUT=] + [default: 90] + ``` ## HELP ```shell