huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-05-21 17:52:09 +00:00
Code Issues Packages Projects Releases Wiki Activity

Updating documentation.

Browse Source
This commit is contained in:
Nicolas Patry 2025-03-19 15:03:47 +01:00
parent 45075d167f
commit 7c030f0618
No known key found for this signature in database
GPG Key ID: 4242CEF24CB6DBF9
1 changed files with 9 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

9
docs/source/reference/launcher.md
View File

@ -477,6 +477,15 @@ Options:
[env: ENABLE_PREFILL_LOGPROBS=]
```
## GRACEFUL_TERMINATION_TIMEOUT
```shell
-g, --graceful-termination-timeout <GRACEFUL_TERMINATION_TIMEOUT>
Change timeout of graceful termination of the TGI server
[env: GRACEFUL_TERMINATION_TIMEOUT=]
[default: 90]
```
## HELP
```shell