From 7143130ba431ce27058b3b54cc59d2058bf2bb64 Mon Sep 17 00:00:00 2001 From: Nicolas Patry Date: Fri, 9 Feb 2024 11:44:42 +0000 Subject: [PATCH] Update docs after rebase. --- docs/source/basic_tutorials/launcher.md | 5 ++--- 1 file changed, 2 insertions(+), 3 deletions(-) diff --git a/docs/source/basic_tutorials/launcher.md b/docs/source/basic_tutorials/launcher.md index fd70474a..be31a7a4 100644 --- a/docs/source/basic_tutorials/launcher.md +++ b/docs/source/basic_tutorials/launcher.md @@ -198,23 +198,22 @@ Options: [default: 20] ``` - ## MAX_BATCH_SIZE ```shell --max-batch-size Enforce a maximum number of requests per batch Specific flag for hardware targets that do not support unpadded inference [env: MAX_BATCH_SIZE=] -``` +``` ## ENABLE_CUDA_GRAPHS ```shell --enable-cuda-graphs Enable experimental support for cuda graphs [env: ENABLE_CUDA_GRAPHS=] -``` +``` ## HOSTNAME ```shell --hostname