diff --git a/docs/source/basic_tutorials/launcher.md b/docs/source/basic_tutorials/launcher.md index fd70474a..be31a7a4 100644 --- a/docs/source/basic_tutorials/launcher.md +++ b/docs/source/basic_tutorials/launcher.md @@ -198,23 +198,22 @@ Options: [default: 20] ``` - ## MAX_BATCH_SIZE ```shell --max-batch-size Enforce a maximum number of requests per batch Specific flag for hardware targets that do not support unpadded inference [env: MAX_BATCH_SIZE=] -``` +``` ## ENABLE_CUDA_GRAPHS ```shell --enable-cuda-graphs Enable experimental support for cuda graphs [env: ENABLE_CUDA_GRAPHS=] -``` +``` ## HOSTNAME ```shell --hostname