From 38652c9da54259640e531318c1a9e9a8ed5e29c8 Mon Sep 17 00:00:00 2001 From: osanseviero Date: Wed, 9 Aug 2023 21:43:05 +0200 Subject: [PATCH] Replace CLI command with docker run IMG --help, it gets improved after #799 --- docs/source/docker_launch.md | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/docs/source/docker_launch.md b/docs/source/docker_launch.md index 9f1c89fb..3ed675c4 100644 --- a/docs/source/docker_launch.md +++ b/docs/source/docker_launch.md @@ -17,8 +17,8 @@ To use GPUs, you need to install the [NVIDIA Container Toolkit](https://docs.nvi -To see all options to serve your models, check in the [codebase](https://github.com/huggingface/text-generation-inference/blob/main/launcher/src/main.rs) or the CLI: +To see all possible flags and options, you can use the `--help` flag. It's possible to configure the number of shards, quantization, generation parameters, and more. -```shell -text-generation-launcher --help ``` +docker run ghcr.io/huggingface/text-generation-inference:1.0.0 --help +``` \ No newline at end of file