huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-09-10 20:04:52 +00:00
Code Issues Packages Projects Releases Wiki Activity

Replace CLI command with docker run IMG --help, it gets improved after #799

Browse Source
This commit is contained in:
osanseviero 2023-08-09 21:43:05 +02:00
parent c48c2cc1fe
commit 38652c9da5
1 changed files with 3 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

6
docs/source/docker_launch.md
View File

@ -17,8 +17,8 @@ To use GPUs, you need to install the [NVIDIA Container Toolkit](https://docs.nvi
</Tip> </Tip>
To see all options to serve your models, check in the [codebase](https://github.com/huggingface/text-generation-inference/blob/main/launcher/src/main.rs) or the CLI: To see all possible flags and options, you can use the `--help` flag. It's possible to configure the number of shards, quantization, generation parameters, and more.
```shell
text-generation-launcher --help
``` ```
docker run ghcr.io/huggingface/text-generation-inference:1.0.0 --help
```