huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-09-10 20:04:52 +00:00
Code Issues Packages Projects Releases Wiki Activity

Update using_cli.md

Browse Source
This commit is contained in:
Merve Noyan 2023-08-10 15:55:44 +03:00 committed by GitHub
parent 4d5fc1235f
commit 6523e8f2a7
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 3 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

6
docs/source/basic_tutorials/using_cli.md
View File

@ -10,19 +10,19 @@ text-generation-server download-weights MODEL_HUB_ID
You can also use it to quantize models like below 👇 You can also use it to quantize models like below 👇
```shell ```bash
text-generation-server quantize MODEL_HUB_ID OUTPUT_DIR text-generation-server quantize MODEL_HUB_ID OUTPUT_DIR
``` ```
You can use `text-generation-launcher` to serve models. You can use `text-generation-launcher` to serve models.
```shell ```bash
text-generation-launcher --model-id MODEL_HUB_ID --port 8080 text-generation-launcher --model-id MODEL_HUB_ID --port 8080
``` ```
There are many options and parameters you can pass to `text-generation-launcher`. The documentation for CLI is kept minimal and intended to rely on self-generating documentation, which can be found by running There are many options and parameters you can pass to `text-generation-launcher`. The documentation for CLI is kept minimal and intended to rely on self-generating documentation, which can be found by running
```shell ```bash
text-generation-launcher --help text-generation-launcher --help
``` ```