huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-09-11 04:14:52 +00:00
Code Issues Packages Projects Releases Wiki Activity

fix: update docs and move arg position in file

Browse Source
This commit is contained in:
drbh 2024-01-26 10:55:35 -05:00
parent f660fcf715
commit f7a8454d43
2 changed files with 12 additions and 4 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

8
docs/source/basic_tutorials/launcher.md
View File

@ -354,6 +354,14 @@ Options:
[env: NGROK_EDGE=]
```
### TOKENIZER_CONFIG_PATH
```shell
--tokenizer-config-path <TOKENIZER_CONFIG_PATH>
The path to the tokenizer config file. This path is used to load the tokenizer configuration which may include a `chat_template`. If not provided, the default config will be used from the model hub.
[env: TOKENIZER_CONFIG_PATH=]
```
## ENV
```shell

8
launcher/src/main.rs
View File

@ -368,13 +368,13 @@ struct Args {
#[clap(long, env)]
ngrok_edge: Option<String>,
/// Display a lot of information about your runtime environment
#[clap(long, short, action)]
env: bool,
/// path to the tokenizer config file
#[clap(long, env)]
tokenizer_config_path: Option<String>,
/// Display a lot of information about your runtime environment
#[clap(long, short, action)]
env: bool,
}
#[derive(Debug)]