huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-29 22:12:07 +00:00
Code Issues Packages Projects Releases Wiki Activity

fix wording

Browse Source
This commit is contained in:
philschmid 2023-08-18 09:27:13 +02:00
parent eccb8a0099
commit 52cacff4a4
3 changed files with 5 additions and 5 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

6
docs/source/_toctree.yml
View File

@ -8,15 +8,15 @@
- local: supported_models - local: supported_models
title: Supported Models and Hardware title: Supported Models and Hardware
- local: launch_parameters - local: launch_parameters
title: Configuring TGI title: Launch Parameters
- local: guides - local: guides
title: Guides title: Guides
title: Getting started title: Getting started
- sections: - sections:
- local: basic_tutorials/consuming_tgi - local: basic_tutorials/consuming_tgi
title: Consuming TGI title: Consuming TGI
- local: basic_tutorials/customize_inference - local: basic_tutorials/request_parameters
title: Control/Customize Inference title: Request Parameters
- local: basic_tutorials/stream - local: basic_tutorials/stream
title: Stream Responses title: Stream Responses
- local: basic_tutorials/preparing_model - local: basic_tutorials/preparing_model

2
docs/source/basic_tutorials/customize_inference.md → docs/source/basic_tutorials/request_parameters.md
View File

@ -1,4 +1,4 @@
# Control/Customize Inference Generation with Text Generation Inference # Request Parameters for Text Generation Inference
Text Generation Inference support different parameters to control the generation, defining them in the `parameters`` attribute of the payload. Text Generation Inference support different parameters to control the generation, defining them in the `parameters`` attribute of the payload.

2
docs/source/launch_parameters.md
View File

@ -1,4 +1,4 @@
# Configuration parameters for Text Generation Inference # Launch Parameters for Text Generation Inference
Text Generation Inference allows you to customize the way you serve your models. You can use the following parameters to configure your server. You can enable them by adding them environment variables or by providing them as arguments when running `text-generation-launcher`. Environment variables are in `UPPER_CASE` and arguments are in `lower_case`. Text Generation Inference allows you to customize the way you serve your models. You can use the following parameters to configure your server. You can enable them by adding them environment variables or by providing them as arguments when running `text-generation-launcher`. Environment variables are in `UPPER_CASE` and arguments are in `lower_case`.