mirror of
https://github.com/huggingface/text-generation-inference.git
synced 2025-07-01 05:20:17 +00:00
requirements name - cabelo@opensuse.org (#237)
This commit is contained in:
parent
46b14e6b28
commit
9ae5ad5057
@ -7,7 +7,7 @@ This example provide a simple way of usage of `tgi-gaudi` with continuous batchi
|
|||||||
### Install
|
### Install
|
||||||
|
|
||||||
```
|
```
|
||||||
pip install -r requirements
|
pip install -r requirements.txt
|
||||||
```
|
```
|
||||||
|
|
||||||
### Setup TGI server
|
### Setup TGI server
|
||||||
@ -36,4 +36,4 @@ All possible parameters are described in the below table:
|
|||||||
| TOTAL_SAMPLE_COUNT | 2048 | Number of samples to run. |
|
| TOTAL_SAMPLE_COUNT | 2048 | Number of samples to run. |
|
||||||
| MAX_CONCURRENT_REQUESTS | 256 | The number of requests sent simultaneously to the TGI server. |
|
| MAX_CONCURRENT_REQUESTS | 256 | The number of requests sent simultaneously to the TGI server. |
|
||||||
|
|
||||||
</div>
|
</div>
|
||||||
|
Loading…
Reference in New Issue
Block a user