mirror of
https://github.com/huggingface/text-generation-inference.git
synced 2025-04-27 21:12:07 +00:00
16 lines
173 B
Markdown
16 lines
173 B
Markdown
|
# Text Generation Inference Python gRPC Server
|
||
|
|
|
||
|
|
A Python gRPC server for Text Generation Inference
|
||
|
|
|
||
|
|
## Install
|
||
|
|
|
||
|
|
```shell
|
||
|
|
make install
|
||
|
|
```
|
||
|
|
|
||
|
|
## Run
|
||
|
|
|
||
|
|
```shell
|
||
|
|
make run-dev
|
||
|
|
```
|