mirror of
https://github.com/huggingface/text-generation-inference.git
synced 2025-04-22 15:32:08 +00:00
683ff53fa3
* wip(gaudi): import server and dockerfile from tgi-gaudi fork * feat(gaudi): new gaudi backend working * fix: fix style * fix prehooks issues * fix(gaudi): refactor server and implement requested changes
16 lines
173 B
Markdown
16 lines
173 B
Markdown
# Text Generation Inference Python gRPC Server
|
|
|
|
A Python gRPC server for Text Generation Inference
|
|
|
|
## Install
|
|
|
|
```shell
|
|
make install
|
|
```
|
|
|
|
## Run
|
|
|
|
```shell
|
|
make run-dev
|
|
```
|