mirror of
https://github.com/huggingface/text-generation-inference.git
synced 2025-04-24 00:12:08 +00:00
15 lines
152 B
Markdown
15 lines
152 B
Markdown
# BLOOM Inference Python gRPC Server
|
|
|
|
A Python gRPC server for BLOOM Inference
|
|
|
|
## Install
|
|
|
|
```shell
|
|
make install
|
|
```
|
|
|
|
## Run
|
|
|
|
```shell
|
|
make run-dev
|
|
``` |