mirror of
https://github.com/huggingface/text-generation-inference.git
synced 2025-04-25 20:12:07 +00:00
15 lines
197 B
Markdown
15 lines
197 B
Markdown
# BLOOM Inference Python gRPC Server
|
|
|
|
A Python gRPC server for BLOOM Inference
|
|
|
|
## Local Install (with poetry)
|
|
|
|
```shell
|
|
make install
|
|
```
|
|
|
|
## Local Install (with pip)
|
|
|
|
```shell
|
|
make pip-install
|
|
``` |