mirror of
https://github.com/huggingface/text-generation-inference.git
synced 2025-04-24 00:12:08 +00:00
15 lines
197 B
Markdown
15 lines
197 B
Markdown
|
# BLOOM Inference Python gRPC Server
|
||
|
|
|
||
|
|
A Python gRPC server for BLOOM Inference
|
||
|
|
|
||
|
|
## Local Install (with poetry)
|
||
|
|
|
||
|
|
```shell
|
||
|
|
make install
|
||
|
|
```
|
||
|
|
|
||
|
|
## Local Install (with pip)
|
||
|
|
|
||
|
|
```shell
|
||
|
|
make pip-install
|
||
|
|
```
|