huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-21 23:12:07 +00:00
Code Issues Packages Projects Releases Wiki Activity
f11965c11d
text-generation-inference/server
History
Olivier Dehaene f11965c11d support deepspeed
2022-10-13 11:05:44 +02:00
..
bloom_inference support deepspeed 2022-10-13 11:05:44 +02:00
Makefile Init 2022-10-08 12:30:12 +02:00
poetry.lock support deepspeed 2022-10-13 11:05:44 +02:00
pyproject.toml support deepspeed 2022-10-13 11:05:44 +02:00
README.md Init 2022-10-08 12:30:12 +02:00

README.md

BLOOM Inference Python gRPC Server

A Python gRPC server for BLOOM Inference

Local Install (with poetry)

make install

Local Install (with pip)

make pip-install