huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-10-11 16:05:24 +00:00
Code Issues Packages Projects Releases Wiki Activity
604b18bec2
text-generation-inference/server
History
Nicolas Patry 604b18bec2
Reworked follwoing https://github.com/huggingface/transformers_bloom_parallel/pull/7
2022-10-21 20:47:57 +02:00
..
bloom_inference Reworked follwoing https://github.com/huggingface/transformers_bloom_parallel/pull/7 2022-10-21 20:47:57 +02:00
.gitignore v0.1.0 2022-10-20 19:14:44 +02:00
Makefile v0.1.0 2022-10-20 19:14:44 +02:00
poetry.lock v0.1.0 2022-10-20 19:14:44 +02:00
pyproject.toml v0.1.0 2022-10-20 19:14:44 +02:00
README.md Init 2022-10-08 12:30:12 +02:00

README.md

BLOOM Inference Python gRPC Server

A Python gRPC server for BLOOM Inference

Local Install (with poetry)

make install

Local Install (with pip)

make pip-install