huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-24 00:12:08 +00:00
Code Issues Packages Projects Releases Wiki Activity
39df4d9975
text-generation-inference/server
History
Olivier Dehaene 4c693e6524 Refactored gRPC interface 
Added validation logic
2022-10-11 16:50:54 +02:00
..
bloom_inference Refactored gRPC interface 2022-10-11 16:50:54 +02:00
Makefile Init 2022-10-08 12:30:12 +02:00
poetry.lock Init 2022-10-08 12:30:12 +02:00
pyproject.toml Init 2022-10-08 12:30:12 +02:00
README.md Init 2022-10-08 12:30:12 +02:00

README.md

BLOOM Inference Python gRPC Server

A Python gRPC server for BLOOM Inference

Local Install (with poetry)

make install

Local Install (with pip)

make pip-install