huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-10-10 23:45:23 +00:00
Code Issues Packages Projects Releases Wiki Activity
75adbb3441
text-generation-inference/server
History
OlivierDehaene 75adbb3441 feat(weights): Support safetensors
2022-10-22 19:46:05 +02:00
..
bloom_inference feat(weights): Support safetensors 2022-10-22 19:46:05 +02:00
.gitignore feat(weights): Support safetensors 2022-10-22 19:46:05 +02:00
Makefile feat(weights): Support safetensors 2022-10-22 19:46:05 +02:00
poetry.lock feat(weights): Support safetensors 2022-10-22 19:46:05 +02:00
pyproject.toml v0.1.0 2022-10-20 19:14:44 +02:00
README.md feat(weights): Support safetensors 2022-10-22 19:46:05 +02:00

README.md

BLOOM Inference Python gRPC Server

A Python gRPC server for BLOOM Inference

Install

make install

Run

make run-dev