From 3318a66a6daa13682fda09298e83a04b795016c4 Mon Sep 17 00:00:00 2001 From: rsnm2 Date: Sat, 19 Aug 2023 13:56:17 +0000 Subject: [PATCH] finished launch readme --- README.md | 14 ++++++++++++-- 1 file changed, 12 insertions(+), 2 deletions(-) diff --git a/README.md b/README.md index 77422777..e2bae362 100644 --- a/README.md +++ b/README.md @@ -47,8 +47,18 @@ Install DeepSparse: pip install deepsparse-nightly[transformers] ``` -Install Server / Router +Install Server ```shell make install-server -make install-router +``` + +Launch Server +```shell +python3 server/text_generation_server/cli.py download-weights bigscience/bloom-560m +python3 server/text_generation_server/cli.py serve bigscience/bloom-560m +``` + +Launch Router +```shell +make router-dev ``` \ No newline at end of file