huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-09-10 20:04:52 +00:00
Code Issues Packages Projects Releases Wiki Activity

Update README.md

Browse Source 
Co-authored-by: Nicolas Patry <patry.nicolas@protonmail.com>
This commit is contained in:
Adarsh Shirawalmath 2023-08-15 22:42:07 +05:30 committed by GitHub
parent 2f7473b454
commit 782b3e5d86
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 0 additions and 4 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
README.md
View File

@ -94,10 +94,6 @@ To see all options to serve your models (in the [code](https://github.com/huggin
```
text-generation-launcher --help
```
For a basic run, you can start the server as follows:
```shell
text-generation-launcher --model-id tiiuae/falcon-7b-instruct --num-shard 1 # You can change the model-id accordingly
```
You can then query the model using either the `/generate` or `/generate_stream` routes: