huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-09-12 04:44:52 +00:00
Code Issues Packages Projects Releases Wiki Activity

Last nit

Browse Source
This commit is contained in:
Vaibhav Srivastav 2024-08-16 12:23:48 +02:00
parent 0e09eeacfc
commit ec4ea88109
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
docs/source/conceptual/streaming.md
View File

@ -101,7 +101,7 @@ asyncio.run(main())
To use the OpenAI Chat Completions compatible Messages API `v1/chat/completions` endpoint with curl, you can add the `-N` flag, which disables curl default buffering and shows data as it arrives from the server To use the OpenAI Chat Completions compatible Messages API `v1/chat/completions` endpoint with curl, you can add the `-N` flag, which disables curl default buffering and shows data as it arrives from the server
```curl ```curl
curl localhost:3000/v1/chat/completions \ curl localhost:8080/v1/chat/completions \
-X POST \ -X POST \
-d '{ -d '{
"model": "tgi", "model": "tgi",