huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-09-10 20:04:52 +00:00
Code Issues Packages Projects Releases Wiki Activity

Added diff and dark/light mode for demo

Browse Source
This commit is contained in:
Merve Noyan 2023-08-18 17:13:31 +03:00 committed by GitHub
parent 117425564e
commit 3a2a13ecd5
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 25 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

27
docs/source/basic_tutorials/consuming_tgi.md
View File

@ -125,10 +125,33 @@ The UI looks like this 👇
You can try the demo directly here 👇
<gradio-app space="merve/gradio-tgi-2"></gradio-app>
<div class="block dark:hidden">
<iframe
src="https://merve-gradio-tgi-2.hf.space?__theme=light"
width="850"
height="350"
></iframe>
</div>
<div class="hidden dark:block">
<iframe
src="https://merve-gradio-tgi-2.hf.space?__theme=dark"
width="850"
height="350"
></iframe>
</div>
You can disable streaming mode using `return` instead of `yield` in your inference function.
You can disable streaming mode using `return` instead of `yield` in your inference function, like below.
```diff
def inference(message, history):
partial_message = ""
for token in client.text_generation(message, max_new_tokens=20, stream=True):
partial_message += token
- yield partial_message
+ return partial_message
```
You can read more about how to customize a `ChatInterface` [here](https://www.gradio.app/guides/creating-a-chatbot-fast).
## API documentation