huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-09-10 20:04:52 +00:00
Code Issues Packages Projects Releases Wiki Activity

Added space and replaced screenshots with llama

Browse Source
This commit is contained in:
Merve Noyan 2023-08-18 16:13:20 +03:00 committed by GitHub
parent e49ecbf4e5
commit 117425564e
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 7 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

9
docs/source/basic_tutorials/consuming_tgi.md
View File

@ -101,7 +101,7 @@ gr.ChatInterface(
inference,
chatbot=gr.Chatbot(height=300),
textbox=gr.Textbox(placeholder="Chat with me!", container=False, scale=7),
description="This is the demo for Gradio UI consuming TGI endpoint with Falcon model.",
description="This is the demo for Gradio UI consuming TGI endpoint with LLaMA 2 7B-Chat model.",
title="Gradio 🤝 TGI",
examples=["Are tomatoes vegetables?"],
retry_btn=None,
@ -119,10 +119,15 @@ The UI looks like this 👇
/>
<img
class="hidden dark:block"
src="https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/tgi/gradio-tgi.png"
src="https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/tgi/gradio-tgi-dark.png"
/>
</div>
You can try the demo directly here 👇
<gradio-app space="merve/gradio-tgi-2"></gradio-app>
You can disable streaming mode using `return` instead of `yield` in your inference function.
You can read more about how to customize a `ChatInterface` [here](https://www.gradio.app/guides/creating-a-chatbot-fast).