text-generation-inference/docs/source/conceptual/streaming.md

18 lines
483 B
Markdown
Raw Permalink Normal View History

2023-08-11 13:03:56 +00:00
# Streaming
TODO: Add a side-by-side gif, one showing streaming and the other showing non streaming
<div class="block dark:hidden">
<iframe
src="https://osanseviero-streaming-vs-non-streaming.hf.space?__theme=light"
width="850"
height="1600"
></iframe>
</div>
<div class="hidden dark:block">
<iframe
src="https://osanseviero-streaming-vs-non-streaming.hf.space?__theme=dark"
width="850"
height="1600"
></iframe>
</div>