text-generation-inference/docs/source/conceptual/streaming.md
2023-08-11 15:03:56 +02:00

18 lines
483 B
Markdown

# Streaming
TODO: Add a side-by-side gif, one showing streaming and the other showing non streaming
<div class="block dark:hidden">
<iframe
src="https://osanseviero-streaming-vs-non-streaming.hf.space?__theme=light"
width="850"
height="1600"
></iframe>
</div>
<div class="hidden dark:block">
<iframe
src="https://osanseviero-streaming-vs-non-streaming.hf.space?__theme=dark"
width="850"
height="1600"
></iframe>
</div>