diff --git a/docs/source/conceptual/streaming.md b/docs/source/conceptual/streaming.md index f58eb2e6..a74db33b 100644 --- a/docs/source/conceptual/streaming.md +++ b/docs/source/conceptual/streaming.md @@ -4,7 +4,7 @@ With streaming, the server returns the tokens as the LLM generates them. This enables showing progressive generations to the user rather than waiting for the whole generation. Streaming is an essential aspect of the end-user experience as it reduces latency, one of the most critical aspects of a smooth experience. -