diff --git a/docs/source/conceptual/guidance.md b/docs/source/conceptual/guidance.md index 75be4ab7..0ce34f2f 100644 --- a/docs/source/conceptual/guidance.md +++ b/docs/source/conceptual/guidance.md @@ -59,6 +59,17 @@ This process can be broken down into the following steps: 4. The grammar mask is applied and the model samples from the remaining tokens. Once a token is chosen, we update the grammar state with the new token, to prepare it for the next pass. +
+ + +
+ ## How to use Guidance? There are two main ways to use guidance; you can either use the `/generate` endpoint with a grammar or use the `/chat/completion` endpoint with tools.