From 4cdc692023951e51e2ee5cf255a42659fce62fa3 Mon Sep 17 00:00:00 2001 From: drbh Date: Tue, 30 Apr 2024 15:24:16 -0400 Subject: [PATCH] feat: add sampling gif --- docs/source/conceptual/guidance.md | 11 +++++++++++ 1 file changed, 11 insertions(+) diff --git a/docs/source/conceptual/guidance.md b/docs/source/conceptual/guidance.md index 75be4ab7..0ce34f2f 100644 --- a/docs/source/conceptual/guidance.md +++ b/docs/source/conceptual/guidance.md @@ -59,6 +59,17 @@ This process can be broken down into the following steps: 4. The grammar mask is applied and the model samples from the remaining tokens. Once a token is chosen, we update the grammar state with the new token, to prepare it for the next pass. +
+ + +
+ ## How to use Guidance? There are two main ways to use guidance; you can either use the `/generate` endpoint with a grammar or use the `/chat/completion` endpoint with tools.