From d05a9814dc4620d943bb1b1b7ebc4f53153a6481 Mon Sep 17 00:00:00 2001 From: drbh Date: Tue, 23 Apr 2024 02:39:02 -0400 Subject: [PATCH] fix: remove trailing space from docs --- docs/source/conceptual/speculation.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/source/conceptual/speculation.md b/docs/source/conceptual/speculation.md index f306c48a..0257b488 100644 --- a/docs/source/conceptual/speculation.md +++ b/docs/source/conceptual/speculation.md @@ -36,7 +36,7 @@ In order to use medusa models in TGI, simply point to a medusa enabled model, an If you don't have a medusa model, or don't have the resource to fine-tune, you can try to use `n-gram`. -N-gram works by trying to find matching tokens in the previous sequence, and use those as speculation for generating new tokens. For example, if the tokens "np.mean" appear multiple times in the sequence, the model can speculate that the next continuation of the tokens "np." is probably also "mean". +N-gram works by trying to find matching tokens in the previous sequence, and use those as speculation for generating new tokens. For example, if the tokens "np.mean" appear multiple times in the sequence, the model can speculate that the next continuation of the tokens "np." is probably also "mean". This is an extremely simple method, which works best for code, or highly repetitive text. This might not be beneficial, if the speculation misses too much.