From 9122e7bd9c310ea7cf6052c332ad00e6f60b02ae Mon Sep 17 00:00:00 2001 From: Guspan Tanadi <36249910+guspan-tanadi@users.noreply.github.com> Date: Tue, 4 Apr 2023 18:27:46 +0700 Subject: [PATCH] docs(readme): provide link Logits Warper README (#154) --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index ee724487..ad938bdd 100644 --- a/README.md +++ b/README.md @@ -46,7 +46,7 @@ to power LLMs api-inference widgets. - Quantization with [bitsandbytes](https://github.com/TimDettmers/bitsandbytes) - [Safetensors](https://github.com/huggingface/safetensors) weight loading - Watermarking with [A Watermark for Large Language Models](https://arxiv.org/abs/2301.10226) -- Logits warpers (temperature scaling, topk, repetition penalty ...) +- Logits warper (temperature scaling, top-p, top-k, repetition penalty, more details see [transformers.LogitsProcessor](https://huggingface.co/docs/transformers/internal/generation_utils#transformers.LogitsProcessor)) - Stop sequences - Log probabilities - Production ready (distributed tracing with Open Telemetry, Prometheus metrics)