text-generation-inference/server/text_generation_server/utils
drbh ab59a5e346 feat: improve temperature logic in chat (#1749)
This PR adds support for `do_sample` to chat to enable greedy sampling

---------

Co-authored-by: Nicolas Patry <patry.nicolas@protonmail.com>
2024-06-10 09:50:25 +03:00
..
awq ROCm AWQ support (#1514) 2024-04-24 09:21:34 +00:00
gptq chore: add pre-commit (#1569) 2024-04-24 15:32:02 +03:00
__init__.py Pad next token chooser parameters with empty logits processors (#151) 2024-05-29 22:43:56 +02:00
convert.py Force weights_only (before fully breaking pickle files anyway). (#1710) 2024-04-25 15:10:53 +03:00
debug.py Add Habana copyright header (#122) 2024-04-08 18:06:21 +02:00
dist.py Add changes from Optimum Habana's TGI folder 2023-12-05 11:12:16 +01:00
flash_attn.py fix: fix CohereForAI/c4ai-command-r-plus (#1707) 2024-04-25 17:51:35 +03:00
hub.py Revamp medusa implementation so that every model can benefit. (#1588) 2024-04-25 09:13:03 +03:00
import_utils.py Add RoCm support (#1243) 2023-11-27 14:08:12 +01:00
layers.py Phi3 support (#1797) 2024-06-10 09:27:01 +03:00
log.py v1.3.4 2024-04-22 09:08:34 +03:00
logits_process.py fix: avoid frequency and repetition penalty on padding tokens (#1765) 2024-06-10 09:29:20 +03:00
paged_attention.py Upgrading all versions. (#1759) 2024-06-03 15:39:47 +03:00
peft.py fix: fix local loading for .bin models (#1419) 2024-04-22 09:17:52 +03:00
speculate.py chore: formatting 2024-04-18 16:26:00 +03:00
tokens.py feat: improve temperature logic in chat (#1749) 2024-06-10 09:50:25 +03:00
watermark.py Add changes from Optimum Habana's TGI folder 2023-12-05 11:12:16 +01:00
weights.py Phi3 support (#1797) 2024-06-10 09:27:01 +03:00