huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-21 23:12:07 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,363 Commits 228 Branches 59 Tags 47 MiB
f124e8422c
Commit Graph

56 Commits

Author SHA1 Message Date
OlivierDehaene
895c5f1562
feat(server): only compute prefill logprobs when asked (#406) 
Close #288
 2023-06-02 17:12:30 +02:00
OlivierDehaene
b8b950b37c
feat(server): support RefinedWeb models (#379) 2023-05-30 18:25:19 +02:00
OlivierDehaene
942005386a
feat(router): log input/ouput at debug level (#364) 
@njhill FYI
 2023-05-23 20:47:37 +02:00
OlivierDehaene
5a58226130
fix(server): fix decode token (#334) 
Fixes #333

---------

Co-authored-by: Nicolas Patry <patry.nicolas@protonmail.com>
 2023-05-16 23:23:27 +02:00
OlivierDehaene
dbdc587ddd
feat(integration-tests): improve comparison and health checks (#336) 2023-05-16 20:22:11 +02:00
OlivierDehaene
e71471bec9
feat: add snapshot testing (#282) 2023-05-15 23:36:30 +02:00