huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-27 04:52:07 +00:00
Code Issues Packages Projects Releases Wiki Activity
308 Commits 230 Branches 59 Tags 24 MiB
377c01e21e
Commit Graph

6 Commits

Author SHA1 Message Date
OlivierDehaene
895c5f1562
feat(server): only compute prefill logprobs when asked (#406) 
Close #288
 2023-06-02 17:12:30 +02:00
OlivierDehaene
951930fbff
feat(benchmarker): add summary tables (#368) 2023-05-25 13:38:36 +02:00
OlivierDehaene
218c9adaa5
feat: decrease IPC proto size (#367) 
Closes #307 #308
 2023-05-24 19:19:57 +02:00
OlivierDehaene
7de8a377b0 fix(benchmarking): fix benchmarking tool 2023-04-26 00:54:27 +02:00
OlivierDehaene
9987960062
feat(router): make router input validation optional (#164) 2023-04-09 20:22:27 +02:00
OlivierDehaene
610bb1f978
feat(benchmark): tui based benchmarking tool (#149) 2023-03-30 15:26:27 +02:00