huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-27 04:52:07 +00:00
Code Issues Packages Projects Releases Wiki Activity
383 Commits 230 Branches 59 Tags 24 MiB
d8f1337e7e
Commit Graph

8 Commits

Author SHA1 Message Date
Nicolas Patry
e6888d0e87
docs(benchmarker): Adding some help for the options in text-generation-benchmark. (#462) 2023-07-04 18:35:37 +02:00
OlivierDehaene
895c5f1562
feat(server): only compute prefill logprobs when asked (#406) 
Close #288
 2023-06-02 17:12:30 +02:00
OlivierDehaene
951930fbff
feat(benchmarker): add summary tables (#368) 2023-05-25 13:38:36 +02:00
OlivierDehaene
218c9adaa5
feat: decrease IPC proto size (#367) 
Closes #307 #308
 2023-05-24 19:19:57 +02:00
OlivierDehaene
0e9d249b79
feat(benchmark): add support for private tokenizers (#262) 2023-04-29 12:17:30 +02:00
OlivierDehaene
7de8a377b0 fix(benchmarking): fix benchmarking tool 2023-04-26 00:54:27 +02:00
OlivierDehaene
9987960062
feat(router): make router input validation optional (#164) 2023-04-09 20:22:27 +02:00
OlivierDehaene
610bb1f978
feat(benchmark): tui based benchmarking tool (#149) 2023-03-30 15:26:27 +02:00