8 Commits

Author	SHA1	Message	Date
Nicolas Patry	e6888d0e87	docs(benchmarker): Adding some help for the options in text-generation-benchmark. (#462)	2023-07-04 18:35:37 +02:00
OlivierDehaene	895c5f1562	feat(server): only compute prefill logprobs when asked (#406) ... Close #288	2023-06-02 17:12:30 +02:00
OlivierDehaene	951930fbff	feat(benchmarker): add summary tables (#368)	2023-05-25 13:38:36 +02:00
OlivierDehaene	218c9adaa5	feat: decrease IPC proto size (#367) ... Closes #307 #308	2023-05-24 19:19:57 +02:00
OlivierDehaene	0e9d249b79	feat(benchmark): add support for private tokenizers (#262)	2023-04-29 12:17:30 +02:00
OlivierDehaene	7de8a377b0	fix(benchmarking): fix benchmarking tool	2023-04-26 00:54:27 +02:00
OlivierDehaene	9987960062	feat(router): make router input validation optional (#164)	2023-04-09 20:22:27 +02:00
OlivierDehaene	610bb1f978	feat(benchmark): tui based benchmarking tool (#149)	2023-03-30 15:26:27 +02:00