huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-24 00:12:08 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,241 Commits 229 Branches 59 Tags 23 MiB
c871d74b46
Commit Graph

2 Commits

Author SHA1 Message Date
Daniël de Kok
c8c7ccd31e
Set maximum grpc message receive size to 2GiB (#2075) 
* Set maximum grpc message receive size to 2GiB

The previous default was 4MiB, which doesn't really work well for
multi-modal models.

* Update to Rust 1.79.0

* Fixup formatting to make PR pass
 2024-06-17 16:40:44 +02:00
OlivierDehaene
610bb1f978
feat(benchmark): tui based benchmarking tool (#149) 2023-03-30 15:26:27 +02:00