text-generation-inference/router/client/src
yuanwu2017 3e28d7aa42
Align the default value with server's (#111)
Signed-off-by: yuanwu <yuan.wu@intel.com>
2024-04-01 12:44:20 +02:00
..
pb Init 2022-10-08 12:30:12 +02:00
client.rs Align the default value with server's (#111) 2024-04-01 12:44:20 +02:00
lib.rs feat: decrease IPC proto size (#367) 2023-05-24 19:19:57 +02:00
sharded_client.rs Adjust warmup to all possible bucket sizes and decode batch size = 1 (#113) 2024-03-27 11:59:51 +01:00