text-generation-inference/router/client/src
Karol Damaszke bad7fe720a
Fix warmup shapes for corner cases (#136)
Co-authored-by: Karol Damaszke <kdamaszke@habana.ai>
2024-05-06 11:35:27 +02:00
..
pb chore: add pre-commit (#1569) 2024-04-24 15:32:02 +03:00
client.rs Fix warmup shapes for corner cases (#136) 2024-05-06 11:35:27 +02:00
lib.rs Outlines guided generation (#1539) 2024-04-24 14:57:37 +03:00
sharded_client.rs feat(router): add max_batch_size (#1542) 2024-04-24 09:21:57 +00:00