Sun Choi fff1d4f86f Add bucket for input seq len exactly same as --max-input-length (#178)		2024-07-05 10:30:26 +02:00
..
pb	chore: add pre-commit (#1569)	2024-04-24 15:32:02 +03:00
client.rs	Add bucket for input seq len exactly same as --max-input-length (#178)	2024-07-05 10:30:26 +02:00
lib.rs	Outlines guided generation (#1539)	2024-04-24 14:57:37 +03:00
sharded_client.rs	feat(router): add max_batch_size (#1542)	2024-04-24 09:21:57 +00:00