OlivierDehaene ebc74d5666 feat(router): use number of tokens in batch as input for dynamic batching (#226) ... Co-authored-by: Nick Hill <nickhill@us.ibm.com>		2023-04-24 17:59:00 +02:00
..
models	feat(router): use number of tokens in batch as input for dynamic batching (#226)	2023-04-24 17:59:00 +02:00
utils	fix(server): fix escape characters in stop sequence (#155)	2023-04-05 19:37:41 +02:00
conftest.py	feat: support typical sampling (#114)	2023-03-09 11:33:57 +01:00