text-generation-inference/launcher
OlivierDehaene 518d30dec4 feat(router): add max_batch_size (#1542)
Some hardware require a maximum batch size.
2024-04-24 09:21:57 +00:00
..
src feat(router): add max_batch_size (#1542) 2024-04-24 09:21:57 +00:00
build.rs chore(github): add templates (#264) 2023-05-02 15:43:19 +02:00
Cargo.toml Update nix version (#102) 2024-03-11 16:21:04 +01:00