text-generation-inference/docs
OlivierDehaene 518d30dec4 feat(router): add max_batch_size (#1542)
Some hardware require a maximum batch size.
2024-04-24 09:21:57 +00:00
..
source feat(router): add max_batch_size (#1542) 2024-04-24 09:21:57 +00:00
index.html feat(router): refactor API and add openAPI schemas (#53) 2023-02-03 12:43:37 +01:00
openapi.json v1.4.0 (#1494) 2024-04-22 15:47:42 +03:00