text-generation-inference/docs
OlivierDehaene 532146338b
feat(router): add max_batch_size (#1542)
Some hardware require a maximum batch size.
2024-02-09 12:38:41 +01:00
..
source feat(router): add max_batch_size (#1542) 2024-02-09 12:38:41 +01:00
index.html feat(router): refactor API and add openAPI schemas (#53) 2023-02-03 12:43:37 +01:00
openapi.json v1.4.0 (#1494) 2024-01-26 19:04:57 +01:00