huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-21 06:42:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
feat/improve_max_tokens
text-generation-inference/router/src
History
OlivierDehaene a963495315 add logic to queue
2023-04-26 13:40:20 +02:00
..
infer.rs feat(router): use number of tokens in batch as input for dynamic batching (#226) 2023-04-24 17:59:00 +02:00
lib.rs feat(router): add endpoint info to /info route (#228) 2023-04-25 13:11:18 +02:00
main.rs feat(router): use number of tokens in batch as input for dynamic batching (#226) 2023-04-24 17:59:00 +02:00
queue.rs add logic to queue 2023-04-26 13:40:20 +02:00
server.rs feat(router): add endpoint info to /info route (#228) 2023-04-25 13:11:18 +02:00
validation.rs add logic to queue 2023-04-26 13:40:20 +02:00