huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-24 08:22:07 +00:00
Code Issues Packages Projects Releases Wiki Activity
77ac0f364b
text-generation-inference/router/src
History
OlivierDehaene 20df9234a9 feat: move allocation logic to rust (#1835) 
Close #2007
2024-09-24 03:34:15 +00:00
..
infer feat: move allocation logic to rust (#1835) 2024-09-24 03:34:15 +00:00
config.rs router: send the input as chunks to the backend 2024-09-24 03:27:14 +00:00
lib.rs feat: add SchedulerV3 (#1996) 2024-09-24 03:28:31 +00:00
main.rs feat: add SchedulerV3 (#1996) 2024-09-24 03:28:31 +00:00
server.rs feat: add SchedulerV3 (#1996) 2024-09-24 03:28:31 +00:00
validation.rs feat: add SchedulerV3 (#1996) 2024-09-24 03:28:31 +00:00