huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-23 07:52:06 +00:00
Code Issues Packages Projects Releases Wiki Activity
724fa6fe0e
text-generation-inference/router/src
History
OlivierDehaene 8aece3bd68
feat: move allocation logic to rust (#1835) 
Close #2007
2024-06-05 12:18:38 +02:00
..
infer feat: move allocation logic to rust (#1835) 2024-06-05 12:18:38 +02:00
config.rs router: send the input as chunks to the backend 2024-06-03 17:02:41 +02:00
lib.rs feat: add SchedulerV3 (#1996) 2024-06-04 15:56:56 +02:00
main.rs feat: add SchedulerV3 (#1996) 2024-06-04 15:56:56 +02:00
server.rs feat: add SchedulerV3 (#1996) 2024-06-04 15:56:56 +02:00
validation.rs feat: add SchedulerV3 (#1996) 2024-06-04 15:56:56 +02:00