huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-21 23:12:07 +00:00
Code Issues Packages Projects Releases Wiki Activity
1ffea36ec2
text-generation-inference/router/src
History
OlivierDehaene 343437c7b5
feat(router): add device and dtype info (#215)
2023-04-21 15:36:29 +02:00
..
infer.rs feat(router): drop requests when client closes the channel (#202) 2023-04-20 11:07:40 +02:00
lib.rs feat(router): add device and dtype info (#215) 2023-04-21 15:36:29 +02:00
main.rs feat(router): add device and dtype info (#215) 2023-04-21 15:36:29 +02:00
queue.rs feat(router): drop requests when client closes the channel (#202) 2023-04-20 11:07:40 +02:00
server.rs feat(router): add device and dtype info (#215) 2023-04-21 15:36:29 +02:00
validation.rs fix(router): fix truncation (#190) 2023-04-17 16:51:53 +02:00