huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-22 23:42:06 +00:00
Code Issues Packages Projects Releases Wiki Activity
1f70bb75e3
text-generation-inference/router/src
History
sunxichen a9faabc374 fix ChatCompletion and ChatCompletionChunk object string not compatible with standard openai api (#2089) 
Co-authored-by: sunxichen <sun.xc@digitalcnzz.com>
2024-09-24 03:51:26 +00:00
..
infer PR #2049 CI run (#2054) 2024-09-24 03:42:29 +00:00
config.rs router: send the input as chunks to the backend 2024-09-24 03:27:14 +00:00
kserve.rs implement Open Inference Protocol endpoints (#1942) 2024-09-24 03:42:29 +00:00
lib.rs fix ChatCompletion and ChatCompletionChunk object string not compatible with standard openai api (#2089) 2024-09-24 03:51:26 +00:00
main.rs Add OTLP Service Name Environment Variable (#2076) 2024-09-24 03:51:26 +00:00
server.rs implement Open Inference Protocol endpoints (#1942) 2024-09-24 03:42:29 +00:00
validation.rs feat: add SchedulerV3 (#1996) 2024-09-24 03:28:31 +00:00