huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-23 16:02:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,230 Commits 229 Branches 59 Tags 23 MiB
a7c2a470d6
Commit Graph

4 Commits

Author SHA1 Message Date
Morgan Funtowicz
a7c2a470d6 backend(vllm): submit new request to vLLM engine 2025-01-27 22:39:35 +01:00
Morgan Funtowicz
02e4b9ab32 backend(vllm): plug in the tokio server and CLI 2025-01-24 10:41:07 +01:00
Morgan Funtowicz
bd2ec03d53 backend(vllm): statically allocate LLMEngine 2025-01-22 22:15:33 +01:00
Morgan Funtowicz
cfd22726c9 backend(vllm): initial commit 2025-01-21 23:37:56 +01:00