huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-24 16:32:12 +00:00
Code Issues Packages Projects Releases Wiki Activity
bd2ec03d53
text-generation-inference/backends/vllm
History
Morgan Funtowicz bd2ec03d53 backend(vllm): statically allocate LLMEngine
2025-01-22 22:15:33 +01:00
..
src backend(vllm): statically allocate LLMEngine 2025-01-22 22:15:33 +01:00
Cargo.toml backend(vllm): statically allocate LLMEngine 2025-01-22 22:15:33 +01:00