huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-23 16:02:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
003163a2b9
text-generation-inference/backends/vllm
History
Morgan Funtowicz 003163a2b9 backend(vllm): map ResultOutput to InferStreamResponse to stream back to the client
2025-01-30 16:12:52 +01:00
..
src backend(vllm): map ResultOutput to InferStreamResponse to stream back to the client 2025-01-30 16:12:52 +01:00
Cargo.toml backend(vllm): expose FFI for CompletionOutput and RequestOutput on Rust side 2025-01-30 13:35:21 +01:00