mirror of
https://github.com/huggingface/text-generation-inference.git
synced 2025-04-21 23:12:07 +00:00
@Narsil @drbh this will update flash attention v2 and vllm. You will need to re-install them. |
||
---|---|---|
.. | ||
config.rs | ||
health.rs | ||
infer.rs | ||
lib.rs | ||
main.rs | ||
queue.rs | ||
server.rs | ||
validation.rs |