mirror of
https://github.com/huggingface/text-generation-inference.git
synced 2025-05-03 07:52:06 +00:00
@Narsil @drbh this will update flash attention v2 and vllm. You will need to re-install them. |
||
---|---|---|
.. | ||
env_runtime.rs | ||
main.rs |