text-generation-inference/launcher/src
OlivierDehaene a1b65e5919 fix: fix CohereForAI/c4ai-command-r-plus (#1707)
@Narsil @drbh this will update flash attention v2 and vllm.
You will need to re-install them.
2024-04-25 17:51:35 +03:00
..
env_runtime.rs chore(github): add templates (#264) 2023-05-02 15:43:19 +02:00
main.rs fix: fix CohereForAI/c4ai-command-r-plus (#1707) 2024-04-25 17:51:35 +03:00