mirror of
https://github.com/huggingface/text-generation-inference.git
synced 2025-04-27 04:52:07 +00:00
3 lines
95 B
Plaintext
3 lines
95 B
Plaintext
install-flashinfer:
|
|
pip install flashinfer==0.1.5 -i https://flashinfer.ai/whl/cu124/torch2.4
|