mirror of
https://github.com/huggingface/text-generation-inference.git
synced 2025-04-30 14:32:08 +00:00
3 lines
95 B
Plaintext
3 lines
95 B
Plaintext
install-flashinfer:
|
|
pip install flashinfer==0.1.6 -i https://flashinfer.ai/whl/cu124/torch2.4
|