huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-27 13:02:12 +00:00
Code Issues Packages Projects Releases Wiki Activity
prefix_default
text-generation-inference/server/Makefile-flashinfer

3 lines
95 B
Plaintext
Raw Permalink Normal View History

Using prebuilt.
2024-08-16 22:42:51 +00:00
install-flashinfer:
pip install flashinfer==0.1.5 -i https://flashinfer.ai/whl/cu124/torch2.4
Reference in New Issue Copy Permalink