huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-09-11 04:14:52 +00:00
Code Issues Packages Projects Releases Wiki Activity

Trying to put back the archlist (to fix the oom).

Browse Source
This commit is contained in:
Nicolas Patry 2025-01-24 00:46:47 +01:00
parent d937eb64da
commit 0dd8a96613
No known key found for this signature in database
GPG Key ID: D2920555C90F704C
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
server/Makefile-flashinfer
View File

@ -3,4 +3,4 @@ install-flashinfer:
# `pip install flashinfer` cannot resolve it.
pip install fsspec sympy==1.13.1 numpy
pip install -U setuptools
FLASHINFER_ENABLE_AOT=1 pip install git+https://github.com/flashinfer-ai/flashinfer.git@v0.2.0.post1#egg=flashinfer --no-build-isolation
TORCH_CUDA_ARCH_LIST="8.0;8.6;8.9;9.0+PTX" FLASHINFER_ENABLE_AOT=1 pip install git+https://github.com/flashinfer-ai/flashinfer.git@v0.2.0.post1#egg=flashinfer --no-build-isolation