huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-21 23:12:07 +00:00
Code Issues Packages Projects Releases Wiki Activity

Trying to put back the archlist (to fix the oom). (#2947)

Browse Source
This commit is contained in:
Nicolas Patry 2025-01-24 09:32:17 +01:00 committed by GitHub
parent d937eb64da
commit d9dda11726
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
server/Makefile-flashinfer
View File

@ -3,4 +3,4 @@ install-flashinfer:
# `pip install flashinfer` cannot resolve it.
pip install fsspec sympy==1.13.1 numpy
pip install -U setuptools
FLASHINFER_ENABLE_AOT=1 pip install git+https://github.com/flashinfer-ai/flashinfer.git@v0.2.0.post1#egg=flashinfer --no-build-isolation
TORCH_CUDA_ARCH_LIST="8.0;8.6;8.9;9.0+PTX" FLASHINFER_ENABLE_AOT=1 pip install git+https://github.com/flashinfer-ai/flashinfer.git@v0.2.0.post1#egg=flashinfer --no-build-isolation