huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-09-11 04:14:52 +00:00
Code Issues Packages Projects Releases Wiki Activity

Add HF transfer

Browse Source 
Signed-off-by: Adrien Gallouët <angt@huggingface.co>
This commit is contained in:
Adrien Gallouët 2025-02-07 14:45:53 +00:00
parent 508d47f80f
commit 1401418243
No known key found for this signature in database
2 changed files with 3 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
Dockerfile_llamacpp
View File

@ -71,4 +71,6 @@ COPY --from=builder /usr/lib/libllama.so /usr/lib/
COPY --from=builder /usr/lib/libggml*.so /usr/lib/ COPY --from=builder /usr/lib/libggml*.so /usr/lib/
COPY --from=builder /app/target/release-opt/text-generation-router-llamacpp /usr/bin/ COPY --from=builder /app/target/release-opt/text-generation-router-llamacpp /usr/bin/
ENV HF_HUB_ENABLE_HF_TRANSFER=1
ENTRYPOINT ["text-generation-router-llamacpp"] ENTRYPOINT ["text-generation-router-llamacpp"]

1
backends/llamacpp/requirements.txt
View File

@ -1,2 +1,3 @@
transformers==4.48.2 transformers==4.48.2
huggingface-hub==0.28.1 huggingface-hub==0.28.1
hf-transfer==0.1.9