huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-06-09 19:02:09 +00:00
Code Issues Packages Projects Releases Wiki Activity

Update Dockerfile.llamacpp as per review

Browse Source 
Co-authored-by: Hugo Larcher <hugo.larcher@huggingface.co>
This commit is contained in:
Funtowicz Morgan 2024-11-28 09:53:15 +01:00 committed by GitHub
parent 9025a26cea
commit bbe95ca9e9
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 3 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
Dockerfile.llamacpp
View File

@ -64,7 +64,9 @@ RUN --mount=type=cache,target=/var/cache/apt,sharing=locked \
apt install -y \ apt install -y \
numactl \ numactl \
openssl \ openssl \
python3.11-dev python3.11-dev \
python3.11-venv \
ibgomp1
COPY --from=builder /usr/src/text-generation-inference/target/release-opt/text-generation-backend-llamacpp /usr/src/text-generation-inference/text-generation-launcher COPY --from=builder /usr/src/text-generation-inference/target/release-opt/text-generation-backend-llamacpp /usr/src/text-generation-inference/text-generation-launcher
COPY --from=builder /usr/src/text-generation-inference/dist /usr/ COPY --from=builder /usr/src/text-generation-inference/dist /usr/