huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-09-11 20:34:54 +00:00
Code Issues Packages Projects Releases Wiki Activity

remove docker entrypoint

Browse Source 
this entrypoint was meant to fix tgi on some cloud providers like gcp that do not ensure the ld cache is refreshed after adding some shared libraries in custom container hooks

this should not belong to tgi repo itself

Signed-off-by: Raphael Glon <oOraph@users.noreply.github.com>
This commit is contained in:
Raphael Glon 2024-10-14 15:52:09 +02:00
parent 3ea82d008c
commit 09d73e56ca
No known key found for this signature in database
GPG Key ID: 4D4CC6881E12A0C3
3 changed files with 2 additions and 13 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

5
Dockerfile
View File

@ -295,8 +295,5 @@ ENTRYPOINT ["./entrypoint.sh"]
# Final image
FROM base
COPY ./tgi-entrypoint.sh /tgi-entrypoint.sh
RUN chmod +x /tgi-entrypoint.sh
ENTRYPOINT ["/tgi-entrypoint.sh"]
ENTRYPOINT ["text-generation-launcher"]
# CMD ["--json-output"]

5
Dockerfile_amd
View File

@ -330,8 +330,5 @@ ENV ATTENTION=paged
ENV USE_PREFIX_CACHING=0
ENV ROCM_USE_SKINNY_GEMM=1
COPY ./tgi-entrypoint.sh /tgi-entrypoint.sh
RUN chmod +x /tgi-entrypoint.sh
ENTRYPOINT ["/tgi-entrypoint.sh"]
ENTRYPOINT ["text-generation-launcher"]
CMD ["--json-output"]

5
tgi-entrypoint.sh
View File

@ -1,5 +0,0 @@
#!/bin/bash
ldconfig 2>/dev/null || echo 'unable to refresh ld cache, not a big deal in most cases'
text-generation-launcher $@