text-generation-inference/tgi-entrypoint.sh

#!/bin/bash

ldconfig 2>/dev/null || echo 'unable to refresh ld cache, not a big deal in most cases'

source ./.venv/bin/activate
exec text-generation-launcher $@
Dev/mask ldconfig output v2 (#1716) wrap text-generation-launcher in docker image mask ldconfig failures to user (no need in most cases anyway) --------- Signed-off-by: Raphael Glon <oOraph@users.noreply.github.com> Co-authored-by: Raphael Glon <oOraph@users.noreply.github.com> 2024-04-11 17:31:48 +00:00			`#!/bin/bash`

			`ldconfig 2>/dev/null \|\| echo 'unable to refresh ld cache, not a big deal in most cases'`

Putting back the NCCL forced upgrade. (#2999) * Putting back the NCCL forced upgrade. * . * ... * Ignoring conda. * Dropping conda from the buidl system + torch 2.6 * Cache min. * Rolling back torch version. * Reverting the EETQ modification. * Fix flash attention ? * Actually stay on flash v1. * Patching flash v1. * Torch 2.6, fork of rotary, eetq updated. * Put back nccl latest (override torch). * Slightly more reproducible build and not as scary. 2025-02-14 10:31:59 +00:00			`source ./.venv/bin/activate`
fix tgi-entrypoint wrapper in docker file: exec instead of spawning a child process (#2663) tgi-entrypoint: exec instead of spawning a child process reason: otherwise parent will receive the signals when we'd like tgi to receive them keeping the parent/child is not necessary and would require the parent to handle signals to forward them properly to the child Signed-off-by: Raphael Glon <oOraph@users.noreply.github.com> Co-authored-by: Raphael Glon <oOraph@users.noreply.github.com> 2024-10-17 09:15:26 +00:00			`exec text-generation-launcher $@`