Daniël de Kok fa964f82d3 nix: experimental support for building a Docker container (#2470) ... * nix: experimental support for building a Docker image Run using something like: ``` docker run \ --device nvidia.com/gpu=all \ -it --rm -p 8080:80 \ -v $PWD/data:/data \ -v $PWD/tmp:/tmp \ tgi-docker:latest \ --model-id <model_id> ``` * Example of building the Docker image using Nix inside Docker * Stream to make the builder image smaller This avoids storing a Docker image tarball in the image. Instead, stream the layers while doing `docker run`. * Don't spam journalctl on Linux * Other dockerfile. --------- Co-authored-by: Nicolas Patry <patry.nicolas@protonmail.com>		2024-10-25 09:12:03 +00:00
..
client.nix	Preparing for release. (#2540)	2024-09-25 06:20:50 +00:00
crate-overrides.nix	nix: support Python tokenizer conversion in the router (#2515)	2024-09-25 06:15:35 +00:00
docker.nix	nix: experimental support for building a Docker container (#2470)	2024-10-25 09:12:03 +00:00
impure-shell.nix	Improve support for GPUs with capability < 8 (#2575)	2024-10-25 09:01:04 +00:00
server.nix	Improve support for GPUs with capability < 8 (#2575)	2024-10-25 09:01:04 +00:00