text-generation-inference/Dockerfile.nix

# Build the image and get out the docker file:
#
# docker build -t tgi-nix-builder -f Dockerfile.nix
# docker run --log-driver=none tgi-nix-builder | docker load

FROM nixos/nix:2.18.8
RUN echo "experimental-features = nix-command flakes" >> /etc/nix/nix.conf
RUN nix profile install nixpkgs#cachix
RUN cachix use text-generation-inference
WORKDIR /root
ADD . .
RUN nix build .#dockerImageStreamed
ENTRYPOINT ./result
Example of building the Docker image using Nix inside Docker 2024-09-28 19:10:33 +00:00			`# Build the image and get out the docker file:`
			`#`
Stream to make the builder image smaller This avoids storing a Docker image tarball in the image. Instead, stream the layers while doing `docker run`. 2024-09-29 10:35:56 +00:00			`# docker build -t tgi-nix-builder -f Dockerfile.nix`
Don't spam journalctl on Linux 2024-09-29 10:43:55 +00:00			`# docker run --log-driver=none tgi-nix-builder \| docker load`
Example of building the Docker image using Nix inside Docker 2024-09-28 19:10:33 +00:00
			`FROM nixos/nix:2.18.8`
			`RUN echo "experimental-features = nix-command flakes" >> /etc/nix/nix.conf`
			`RUN nix profile install nixpkgs#cachix`
			`RUN cachix use text-generation-inference`
			`WORKDIR /root`
			`ADD . .`
Stream to make the builder image smaller This avoids storing a Docker image tarball in the image. Instead, stream the layers while doing `docker run`. 2024-09-29 10:35:56 +00:00			`RUN nix build .#dockerImageStreamed`
			`ENTRYPOINT ./result`