diff --git a/README.md b/README.md index e4c4486f9..b344892ef 100644 --- a/README.md +++ b/README.md @@ -263,7 +263,8 @@ locally, which can take hours. After that you can run TGI with `nix run`: ```shell -nix run . -- --model-id meta-llama/Llama-3.1-8B-Instruct +cd text-generation-inference +nix run --extra-experimental-features nix-command --extra-experimental-features flakes . -- --model-idmeta-llama/Llama-3.1-8B-Instruct ``` **Note:** when you are using Nix on a non-NixOS system, you have to [make some symlinks](https://danieldk.eu/Nix-CUDA-on-non-NixOS-systems#make-runopengl-driverlib-and-symlink-the-driver-library)