text-generation-inference/nix
Daniël de Kok 9c9ef37c56
Add impureWithCuda dev shell (#2677)
* Add `impureWithCuda` dev shell

This shell is handy when developing some kernels jointly with TGI - it
adds nvcc and a bunch of commonly-used CUDA libraries to the environment.

We don't add this to the normal impure shell to keep the development
environment as clean as possible (avoid accidental dependencies, etc.).

* Add cuDNN
2024-10-22 11:02:55 +02:00
..
client.nix Stream options. (#2533) 2024-09-19 20:50:37 +02:00
crate-overrides.nix nix: support Python tokenizer conversion in the router (#2515) 2024-09-12 10:44:01 +02:00
docker.nix nix: experimental support for building a Docker container (#2470) 2024-10-01 18:02:06 +02:00
impure-shell.nix Add impureWithCuda dev shell (#2677) 2024-10-22 11:02:55 +02:00
overlay.nix nix: example of local package overrides during development (#2607) 2024-10-04 16:52:42 +02:00
server.nix Improve support for GPUs with capability < 8 (#2575) 2024-09-27 16:19:42 +02:00