text-generation-inference/nix
Daniël de Kok e32528792c
Switch to punica-sgmv kernel from the Hub (#3236)
* Switch to punica-sgmv kernel from the Hub

This also switches (temporarily) to the tgi-nix/kernel-builder merge
branch, bumping up to CUDA 12.8 (same as non-Nix Torch).

* nix: client depends on aiohttp

This probably worked before the nixpkgs bump because a dependency
propagated aiohttp.
2025-05-21 15:44:15 +02:00
..
client.nix Switch to punica-sgmv kernel from the Hub (#3236) 2025-05-21 15:44:15 +02:00
crate-overrides.nix nix: support Python tokenizer conversion in the router (#2515) 2024-09-12 10:44:01 +02:00
docker.nix Publish nix docker image. (#3122) 2025-03-18 12:58:21 +01:00
impure-shell.nix Nix: add openai to impure shell for integration tests (#3081) 2025-03-07 13:04:21 +01:00
overlay.nix Update transformers to 4.51 (#3148) 2025-04-07 12:55:43 +02:00
server.nix Switch to punica-sgmv kernel from the Hub (#3236) 2025-05-21 15:44:15 +02:00