mirror of
https://github.com/huggingface/text-generation-inference.git
synced 2025-05-24 04:22:10 +00:00
* Switch to punica-sgmv kernel from the Hub This also switches (temporarily) to the tgi-nix/kernel-builder merge branch, bumping up to CUDA 12.8 (same as non-Nix Torch). * nix: client depends on aiohttp This probably worked before the nixpkgs bump because a dependency propagated aiohttp. |
||
---|---|---|
.. | ||
client.nix | ||
crate-overrides.nix | ||
docker.nix | ||
impure-shell.nix | ||
overlay.nix | ||
server.nix |