mirror of
https://github.com/huggingface/text-generation-inference.git
synced 2025-11-18 23:15:59 +00:00
* Switch to punica-sgmv kernel from the Hub This also switches (temporarily) to the tgi-nix/kernel-builder merge branch, bumping up to CUDA 12.8 (same as non-Nix Torch). * nix: client depends on aiohttp This probably worked before the nixpkgs bump because a dependency propagated aiohttp. |
||
|---|---|---|
| .. | ||
| client.nix | ||
| crate-overrides.nix | ||
| docker.nix | ||
| impure-shell.nix | ||
| overlay.nix | ||
| server.nix | ||