mirror of
https://github.com/huggingface/text-generation-inference.git
synced 2025-05-24 20:42:07 +00:00
* Switch to punica-sgmv kernel from the Hub This also switches (temporarily) to the tgi-nix/kernel-builder merge branch, bumping up to CUDA 12.8 (same as non-Nix Torch). * nix: client depends on aiohttp This probably worked before the nixpkgs bump because a dependency propagated aiohttp. |
||
---|---|---|
.. | ||
__init__.py | ||
config.py | ||
lora.py | ||
weights.py |