3 Commits

Author	SHA1	Message	Date
Daniël de Kok	e32528792c	Switch to punica-sgmv kernel from the Hub (#3236) ... * Switch to punica-sgmv kernel from the Hub This also switches (temporarily) to the tgi-nix/kernel-builder merge branch, bumping up to CUDA 12.8 (same as non-Nix Torch). * nix: client depends on aiohttp This probably worked before the nixpkgs bump because a dependency propagated aiohttp.	2025-05-21 15:44:15 +02:00
Daniël de Kok	7e531f413d	Update to Torch 2.7.0 (#3221) ... * Update to Torch 2.7.0 * Try to fix typer/click issue * Pin click to fix incompatibility with typer * Fix some test outputs with slight deviations * Attempt again to sync with CI * Mamba too * Fixup mllama Also switch to `unsloth/Llama-3.2-11B-Vision-Instruct` for testing from the EU :).	2025-05-15 11:48:33 +02:00
Daniël de Kok	c73ae0bd88	Update to kernels 0.2.1 (#3084) ... * Update to `kernels` 0.2.1 The package was renamed from `hf-kernels` to `kernels`. The new version also updates the lockfile format. * Download kernels in `install-cuda` target	2025-03-13 10:36:29 +01:00