text-generation-inference/nix
Daniël de Kok 622c9c367a nix: build Torch against MKL and various other improvements (#2469)
Updates tgi-nix input:

- Move Torch closer to upstream by building against MKL.
- Remove compute capability 8.7 from Torch (Jetson).
- Sync nixpkgs cumpute capabilities with Torch (avoids
  compiling too mana capabilities for MAGMA).
- Use nixpkgs configuration passed through by `tgi-nix`.
2024-09-25 06:11:21 +00:00
..
crate-overrides.nix nix: add text-generation-benchmark to pure devshell (#2431) 2024-09-25 06:10:59 +00:00
server.nix nix: build Torch against MKL and various other improvements (#2469) 2024-09-25 06:11:21 +00:00