hf_text-generation-inference/nix
Daniël de Kok 4e821c003a
nix: build Torch against MKL and various other improvements (#2469)
Updates tgi-nix input:

- Move Torch closer to upstream by building against MKL.
- Remove compute capability 8.7 from Torch (Jetson).
- Sync nixpkgs cumpute capabilities with Torch (avoids
  compiling too mana capabilities for MAGMA).
- Use nixpkgs configuration passed through by `tgi-nix`.
2024-08-29 16:25:25 +02:00
..
crate-overrides.nix nix: add `text-generation-benchmark` to pure devshell (#2431) 2024-08-21 07:48:13 +02:00
server.nix nix: build Torch against MKL and various other improvements (#2469) 2024-08-29 16:25:25 +02:00