text-generation-inference/launcher
lazariv 83624a07be
Add possible variants for A100 and H100 GPUs for auto-detecting flops (#2837)
* Update main.rs with A100 and H100 variants

* Add another variant "nvidia-h100-nvl"

* Update main.rs

Add nvidia-a100-sxm4-40gb
2025-01-10 16:12:02 +01:00
..
src Add possible variants for A100 and H100 GPUs for auto-detecting flops (#2837) 2025-01-10 16:12:02 +01:00
build.rs chore(github): add templates (#264) 2023-05-02 15:43:19 +02:00
Cargo.toml CI (2592): Allow LoRA adapter revision in server launcher (#2602) 2024-10-02 10:51:04 -04:00