huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-28 21:42:06 +00:00
Code Issues Packages Projects Releases Wiki Activity
46994b34fb
text-generation-inference/launcher/src
History
lazariv 83624a07be
Add possible variants for A100 and H100 GPUs for auto-detecting flops (#2837) 
* Update main.rs with A100 and H100 variants

* Add another variant "nvidia-h100-nvl"

* Update main.rs

Add nvidia-a100-sxm4-40gb
2025-01-10 16:12:02 +01:00
..
env_runtime.rs add intel xpu support for TGI (#1475) 2024-04-26 15:48:58 +02:00
gpu.rs Remove compute capability lazy cell (#2580) 2024-09-30 08:48:47 +02:00
main.rs Add possible variants for A100 and H100 GPUs for auto-detecting flops (#2837) 2025-01-10 16:12:02 +01:00