text-generation-inference/backends
regisss f13e28c98d
[gaudi] Refine logging for Gaudi warmup ()
* Refine logging for Gaudi warmup

* Make style

* Make style 2

* Flash causal LM case

* Add log_master & VLM cases

* Black
2025-06-18 12:34:00 +02:00
..
client Revert "feat: improve qwen2-vl startup " () 2025-01-17 12:09:05 -05:00
gaudi [gaudi] Refine logging for Gaudi warmup () 2025-06-18 12:34:00 +02:00
grpc-metadata Upgrading our rustc version. () 2025-01-15 17:04:03 +01:00
llamacpp Add option to configure prometheus port () 2025-04-23 20:43:25 +05:30
neuron Bump neuron SDK version () 2025-06-10 17:56:25 +02:00
trtllm Add option to configure prometheus port () 2025-04-23 20:43:25 +05:30
v2 Add option to configure prometheus port () 2025-04-23 20:43:25 +05:30
v3 fp8 compressed tensors w8a8 support for Gaudi backend () 2025-05-28 14:54:20 +02:00