huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-05-01 15:02:09 +00:00
Code Issues Packages Projects Releases Wiki Activity
375802948d
text-generation-inference/backends/trtllm/src
History
Mohit Sharma 02715dc53f
Add option to configure prometheus port (#3187) 
* add prometheus port

* fix doc

* add port for trtllm and llamacpp

* Fixing format after rebase.

---------

Co-authored-by: Nicolas Patry <patry.nicolas@protonmail.com>
2025-04-23 20:43:25 +05:30
..
errors.rs [TENSORRT-LLM] - Implement new looper thread based backend (#2357) 2024-10-25 07:17:14 +02:00
lib.rs Give TensorRT-LLMa proper CI/CD 😍 (#2886) 2025-01-21 10:19:16 +01:00
looper.rs Add backend name to telemetry (#2962) 2025-01-28 16:53:16 +01:00
main.rs Add option to configure prometheus port (#3187) 2025-04-23 20:43:25 +05:30
utils.rs [TENSORRT-LLM] - Implement new looper thread based backend (#2357) 2024-10-25 07:17:14 +02:00