text-generation-inference/backends/v3
Mohit Sharma 02715dc53f
Add option to configure prometheus port (#3187)
* add prometheus port

* fix doc

* add port for trtllm and llamacpp

* Fixing format after rebase.

---------

Co-authored-by: Nicolas Patry <patry.nicolas@protonmail.com>
2025-04-23 20:43:25 +05:30
..
benches Keeping the benchmark somewhere (#2401) 2024-08-12 15:22:02 +02:00
src Add option to configure prometheus port (#3187) 2025-04-23 20:43:25 +05:30
build.rs Rebase TRT-llm (#2331) 2024-07-31 10:33:10 +02:00
Cargo.toml Add property-based testing for RadixAllocator (#3068) 2025-03-04 15:09:46 +01:00