Mohit Sharma
02715dc53f
Add option to configure prometheus port ( #3187 )
...
* add prometheus port
* fix doc
* add port for trtllm and llamacpp
* Fixing format after rebase.
---------
Co-authored-by: Nicolas Patry <patry.nicolas@protonmail.com>
2025-04-23 20:43:25 +05:30
OlivierDehaene
ab7ccf5bc3
feat: add payload limit ( #2726 )
...
* feat: add payload limit
* update launcher
2024-11-21 18:20:15 +00:00
Nicolas Patry
ed87b464b4
Fixing "deadlock" when python prompts for trust_remote_code by always ( #2664 )
...
specifiying a value.
2024-10-25 06:39:21 +02:00
OlivierDehaene
41c2623735
feat: allow any supported payload on /invocations ( #2683 )
...
* feat: allow any supported payload on /invocations
* update openAPI
* update doc
2024-10-23 11:26:01 +00:00
OlivierDehaene
10e6f29295
chore: Add old V2 backend ( #2551 )
...
* wip
* added v2
2024-09-24 08:38:17 +02:00
