text-generation-inference/router/src
Nicolas Patry 8e92942a18
Making tool_calls a vector. (#3075)
* Making `tool_calls` a vector.

* Update doc.

* Fixing the nix overlay with updated version.

* Add openai dependency.

* Updating the old tests.

* Trying to reduce the logs in the case of errors.

* Less spammy logs too.
2025-03-05 22:32:31 +01:00
..
infer Improve tool call message processing (#3036) 2025-02-21 10:30:29 +01:00
config.rs feat: add initial qwen2.5-vl model and test (#2971) 2025-02-19 12:38:20 +01:00
kserve.rs fix: include add_special_tokens in kserve request (#2859) 2024-12-19 16:55:17 -05:00
lib.rs Making tool_calls a vector. (#3075) 2025-03-05 22:32:31 +01:00
logging.rs Rebase TRT-llm (#2331) 2024-07-31 10:33:10 +02:00
sagemaker.rs feat: allow any supported payload on /invocations (#2683) 2024-10-23 11:26:01 +00:00
server.rs Only add token when it is defined. (#3073) 2025-03-05 11:59:52 +01:00
usage_stats.rs feat: Add the parsing of HF_HUB_USER_AGENT_ORIGIN environment variable for telemetry (#3027) 2025-02-19 21:09:12 +01:00
validation.rs feat: add initial qwen2.5-vl model and test (#2971) 2025-02-19 12:38:20 +01:00
vertex.rs Improve tool call message processing (#3036) 2025-02-21 10:30:29 +01:00