text-generation-inference/router/src
drbh 1cae3197c4
Improve tool call message processing (#3036)
* make content field optional in chat request

* add tool_calls field to Message struct

* feat: add test and serialize tool messages

* fix: bump utopia, openapi doc version and improve test

* fix: rerun update docs

* fix: suppoer tool call id in template and remove unnecessary changes

* fix: ruff lint remove unused import

* fix: adjust message types in tests

---------

Co-authored-by: sailesh duddupudi <saileshradar@gmail.com>
2025-02-21 10:30:29 +01:00
..
infer Improve tool call message processing (#3036) 2025-02-21 10:30:29 +01:00
config.rs feat: add initial qwen2.5-vl model and test (#2971) 2025-02-19 12:38:20 +01:00
kserve.rs fix: include add_special_tokens in kserve request (#2859) 2024-12-19 16:55:17 -05:00
lib.rs Improve tool call message processing (#3036) 2025-02-21 10:30:29 +01:00
logging.rs Rebase TRT-llm (#2331) 2024-07-31 10:33:10 +02:00
sagemaker.rs feat: allow any supported payload on /invocations (#2683) 2024-10-23 11:26:01 +00:00
server.rs Improve tool call message processing (#3036) 2025-02-21 10:30:29 +01:00
usage_stats.rs feat: Add the parsing of HF_HUB_USER_AGENT_ORIGIN environment variable for telemetry (#3027) 2025-02-19 21:09:12 +01:00
validation.rs feat: add initial qwen2.5-vl model and test (#2971) 2025-02-19 12:38:20 +01:00
vertex.rs Improve tool call message processing (#3036) 2025-02-21 10:30:29 +01:00