text-generation-inference/router/src/infer
drbh 1cae3197c4
Improve tool call message processing (#3036)
* make content field optional in chat request

* add tool_calls field to Message struct

* feat: add test and serialize tool messages

* fix: bump utopia, openapi doc version and improve test

* fix: rerun update docs

* fix: suppoer tool call id in template and remove unnecessary changes

* fix: ruff lint remove unused import

* fix: adjust message types in tests

---------

Co-authored-by: sailesh duddupudi <saileshradar@gmail.com>
2025-02-21 10:30:29 +01:00
..
chat_template.rs Improve tool call message processing (#3036) 2025-02-21 10:30:29 +01:00
mod.rs Add backend name to telemetry (#2962) 2025-01-28 16:53:16 +01:00
tool_grammar.rs PR 2634 CI - Fix the tool_choice format for named choice by adapting OpenAIs scheme (#2645) 2024-11-19 13:31:59 -05:00