mirror of
https://github.com/huggingface/text-generation-inference.git
synced 2025-05-09 11:22:09 +00:00
5489406c4a
* add OpenAI like tool_choice for named choice * add tests * fix: run linter and bump api docs * fix: consolidate changes and remove old tool type * feat: improve, simplify and rename tool choice struct add required support and refactor * fix: simplify tool choice logic, improve tests, openapi and rust docs * fix: refactor away prepare_chat_input and improve tool grammar apply control flow * feat: update docs and add tool choice configuration section * fix: simplify naming, tool choice default and improve test * fix: adjust tool choice none logic, add test and small refactors * fix: add missing snapshot file * fix: adjust tool choice type in test * fix: adjust default when json tool choice is * fix: remove trailing space lint after rebase * fix: remove mostly mocked unit test --------- Co-authored-by: Linus Bierhoff <linus.bierhoff@icloud.com> |
||
|---|---|---|
| .. | ||
| test_flash_llama_grammar_tools_auto.json | ||
| test_flash_llama_grammar_tools_choice.json | ||
| test_flash_llama_grammar_tools_insufficient_information_stream.json | ||
| test_flash_llama_grammar_tools_insufficient_information.json | ||
| test_flash_llama_grammar_tools_sea_creatures_stream_function_object.json | ||
| test_flash_llama_grammar_tools_sea_creatures_stream_none.json | ||
| test_flash_llama_grammar_tools_sea_creatures_stream_required.json | ||
| test_flash_llama_grammar_tools_sea_creatures_stream.json | ||
| test_flash_llama_grammar_tools_stream.json | ||
| test_flash_llama_grammar_tools.json | ||