4 Commits

Author	SHA1	Message	Date
drbh	7276d43495	feat: improve tools to include name and add tests (#1693) ... This PR makes tool calling aware of the name of the function selected. Fixes: https://github.com/huggingface/text-generation-inference/issues/1657 Thank you @puppetm4st3r for the helpful snippets, large parts of this PR are simply refactors of the code shared 🙏 **opening draft PR because small tweaks are needed before merging	2024-04-16 09:02:46 -04:00
drbh	de6cb15fa5	fix: improve tool type, bump pydantic and outlines (#1650) ... This PR resolves a couple - [X] adjusts the tool response to align with openai's tools response type - [X] bumps pydantic to `2.6.4` in all apps (resolves dependency issue when running tests) - [X] bump `outlines` version and fix import for new name	2024-03-21 12:45:56 -04:00
drbh	7dbaf9e901	fix: correctly index into mask when applying grammar (#1618) ... This PR fixes how the grammar mask is index when generating text and adds a new test to ensure the grammars work with non flash models	2024-03-01 18:22:01 +01:00
drbh	9b6db5f793	Support tools (#1587) ... This work in progress PR begins to add support for tools. Tools relies on grammar support and still has some unsolved challenges. Opening the PR for visibility and feedback	2024-02-28 11:10:27 +01:00