4 Commits

Author	SHA1	Message	Date
drbh	2aad5f89bb	feat: improve tools to include name and add tests (#1693) ... This PR makes tool calling aware of the name of the function selected. Fixes: https://github.com/huggingface/text-generation-inference/issues/1657 Thank you @puppetm4st3r for the helpful snippets, large parts of this PR are simply refactors of the code shared 🙏 **opening draft PR because small tweaks are needed before merging	2024-06-03 15:39:47 +03:00
drbh	ab074c81b7	fix: improve tool type, bump pydantic and outlines (#1650) ... This PR resolves a couple - [X] adjusts the tool response to align with openai's tools response type - [X] bumps pydantic to `2.6.4` in all apps (resolves dependency issue when running tests) - [X] bump `outlines` version and fix import for new name	2024-04-25 12:34:55 +03:00
drbh	d4aebbd10a	fix: correctly index into mask when applying grammar (#1618) ... This PR fixes how the grammar mask is index when generating text and adds a new test to ensure the grammars work with non flash models	2024-04-25 10:16:16 +03:00
drbh	f215cc15ee	Support tools (#1587) ... This work in progress PR begins to add support for tools. Tools relies on grammar support and still has some unsolved challenges. Opening the PR for visibility and feedback	2024-04-25 09:14:53 +03:00