3 Commits

Author	SHA1	Message	Date
drbh	de6cb15fa5	fix: improve tool type, bump pydantic and outlines (#1650) ... This PR resolves a couple - [X] adjusts the tool response to align with openai's tools response type - [X] bumps pydantic to `2.6.4` in all apps (resolves dependency issue when running tests) - [X] bump `outlines` version and fix import for new name	2024-03-21 12:45:56 -04:00
drbh	7dbaf9e901	fix: correctly index into mask when applying grammar (#1618) ... This PR fixes how the grammar mask is index when generating text and adds a new test to ensure the grammars work with non flash models	2024-03-01 18:22:01 +01:00
drbh	9b6db5f793	Support tools (#1587) ... This work in progress PR begins to add support for tools. Tools relies on grammar support and still has some unsolved challenges. Opening the PR for visibility and feedback	2024-02-28 11:10:27 +01:00