huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-23 16:02:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,141 Commits 229 Branches 59 Tags 23 MiB
29a93b78ba
Commit Graph

6 Commits

Author SHA1 Message Date
drbh
73ebbd05f8 Pr 2451 ci branch (#2454) 
* fix[router]: Fix tools not passed in chat template

Signed-off-by: GitHub <noreply@github.com>

* feat: improve default tool serialization and lints

* feat: refactor tool logic to include notify_error in prompt and adjust typing

* fix: adjust non tool template apply

* fix: simplify tool grammar logic and improve schema

* feat: avoid skip tool test and avoid empty tool prompts

* fix: increase test client timeout for grammar compilation tests

---------

Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: Simone Rossi <simone.rossi.93@gmail.com>
 2024-09-25 06:10:59 +00:00
drbh
a87791d7c9 feat: add ruff and resolve issue (#2262) 
* feat: add ruff and resolve issue

* fix: update client exports and adjust after rebase

* fix: adjust syntax to avoid circular import

* fix: adjust client ruff settings

* fix: lint and refactor import check and avoid model enum as global names

* fix: improve fbgemm_gpu check and lints

* fix: update lints

* fix: prefer comparing model enum over str

* fix: adjust lints and ignore specific rules

* fix: avoid unneeded quantize check
 2024-09-25 05:46:24 +00:00
drbh
2aad5f89bb feat: improve tools to include name and add tests (#1693) 
This PR makes tool calling aware of the name of the function selected. 

Fixes:
https://github.com/huggingface/text-generation-inference/issues/1657

Thank you @puppetm4st3r for the helpful snippets, large parts of this PR
are simply refactors of the code shared 🙏

**opening draft PR because small tweaks are needed before merging
 2024-06-03 15:39:47 +03:00
drbh
ab074c81b7 fix: improve tool type, bump pydantic and outlines (#1650) 
This PR resolves a couple

- [X] adjusts the tool response to align with openai's tools response
type
- [X] bumps pydantic to `2.6.4` in all apps (resolves dependency issue
when running tests)
- [X] bump `outlines` version and fix import for new name
 2024-04-25 12:34:55 +03:00
drbh
d4aebbd10a fix: correctly index into mask when applying grammar (#1618) 
This PR fixes how the grammar mask is index when generating text and
adds a new test to ensure the grammars work with non flash models
 2024-04-25 10:16:16 +03:00
drbh
f215cc15ee Support tools (#1587) 
This work in progress PR begins to add support for tools. Tools relies
on grammar support and still has some unsolved challenges. Opening the
PR for visibility and feedback
 2024-04-25 09:14:53 +03:00