huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-22 15:32:08 +00:00
Code Issues Packages Projects Releases Wiki Activity
666 Commits 228 Branches 59 Tags 47 MiB
d4aebbd10a
Commit Graph

2 Commits

Author SHA1 Message Date
drbh
d4aebbd10a fix: correctly index into mask when applying grammar (#1618) 
This PR fixes how the grammar mask is index when generating text and
adds a new test to ensure the grammars work with non flash models
 2024-04-25 10:16:16 +03:00
drbh
f215cc15ee Support tools (#1587) 
This work in progress PR begins to add support for tools. Tools relies
on grammar support and still has some unsolved challenges. Opening the
PR for visibility and feedback
 2024-04-25 09:14:53 +03:00