huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-21 23:12:07 +00:00
Code Issues Packages Projects Releases Wiki Activity
feat/add-load-test
text-generation-inference/integration-tests/models/__snapshots__/test_grammar_llama
History
drbh 7dbaf9e901
fix: correctly index into mask when applying grammar (#1618) 
This PR fixes how the grammar mask is index when generating text and
adds a new test to ensure the grammars work with non flash models
2024-03-01 18:22:01 +01:00
..
test_non_flash_llama_grammar_json.json fix: correctly index into mask when applying grammar (#1618) 2024-03-01 18:22:01 +01:00