mirror of
https://github.com/huggingface/text-generation-inference.git
synced 2025-04-24 00:12:08 +00:00
This PR fixes how the grammar mask is index when generating text and adds a new test to ensure the grammars work with non flash models |
||
---|---|---|
.. | ||
test_flash_llama_grammar_json.json | ||
test_flash_llama_grammar_load.json | ||
test_flash_llama_grammar_regex.json | ||
test_flash_llama_grammar_single_load_instance.json | ||
test_flash_llama_grammar.json |