mirror of
https://github.com/huggingface/text-generation-inference.git
synced 2025-10-20 12:25:23 +00:00
This PR fixes how the grammar mask is index when generating text and adds a new test to ensure the grammars work with non flash models |
||
|---|---|---|
| .. | ||
| test_flash_llama_grammar_json.json | ||
| test_flash_llama_grammar_load.json | ||
| test_flash_llama_grammar_regex.json | ||
| test_flash_llama_grammar_single_load_instance.json | ||
| test_flash_llama_grammar.json | ||