hf_text-generation-inference

mirror of https://github.com/huggingface/text-generation-inference.git

Author	SHA1	Message	Date
drbh	7dbaf9e901	fix: correctly index into mask when applying grammar (#1618 ) This PR fixes how the grammar mask is index when generating text and adds a new test to ensure the grammars work with non flash models	2024-03-01 18:22:01 +01:00