2 Commits

Author	SHA1	Message	Date
Daniël de Kok	fc9c3153e5	Add pytest release marker (#2114) ... * Add pytest release marker Annotate a test with `@pytest.mark.release` and it only gets run with `pytest integration-tests --release`. * Mark many models as `release` to speed up CI	2024-06-25 16:53:20 +02:00
Nicolas Patry	1da07e85aa	feat(server): Add Non flash MPT. (#514) ... # What does this PR do? This adds a non flash version of MPT. Flash is harder because we need to create a bias ready cuda kernel of flash attention. Fixes https://github.com/huggingface/text-generation-inference/issues/361 Fixes https://github.com/huggingface/text-generation-inference/issues/491 Fixes https://github.com/huggingface/text-generation-inference/issues/290	2023-07-03 13:01:46 +02:00