hf_text-generation-inference/integration-tests
Daniël de Kok e903770897
Support different image sizes in prefill in VLMs (#2065)
When a batch contained images if different sizes during prefill, the
server would fail (see e.g. #2056). Images were processed separately and
then concatenated. However, this can fail for images with different sizes.

Fix this by preprocessing all images in the batch together, so that the
image processor can ensure that all image tensors have compatible sizes.
2024-06-17 10:49:41 +02:00
..
images Pali gemma modeling (#1895) 2024-05-16 06:58:47 +02:00
models Support different image sizes in prefill in VLMs (#2065) 2024-06-17 10:49:41 +02:00
conftest.py Add support for exl2 quantization 2024-05-30 11:28:05 +02:00
poetry.lock fix: improve tool type, bump pydantic and outlines (#1650) 2024-03-21 12:45:56 -04:00
pyproject.toml v2.0.1 2024-04-18 17:20:36 +02:00
pytest.ini chore: add pre-commit (#1569) 2024-02-16 11:58:58 +01:00
requirements.txt fix: improve tool type, bump pydantic and outlines (#1650) 2024-03-21 12:45:56 -04:00