hf_text-generation-inference/integration-tests/models/__snapshots__/test_idefics
Daniël de Kok e903770897
Support different image sizes in prefill in VLMs (#2065)
When a batch contained images if different sizes during prefill, the
server would fail (see e.g. #2056). Images were processed separately and
then concatenated. However, this can fail for images with different sizes.

Fix this by preprocessing all images in the batch together, so that the
image processor can ensure that all image tensors have compatible sizes.
2024-06-17 10:49:41 +02:00
..
test_idefics.json
test_idefics_load.json
test_idefics_two_images.json Support different image sizes in prefill in VLMs (#2065) 2024-06-17 10:49:41 +02:00