hf_text-generation-inference

Commit Graph

Author	SHA1	Message	Date
Daniël de Kok	fc9c3153e5	Add pytest release marker (#2114 ) * Add pytest release marker Annotate a test with `@pytest.mark.release` and it only gets run with `pytest integration-tests --release`. * Mark many models as `release` to speed up CI	2024-06-25 16:53:20 +02:00
drbh	06c3d4b1ec	feat: accept list as prompt and use first string (#1702 ) This PR allows the `CompletionRequest.prompt` to be sent as a string or array of strings. When an array is sent the first value will be used if it's a string; otherwise the according error will be thrown Fixes: https://github.com/huggingface/text-generation-inference/issues/1690 Similar to: https://github.com/vllm-project/vllm/pull/323/files	2024-04-17 10:41:12 +02:00

Author

SHA1

Message

Date

Daniël de Kok

fc9c3153e5

Add pytest release marker (#2114 )

* Add pytest release marker

Annotate a test with `@pytest.mark.release` and it only gets run
with `pytest integration-tests --release`.

* Mark many models as `release` to speed up CI

2024-06-25 16:53:20 +02:00

drbh

06c3d4b1ec

feat: accept list as prompt and use first string (#1702 )

This PR allows the `CompletionRequest.prompt` to be sent as a string or
array of strings. When an array is sent the first value will be used if
it's a string; otherwise the according error will be thrown

Fixes:
https://github.com/huggingface/text-generation-inference/issues/1690
Similar to: https://github.com/vllm-project/vllm/pull/323/files

2024-04-17 10:41:12 +02:00

2 Commits