06c3d4b1ec
This PR allows the `CompletionRequest.prompt` to be sent as a string or array of strings. When an array is sent the first value will be used if it's a string; otherwise the according error will be thrown Fixes: https://github.com/huggingface/text-generation-inference/issues/1690 Similar to: https://github.com/vllm-project/vllm/pull/323/files |
||
|---|---|---|
| .. | ||
| basic_tutorials | ||
| conceptual | ||
| _toctree.yml | ||
| index.md | ||
| installation.md | ||
| messages_api.md | ||
| quicktour.md | ||
| supported_models.md | ||