06c3d4b1ec
This PR allows the `CompletionRequest.prompt` to be sent as a string or array of strings. When an array is sent the first value will be used if it's a string; otherwise the according error will be thrown Fixes: https://github.com/huggingface/text-generation-inference/issues/1690 Similar to: https://github.com/vllm-project/vllm/pull/323/files |
||
|---|---|---|
| .. | ||
| consuming_tgi.md | ||
| gated_model_access.md | ||
| launcher.md | ||
| non_core_models.md | ||
| preparing_model.md | ||
| safety.md | ||
| using_cli.md | ||