text-generation-inference/docs/source
drbh 918916939f feat: accept list as prompt and use first string (#1702)
This PR allows the `CompletionRequest.prompt` to be sent as a string or
array of strings. When an array is sent the first value will be used if
it's a string; otherwise the according error will be thrown

Fixes:
https://github.com/huggingface/text-generation-inference/issues/1690
Similar to: https://github.com/vllm-project/vllm/pull/323/files
2024-06-03 15:39:47 +03:00
..
basic_tutorials feat: accept list as prompt and use first string (#1702) 2024-06-03 15:39:47 +03:00
conceptual Fix typo in guidance.md (#1735) 2024-04-26 07:42:46 +00:00
_toctree.yml Pickle conversion now requires --trust-remote-code. (#1704) 2024-04-25 15:09:00 +03:00
index.md Remove some content from the README in favour of the documentation (#958) 2023-10-09 11:59:06 +02:00
installation.md chore: add pre-commit (#1569) 2024-04-24 15:32:02 +03:00
messages_api.md chore: add pre-commit (#1569) 2024-04-24 15:32:02 +03:00
quicktour.md Use a better model for the quick tour (#1639) 2024-04-25 10:19:19 +03:00
supported_models.md Adding Llava-Next (Llava 1.6) with full support. (#1709) 2024-04-25 14:30:55 +00:00