Nicolas Patry
|
ba1ce20ce8
|
Updating integration tests with new values with FI/FD.
Remove paged as a default too, and using FD everywhere.
|
2024-08-27 20:05:29 +02:00 |
|
drbh
|
0b95693fb8
|
fix: adjust test snapshots and small refactors (#2323)
* fix: adjust test snapshots and small refactors
* fix: revert non snapshot changes
|
2024-07-29 11:38:38 -04:00 |
|
OlivierDehaene
|
2d0a7173d4
|
v2.0.1
|
2024-04-18 17:20:36 +02:00 |
|
drbh
|
06c3d4b1ec
|
feat: accept list as prompt and use first string (#1702)
This PR allows the `CompletionRequest.prompt` to be sent as a string or
array of strings. When an array is sent the first value will be used if
it's a string; otherwise the according error will be thrown
Fixes:
https://github.com/huggingface/text-generation-inference/issues/1690
Similar to: https://github.com/vllm-project/vllm/pull/323/files
|
2024-04-17 10:41:12 +02:00 |
|