mirror of
https://github.com/huggingface/text-generation-inference.git
synced 2025-10-10 15:35:24 +00:00
df71aafdcc
Before this change, the generation input was sent to the backend as a single string, encoding images as Base64 and packing them in Markdown-style links. This change adds a new chunked input representation that separates text chunks from images chunks. Image chunks contain binary data (for smaller message sizes) and the image's MIME type. The stringly-typed inputs are still sent to support backends that do not support chunked inputs yet. |
||
|---|---|---|
| .. | ||
| config.rs | ||
| health.rs | ||
| infer.rs | ||
| lib.rs | ||
| main.rs | ||
| queue.rs | ||
| server.rs | ||
| validation.rs | ||