text-generation-inference

huggingface/text-generation-inference

Fork 0

mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-22 07:22:07 +00:00

Commit Graph

Author	SHA1	Message	Date
Daniël de Kok	93663b4567	server: use chunked inputs The router will now send the input as chunks besides as a single string. This change modifies the server to process chunked input rather than strings. This also allows us to remove the image extraction code from the server.	2024-09-24 03:42:29 +00:00

Author

SHA1

Message

Date

Daniël de Kok

93663b4567

server: use chunked inputs

The router will now send the input as chunks besides as a single
string. This change modifies the server to process chunked input
rather than strings. This also allows us to remove the image
extraction code from the server.

2024-09-24 03:42:29 +00:00

1 Commits