huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-11-18 23:15:59 +00:00
Code Issues Packages Projects Releases Wiki Activity
56b16614de
text-generation-inference/server/tests
History
Daniël de Kok bf3c813782 server: use chunked inputs 
The router will now send the input as chunks besides as a single
string. This change modifies the server to process chunked input
rather than strings. This also allows us to remove the image
extraction code from the server.
2024-06-07 08:09:04 +02:00
..
models server: use chunked inputs 2024-06-07 08:09:04 +02:00
utils Refactor layers. (#1866) 2024-05-13 12:44:30 +02:00
conftest.py feat: support typical sampling (#114) 2023-03-09 11:33:57 +01:00