huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-10-12 00:15:24 +00:00
Code Issues Packages Projects Releases Wiki Activity
7c475b6226
text-generation-inference/router/client/src
History
Karol Damaszke 535a35db17
Set unique request id during warmup (#170)
2024-07-03 10:58:20 +02:00
..
pb chore: add pre-commit (#1569) 2024-04-24 15:32:02 +03:00
client.rs Set unique request id during warmup (#170) 2024-07-03 10:58:20 +02:00
lib.rs Outlines guided generation (#1539) 2024-04-24 14:57:37 +03:00
sharded_client.rs feat(router): add max_batch_size (#1542) 2024-04-24 09:21:57 +00:00