text-generation-inference/backends
Adrien Gallouët e7facf692f
Handle max_batch_size
Signed-off-by: Adrien Gallouët <angt@huggingface.co>
2025-02-04 13:32:58 +00:00
..
client Revert "feat: improve qwen2-vl startup " (#2924) 2025-01-17 12:09:05 -05:00
grpc-metadata Upgrading our rustc version. (#2908) 2025-01-15 17:04:03 +01:00
llamacpp Handle max_batch_size 2025-02-04 13:32:58 +00:00
trtllm Add backend name to telemetry (#2962) 2025-01-28 16:53:16 +01:00
v2 Add backend name to telemetry (#2962) 2025-01-28 16:53:16 +01:00
v3 Add backend name to telemetry (#2962) 2025-01-28 16:53:16 +01:00