text-generation-inference/backends
2025-01-17 15:48:02 +01:00
..
client Choosing input/total tokens automatically based on available VRAM? (#2673) 2024-10-28 04:59:49 +01:00
grpc-metadata Upgrading our rustc version. (#2908) 2025-01-15 17:04:03 +01:00
trtllm fix: lint backend and doc files (#2850) 2024-12-16 16:12:34 -05:00
v2 Add tgi_batch_current_size and tgi_batch_current_size as response header 2025-01-17 15:48:02 +01:00
v3 Add tgi_batch_current_size and tgi_batch_current_size as response header 2025-01-17 15:48:02 +01:00