huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-19 22:02:06 +00:00
Code Issues Packages Projects Releases Wiki Activity
response-header-metrics
text-generation-inference/backends
History
Corentin REGAL b4187d6022 Add tgi_batch_current_size and tgi_batch_current_size as response header
2025-01-17 15:48:02 +01:00
..
client Choosing input/total tokens automatically based on available VRAM? (#2673) 2024-10-28 04:59:49 +01:00
grpc-metadata Upgrading our rustc version. (#2908) 2025-01-15 17:04:03 +01:00
trtllm fix: lint backend and doc files (#2850) 2024-12-16 16:12:34 -05:00
v2 Add tgi_batch_current_size and tgi_batch_current_size as response header 2025-01-17 15:48:02 +01:00
v3 Add tgi_batch_current_size and tgi_batch_current_size as response header 2025-01-17 15:48:02 +01:00