huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-21 14:52:20 +00:00
Code Issues Packages Projects Releases Wiki Activity
b4187d6022
text-generation-inference/backends/v3
History
Corentin REGAL b4187d6022 Add tgi_batch_current_size and tgi_batch_current_size as response header
2025-01-17 15:48:02 +01:00
..
benches Keeping the benchmark somewhere (#2401) 2024-08-12 15:22:02 +02:00
src Add tgi_batch_current_size and tgi_batch_current_size as response header 2025-01-17 15:48:02 +01:00
build.rs Rebase TRT-llm (#2331) 2024-07-31 10:33:10 +02:00
Cargo.toml chore: Update jsonschema to 0.28.0 (#2870) 2025-01-10 15:01:54 +01:00