huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-23 07:52:06 +00:00
Code Issues Packages Projects Releases Wiki Activity
73d0876f12
text-generation-inference/backends/v3
History
Nicolas Patry 0a495ad118
Updating the kvrouter to support roundrobin 
for comparison, still withthe overloading checks
2025-01-31 09:08:55 +01:00
..
benches Keeping the benchmark somewhere (#2401) 2024-08-12 15:22:02 +02:00
src Updating the kvrouter to support roundrobin 2025-01-31 09:08:55 +01:00
build.rs Rebase TRT-llm (#2331) 2024-07-31 10:33:10 +02:00
Cargo.toml chore: Update jsonschema to 0.28.0 (#2870) 2025-01-10 15:01:54 +01:00