huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-21 23:12:07 +00:00
Code Issues Packages Projects Releases Wiki Activity
1932c5b9ed
text-generation-inference/load_tests
History
Nicolas Patry 0a495ad118
Updating the kvrouter to support roundrobin 
for comparison, still withthe overloading checks
2025-01-31 09:08:55 +01:00
..
benchmarks.py chore: prepare 2.4.1 release (#2773) 2024-11-22 17:26:15 +00:00
common.js Updating the kvrouter to support roundrobin 2025-01-31 09:08:55 +01:00
filter.py Auto max prefill (#2797) 2024-12-06 05:52:00 +01:00
long_prompt2.py Auto max prefill (#2797) 2024-12-06 05:52:00 +01:00
long.js Auto max prefill (#2797) 2024-12-06 05:52:00 +01:00
long.py Auto max prefill (#2797) 2024-12-06 05:52:00 +01:00
Makefile Auto max prefill (#2797) 2024-12-06 05:52:00 +01:00
orca.py Auto max prefill (#2797) 2024-12-06 05:52:00 +01:00
poetry.lock feat: Add automatic nightly benchmarks (#2591) 2024-11-21 17:11:42 +00:00
pyproject.toml chore: prepare 2.4.1 release (#2773) 2024-11-22 17:26:15 +00:00