huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-23 16:02:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
b3309abb87
text-generation-inference/router/client
History
Karol Damaszke 0e8f8726db
Warmup all decode buckets (#152) 
Co-authored-by: Karol Damaszke <kdamaszke@habana.ai>
2024-05-29 22:46:55 +02:00
..
src Warmup all decode buckets (#152) 2024-05-29 22:46:55 +02:00
build.rs feat: add distributed tracing (#62) 2023-02-13 13:02:45 +01:00
Cargo.toml Add warmup for all possible shapes for prefill #49 (#81) 2024-02-28 10:40:13 +01:00