huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-24 00:12:08 +00:00
Code Issues Packages Projects Releases Wiki Activity
6868a13433
text-generation-inference/launcher/src
History
Erik Kaunismäki e5503eba78
configurable termination timeout (#3126) 
* make shard and webserver termination timeouts configurable

* Updating documentation.

* Fmt.

---------

Co-authored-by: Nicolas Patry <patry.nicolas@protonmail.com>
2025-03-20 14:25:56 +01:00
..
env_runtime.rs Add Gaudi Backend (#3055) 2025-02-28 12:14:58 +01:00
gpu.rs Remove compute capability lazy cell (#2580) 2024-09-30 08:48:47 +02:00
main.rs configurable termination timeout (#3126) 2025-03-20 14:25:56 +01:00