text-generation-inference/docs/source
Erik Kaunismäki e5503eba78
configurable termination timeout (#3126)
* make shard and webserver termination timeouts configurable

* Updating documentation.

* Fmt.

---------

Co-authored-by: Nicolas Patry <patry.nicolas@protonmail.com>
2025-03-20 14:25:56 +01:00
..
backends Prepare for patch release. (#3124) 2025-03-18 15:11:55 +01:00
basic_tutorials Prepare for patch release. (#3124) 2025-03-18 15:11:55 +01:00
conceptual Prepare for patch release. (#3124) 2025-03-18 15:11:55 +01:00
reference configurable termination timeout (#3126) 2025-03-20 14:25:56 +01:00
_toctree.yml Release of Gaudi Backend for TGI (#3091) 2025-03-13 10:56:01 +01:00
architecture.md Avoid running neuron integration tests twice (#3054) 2025-02-26 12:15:01 +01:00
index.md Removing ../ that broke the link (#2789) 2024-12-02 05:48:55 +01:00
installation_amd.md Prepare for patch release. (#3124) 2025-03-18 15:11:55 +01:00
installation_gaudi.md Release of Gaudi Backend for TGI (#3091) 2025-03-13 10:56:01 +01:00
installation_inferentia.md Avoid running neuron integration tests twice (#3054) 2025-02-26 12:15:01 +01:00
installation_intel.md Prepare for patch release. (#3124) 2025-03-18 15:11:55 +01:00
installation_nvidia.md Prepare for patch release. (#3124) 2025-03-18 15:11:55 +01:00
installation_tpu.md Fix typo in TPU docs (#2911) 2025-01-15 18:32:07 +01:00
installation.md MI300 compatibility (#1764) 2024-05-17 15:30:47 +02:00
multi_backend_support.md Avoid running neuron integration tests twice (#3054) 2025-02-26 12:15:01 +01:00
quicktour.md Prepare for patch release. (#3124) 2025-03-18 15:11:55 +01:00
supported_models.md Bug Fix: Sliding Window Attention (#3112) 2025-03-18 10:37:33 +01:00
usage_statistics.md fix: Telemetry (#2957) 2025-01-28 10:29:18 +01:00