huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-09-11 04:14:52 +00:00
Code Issues Packages Projects Releases Wiki Activity

fix: update ping delay and update doc.

Browse Source
This commit is contained in:
Hugo Larcher 2025-01-27 14:12:03 +01:00
parent 19bb3bf355
commit a8ba2542d8
No known key found for this signature in database
GPG Key ID: 3DAF63124699CA2B
2 changed files with 3 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
docs/source/usage_statistics.md
View File

@ -3,7 +3,8 @@
Text Generation Inference collects anonymous usage statistics to help us improve the service. The collected data is used to improve TGI and to understand what causes failures. The data is collected transparently and any sensitive information is omitted.
Data is sent twice, once on server startup and once when server stops. Also, usage statistics are only enabled when TGI is running in docker to avoid collecting data then TGI runs directly on the host machine.
Usage statistics are only enabled when TGI is running in docker to avoid collecting data then TGI runs directly on the host machine. Data is sent on
startup/shutdown events and a heartbeat every 15 minutes.
## What data is collected

2
router/src/server.rs
View File

@ -1918,7 +1918,7 @@ pub async fn run(
start_event.send().await;
let mut last_report = Instant::now();
while !stop_usage_thread_clone.load(Ordering::Relaxed) {
if last_report.elapsed() > Duration::from_secs(3600) {
if last_report.elapsed() > Duration::from_secs(900) {
let report_event = usage_stats::UsageStatsEvent::new(
ua.clone(),
usage_stats::EventType::Ping,