huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-09-11 20:34:54 +00:00
Code Issues Packages Projects Releases Wiki Activity

fix typos

Browse Source
This commit is contained in:
fxmarty 2024-05-16 13:44:23 +00:00
parent b25d5aa900
commit 56909c2843
1 changed files with 2 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
docs/source/basic_tutorials/monitoring.md
View File

@ -12,7 +12,7 @@ First, on your server machine, TGI needs to be launched as usual. TGI exposes [m
In the rest of this tutorial, we assume that TGI was launched through Docker with `--network host`. In the rest of this tutorial, we assume that TGI was launched through Docker with `--network host`.
On the server where TGI is hosted, a Prometheus server needs to be installed and launched. To do so, please follow [Prometheus installation instructions](https://prometheus.io/download/#prometheus). For example, at the time of writting on a Linux machine: On the server where TGI is hosted, a Prometheus server needs to be installed and launched. To do so, please follow [Prometheus installation instructions](https://prometheus.io/download/#prometheus). For example, at the time of writing on a Linux machine:
``` ```
wget https://github.com/prometheus/prometheus/releases/download/v2.52.0/prometheus-2.52.0.linux-amd64.tar.gz wget https://github.com/prometheus/prometheus/releases/download/v2.52.0/prometheus-2.52.0.linux-amd64.tar.gz
@ -31,7 +31,7 @@ We suggest to try `curl 0.0.0.0:80/generate -X POST -d '{"inputs":"hey chatbot,
Once Prometheus is configured, Prometheus server can be launched on the same machine where TGI is launched: Once Prometheus is configured, Prometheus server can be launched on the same machine where TGI is launched:
``` ```
./prometheus ./prometheus --config.file="prometheus.yml"
``` ```
In this guide, Prometheus monitoring data will be consumed on a local computer. Hence, we need to forward Prometheus port (by default 9090) to the local computer. To do so, we can for example: In this guide, Prometheus monitoring data will be consumed on a local computer. Hence, we need to forward Prometheus port (by default 9090) to the local computer. To do so, we can for example: