Wang, Yi 83634dc122 use xpu-smi to dump used memory (#2047) ... * use xpu-smi to dump used memory xpu use "ZE_AFFINITY_MASK" to control card, usage is like CUDA_VISIBLE_DEVICES Signed-off-by: Wang, Yi A <yi.a.wang@intel.com> * Update server/text_generation_server/utils/import_utils.py Co-authored-by: Daniël de Kok <me@github.danieldk.eu> --------- Signed-off-by: Wang, Yi A <yi.a.wang@intel.com> Co-authored-by: Daniël de Kok <me@github.danieldk.eu>		2024-06-25 10:15:46 +02:00
..
layers	Fix text-generation-server quantize (#2103)	2024-06-21 15:28:51 +02:00
models	feat: sort cuda graphs in descending order (#2104)	2024-06-21 14:28:26 -04:00
pb	chore: add pre-commit (#1569)	2024-02-16 11:58:58 +01:00
utils	use xpu-smi to dump used memory (#2047)	2024-06-25 10:15:46 +02:00
__init__.py	feat(clients): Python client (#103)	2023-03-07 18:52:22 +01:00
cache.py	fix(server): decrease memory fragmentation (#557)	2023-07-06 14:28:33 +02:00
cli.py	Add OTLP Service Name Environment Variable (#2076)	2024-06-25 09:33:01 +02:00
interceptor.py	v2.0.0 (#1736)	2024-04-12 18:38:34 +02:00
server.py	Set maximum grpc message receive size to 2GiB (#2075)	2024-06-17 16:40:44 +02:00
tracing.py	Add OTLP Service Name Environment Variable (#2076)	2024-06-25 09:33:01 +02:00