huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-24 00:12:08 +00:00
Code Issues Packages Projects Releases Wiki Activity

feat(common) adding device utilities

Browse Source
This commit is contained in:
EC2 Default User 2024-09-28 21:10:18 +00:00
parent 5f9120da9c
commit fb81ffce02
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
csrc/common/lib/device.cpp
View File

@ -1,7 +1,7 @@
//
// Created by morgan on 27/09/24.
//
#include <nvml.h>
#include "device.hpp"
std::optional<nvmlDevice_t> huggingface::tgi::GetDeviceByIndex(device_index_t device)