Mirrors
/
hf_text-generation-inference
mirror of https://github.com/huggingface/text-generation-inference.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

feat(common) adding device utilities

This commit is contained in:
EC2 Default User 2024-09-28 21:10:18 +00:00
parent 5f9120da9c
commit fb81ffce02
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
csrc/common/lib/device.cpp
View File

@ -1,7 +1,7 @@
// //
// Created by morgan on 27/09/24. // Created by morgan on 27/09/24.
// //
#include <nvml.h>
#include "device.hpp" #include "device.hpp"
std::optional<nvmlDevice_t> huggingface::tgi::GetDeviceByIndex(device_index_t device) std::optional<nvmlDevice_t> huggingface::tgi::GetDeviceByIndex(device_index_t device)