hf_text-generation-inference/launcher
Wang, Yi 83634dc122
use xpu-smi to dump used memory (#2047)
* use xpu-smi to dump used memory
xpu use "ZE_AFFINITY_MASK" to control card, usage is like CUDA_VISIBLE_DEVICES

Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>

* Update server/text_generation_server/utils/import_utils.py

Co-authored-by: Daniël de Kok <me@github.danieldk.eu>

---------

Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>
Co-authored-by: Daniël de Kok <me@github.danieldk.eu>
2024-06-25 10:15:46 +02:00
..
src use xpu-smi to dump used memory (#2047) 2024-06-25 10:15:46 +02:00
Cargo.toml Upgrading to rust 1.78. (#1851) 2024-05-06 13:48:11 +02:00
build.rs chore(github): add templates (#264) 2023-05-02 15:43:19 +02:00