hf_text-generation-inference/launcher
Nicolas Patry 3ea82d008c
Cpu perf (#2596)
* break when there's nothing to read

Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>

* Different approach, only listen on stdin when `LOG_LEVEL=debug` (which
is where dropping to a debugger is important).

---------

Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>
Co-authored-by: Wang, Yi A <yi.a.wang@intel.com>
2024-10-14 15:34:08 +02:00
..
src Cpu perf (#2596) 2024-10-14 15:34:08 +02:00
Cargo.toml CI (2592): Allow LoRA adapter revision in server launcher (#2602) 2024-10-02 10:51:04 -04:00
build.rs chore(github): add templates (#264) 2023-05-02 15:43:19 +02:00