hf_text-generation-inference/launcher
fxmarty 9b3674d903
ROCm and sliding windows fixes (#2033)
* update vllm commit & fix models using sliding window

* update

* update commit

* fix bug where tunableop is bound to cuda graph even when cuda graph are disabled

* enable tunableop by default

* fix sliding window

* address review

* dead code

* precise comment

* is it flaky?
2024-06-10 15:09:50 +08:00
..
src ROCm and sliding windows fixes (#2033) 2024-06-10 15:09:50 +08:00
Cargo.toml Upgrading to rust 1.78. (#1851) 2024-05-06 13:48:11 +02:00
build.rs chore(github): add templates (#264) 2023-05-02 15:43:19 +02:00