hf_text-generation-inference/backends/trtllm/src
Funtowicz Morgan 3f385991b0
More fixes trtllm (#2342)
* (backend) use parking_lot crate for RwLock fairness

* (docker) let's put rust in the TRTLLM folder when building

* (docker) build ompi with SLURM support

* (launcher) default new server::run parameters to false for now

* (chore) fmt ... why?
2024-08-14 12:02:05 +02:00
..
backend.rs More fixes trtllm (#2342) 2024-08-14 12:02:05 +02:00
errors.rs Rebase TRT-llm (#2331) 2024-07-31 10:33:10 +02:00
ffi.cpp Rebase TRT-llm (#2331) 2024-07-31 10:33:10 +02:00
lib.rs Rebase TRT-llm (#2331) 2024-07-31 10:33:10 +02:00
main.rs More fixes trtllm (#2342) 2024-08-14 12:02:05 +02:00