Morgan Funtowicz
|
b846ae2d9e
|
use external fmt lib
|
2024-07-12 19:24:59 +00:00 |
|
Morgan Funtowicz
|
5aede911f8
|
include guard to build example in cmakelists
|
2024-07-11 21:24:01 +00:00 |
|
Morgan Funtowicz
|
ca9da2dd49
|
create cmake install target to put everything relevant in installation folder
|
2024-07-10 13:48:59 +00:00 |
|
Morgan Funtowicz
|
4272b8cf51
|
correctly tell cmake to build dependent tensorrt-llm required libraries
|
2024-07-10 13:48:44 +00:00 |
|
Morgan Funtowicz
|
bec188ff73
|
bind to CUDA::nvml to retrieve compute capabilities at runtime
|
2024-07-08 22:32:41 +00:00 |
|
Morgan Funtowicz
|
f57f2a4521
|
First version loading engines and making it ready for inference
|
2024-07-03 21:12:24 +00:00 |
|
Morgan Funtowicz
|
f8a1463915
|
Enable end to end CMake build
|
2024-07-03 10:27:53 +02:00 |
|
Morgan Funtowicz
|
818162e0c2
|
Overall build TRTLLM and deps through CMake build system
|
2024-07-02 17:16:27 +02:00 |
|
Morgan Funtowicz
|
47ac5c654d
|
Working FFI call for TGI and TRTLLM backend
|
2024-07-01 15:53:23 +02:00 |
|
Morgan Funtowicz
|
dc402dc9ac
|
Initial setup for CXX binding to TRTLLM
|
2024-06-30 23:37:20 +02:00 |