Morgan Funtowicz
|
29c7cb36e5
|
Remembering to check how we can detect support for chunked context
|
2024-07-03 21:38:17 +00:00 |
|
Morgan Funtowicz
|
f57f2a4521
|
First version loading engines and making it ready for inference
|
2024-07-03 21:12:24 +00:00 |
|
Morgan Funtowicz
|
f8a1463915
|
Enable end to end CMake build
|
2024-07-03 10:27:53 +02:00 |
|
Morgan Funtowicz
|
818162e0c2
|
Overall build TRTLLM and deps through CMake build system
|
2024-07-02 17:16:27 +02:00 |
|
Morgan Funtowicz
|
6dc98abe46
|
Remove unused parameters annd force tokenizer name to be set
|
2024-07-01 16:11:59 +02:00 |
|
Morgan Funtowicz
|
47ac5c654d
|
Working FFI call for TGI and TRTLLM backend
|
2024-07-01 15:53:23 +02:00 |
|
Morgan Funtowicz
|
dc402dc9ac
|
Initial setup for CXX binding to TRTLLM
|
2024-06-30 23:37:20 +02:00 |
|
OlivierDehaene
|
230f2a415a
|
refacto
|
2024-06-26 14:12:01 +02:00 |
|
OlivierDehaene
|
93e0a7de8b
|
refacto
|
2024-06-26 14:00:03 +02:00 |