Morgan Funtowicz
|
42748d5960
|
allow converting huggingface::tokenizers error to TensorRtLlmBackendError
|
2024-07-10 13:56:57 +00:00 |
|
Morgan Funtowicz
|
40fe2ec0ff
|
add auth_token CLI argument to provide hf hub authentification token
|
2024-07-10 13:50:28 +00:00 |
|
Morgan Funtowicz
|
68a0247a2c
|
unconditionally call InitializeBackend on the FFI layer
|
2024-07-08 22:09:09 +00:00 |
|
Morgan Funtowicz
|
f57f2a4521
|
First version loading engines and making it ready for inference
|
2024-07-03 21:12:24 +00:00 |
|
Morgan Funtowicz
|
f8a1463915
|
Enable end to end CMake build
|
2024-07-03 10:27:53 +02:00 |
|
Morgan Funtowicz
|
6dc98abe46
|
Remove unused parameters annd force tokenizer name to be set
|
2024-07-01 16:11:59 +02:00 |
|
Morgan Funtowicz
|
47ac5c654d
|
Working FFI call for TGI and TRTLLM backend
|
2024-07-01 15:53:23 +02:00 |
|
Morgan Funtowicz
|
dc402dc9ac
|
Initial setup for CXX binding to TRTLLM
|
2024-06-30 23:37:20 +02:00 |