Morgan Funtowicz
|
929a2fc718
|
feat(backend): add some test to the backend for core allocation
|
2024-11-28 14:53:46 +01:00 |
Morgan Funtowicz
|
50c376612c
|
feat(backend): bind thread and memory affinity for thread
|
2024-11-21 13:52:38 +01:00 |
Morgan Funtowicz
|
5335bf973b
|
feat(backend): multistream inference on CPU
|
2024-11-21 00:03:05 +01:00 |
Morgan Funtowicz
|
23d2bcf28d
|
misc(build): improve build process
|
2024-11-14 09:38:13 +01:00 |
Morgan Funtowicz
|
cf17928f83
|
misc(cmake): remove dependency on fmt
|
2024-11-14 08:42:01 +01:00 |
Morgan Funtowicz
|
7eec0f704f
|
chore(backend): minor fixes mostly format
|
2024-11-14 08:42:01 +01:00 |
Morgan Funtowicz
|
2cdfed94d9
|
feat(backend): correctly link to shared fmt and spdlog instead of static
|
2024-11-14 08:42:01 +01:00 |
Morgan Funtowicz
|
f0859c247f
|
misc(build): handle different lib destination folder lib/lib64
|
2024-11-14 08:42:01 +01:00 |
Morgan Funtowicz
|
e4d803c94e
|
feat(backend): build and link through build.rs
|
2024-11-14 08:42:01 +01:00 |
Morgan Funtowicz
|
355d8a55b4
|
feat(backend): wip Rust binding
|
2024-11-14 08:42:01 +01:00 |
Morgan Funtowicz
|
05ad684676
|
feat(llamacpp): enable cuda
|
2024-11-14 08:42:01 +01:00 |
Morgan Funtowicz
|
52d57dca79
|
feat(llamacpp): initial end2end build
|
2024-11-14 08:42:01 +01:00 |