Commit Graph

12 Commits

Author SHA1 Message Date
Morgan Funtowicz 929a2fc718 feat(backend): add some test to the backend for core allocation 2024-11-28 14:53:46 +01:00
Morgan Funtowicz 50c376612c feat(backend): bind thread and memory affinity for thread 2024-11-21 13:52:38 +01:00
Morgan Funtowicz 5335bf973b feat(backend): multistream inference on CPU 2024-11-21 00:03:05 +01:00
Morgan Funtowicz 23d2bcf28d misc(build): improve build process 2024-11-14 09:38:13 +01:00
Morgan Funtowicz cf17928f83 misc(cmake): remove dependency on fmt 2024-11-14 08:42:01 +01:00
Morgan Funtowicz 7eec0f704f chore(backend): minor fixes mostly format 2024-11-14 08:42:01 +01:00
Morgan Funtowicz 2cdfed94d9 feat(backend): correctly link to shared fmt and spdlog instead of static 2024-11-14 08:42:01 +01:00
Morgan Funtowicz f0859c247f misc(build): handle different lib destination folder lib/lib64 2024-11-14 08:42:01 +01:00
Morgan Funtowicz e4d803c94e feat(backend): build and link through build.rs 2024-11-14 08:42:01 +01:00
Morgan Funtowicz 355d8a55b4 feat(backend): wip Rust binding 2024-11-14 08:42:01 +01:00
Morgan Funtowicz 05ad684676 feat(llamacpp): enable cuda 2024-11-14 08:42:01 +01:00
Morgan Funtowicz 52d57dca79 feat(llamacpp): initial end2end build 2024-11-14 08:42:01 +01:00