Commit Graph

11 Commits

Author SHA1 Message Date
Morgan Funtowicz dc6435e3a5 feat(backend): create llama_context_params with default factory 2024-11-28 23:57:13 +01:00
Morgan Funtowicz 6c5a75b593 misc(offline): update model creation as std::shared_ptr 2024-11-28 17:45:22 +01:00
Morgan Funtowicz 86d30aea43 feat(backend): simplify overall cpp structure 2024-11-14 08:42:01 +01:00
Morgan Funtowicz 3af2c6837c misc(offline): match rework 2024-11-14 08:42:01 +01:00
Morgan Funtowicz 6a5f6b0755 misc(offline): update offline tester 2024-11-14 08:42:01 +01:00
Morgan Funtowicz dbc5b7a0f7 misc(offline): link correctly 2024-11-14 08:42:01 +01:00
Morgan Funtowicz e4d803c94e feat(backend): build and link through build.rs 2024-11-14 08:42:01 +01:00
Morgan Funtowicz 37faeb34b2 feat(backend): expose frequency and repetition penalties 2024-11-14 08:42:01 +01:00
Morgan Funtowicz 45d5a6a8c5 feat(backend): add some initial decoding steps 2024-11-14 08:42:01 +01:00
Morgan Funtowicz 0911076320 feat(backend): correctly load llama.cpp model from llama api and not gpt2 2024-11-14 08:42:01 +01:00
Morgan Funtowicz 52d57dca79 feat(llamacpp): initial end2end build 2024-11-14 08:42:01 +01:00