Daniël de Kok ce85efa968 Move to moe-kernels package and switch to common MoE layer (#2511) ... * Move to moe-kernels package and switch to common MoE layer This change introduces the new `moe-kernels` package: - Add `moe-kernels` as a dependency. - Introduce a `SparseMoELayer` module that can be used by MoE models. - Port over Mixtral and Deepseek. * Make `cargo check` pass * Update runner		2024-09-17 18:08:58 +02:00
..
ISSUE_TEMPLATE	chore: add pre-commit (#1569)	2024-02-16 11:58:58 +01:00
workflows	Move to moe-kernels package and switch to common MoE layer (#2511)	2024-09-17 18:08:58 +02:00
PULL_REQUEST_TEMPLATE.md	chore(github): add templates (#264)	2023-05-02 15:43:19 +02:00