5726a9ca81
This change introduces the new `moe-kernels` package: - Add `moe-kernels` as a dependency. - Introduce a `SparseMoELayer` module that can be used by MoE models. - Port over Mixtral and Deepseek. |
||
---|---|---|
.. | ||
crate-overrides.nix | ||
server.nix |