ce85efa968
* Move to moe-kernels package and switch to common MoE layer This change introduces the new `moe-kernels` package: - Add `moe-kernels` as a dependency. - Introduce a `SparseMoELayer` module that can be used by MoE models. - Port over Mixtral and Deepseek. * Make `cargo check` pass * Update runner |
||
---|---|---|
.. | ||
images | ||
models | ||
conftest.py | ||
poetry.lock | ||
pyproject.toml | ||
pytest.ini | ||
requirements.txt |