1c84a30fe6
This change uses the updated Marlin MoE kernel from vLLM to support MoE with activation sorting and groups. |
||
---|---|---|
.. | ||
__init__.py | ||
fp8.py | ||
gptq.py | ||
marlin.py | ||
util.py |
1c84a30fe6
This change uses the updated Marlin MoE kernel from vLLM to support MoE with activation sorting and groups. |
||
---|---|---|
.. | ||
__init__.py | ||
fp8.py | ||
gptq.py | ||
marlin.py | ||
util.py |