attention
|
ROCm and sliding windows fixes (#2033)
|
2024-06-10 15:09:50 +08:00 |
awq
|
Refactor layers. (#1866)
|
2024-05-13 12:44:30 +02:00 |
gptq
|
Fix `text-generation-server quantize` (#2103)
|
2024-06-21 15:28:51 +02:00 |
__init__.py
|
MLPSpeculator. (#1865)
|
2024-05-14 12:33:18 +02:00 |
conv.py
|
Refactor layers. (#1866)
|
2024-05-13 12:44:30 +02:00 |
eetq.py
|
Refactor layers. (#1866)
|
2024-05-13 12:44:30 +02:00 |
exl2.py
|
Add support for exl2 quantization
|
2024-05-30 11:28:05 +02:00 |
fp8.py
|
Refactor layers. (#1866)
|
2024-05-13 12:44:30 +02:00 |
layernorm.py
|
MI300 compatibility (#1764)
|
2024-05-17 15:30:47 +02:00 |
linear.py
|
fix tests
|
2024-06-24 18:50:18 +02:00 |
marlin.py
|
disable marlin tests on rocm/xpu
|
2024-06-24 18:49:37 +02:00 |
mlp.py
|
MLPSpeculator. (#1865)
|
2024-05-14 12:33:18 +02:00 |
rotary.py
|
fix(layers): fix SuRotaryEmbedding (#2060)
|
2024-06-12 18:24:47 +02:00 |
speculative.py
|
MLPSpeculator. (#1865)
|
2024-05-14 12:33:18 +02:00 |
tensor_parallel.py
|
Add Phi-3 medium support (#2039)
|
2024-06-10 09:22:29 +02:00 |