Nicolas Patry 9a59ebcec3 Hotfix GPTQ.		2024-06-03 09:32:12 +00:00
..
attention	Purely refactors paged/attention into `layers/attention` and make hardware differences more obvious with 1 file per hardware. (#1986)	2024-05-31 17:57:01 +02:00
awq	Refactor layers. (#1866)	2024-05-13 12:44:30 +02:00
gptq	Fixing exl2 scratch buffer. (#1990)	2024-05-31 18:01:43 +02:00
__init__.py	MLPSpeculator. (#1865)	2024-05-14 12:33:18 +02:00
bnb.py	[Bug Fix] Update torch import reference in bnb quantization (#1902)	2024-05-15 21:08:32 +02:00
conv.py	Refactor layers. (#1866)	2024-05-13 12:44:30 +02:00
eetq.py	Refactor layers. (#1866)	2024-05-13 12:44:30 +02:00
exl2.py	Add support for exl2 quantization	2024-05-30 11:28:05 +02:00
fp8.py	Refactor layers. (#1866)	2024-05-13 12:44:30 +02:00
layernorm.py	MI300 compatibility (#1764)	2024-05-17 15:30:47 +02:00
linear.py	Hotfix GPTQ.	2024-06-03 09:32:12 +00:00
medusa.py	fix: use path inside of speculator config (#1935)	2024-05-22 20:46:29 +02:00
mlp.py	MLPSpeculator. (#1865)	2024-05-14 12:33:18 +02:00
rotary.py	reenable xpu for tgi (#1939)	2024-05-23 14:11:08 +02:00
speculative.py	MLPSpeculator. (#1865)	2024-05-14 12:33:18 +02:00
tensor_parallel.py	Add support for exl2 quantization	2024-05-30 11:28:05 +02:00