OlivierDehaene d077150eb7 fix: fix gpt-q with groupsize = -1 (#1358)		2023-12-18 16:07:05 +01:00
..
awq/quantize	feat: format code (#1070)	2023-09-27 12:22:09 +02:00
gptq	fix: fix gpt-q with groupsize = -1 (#1358)	2023-12-18 16:07:05 +01:00
__init__.py	feat(server): Add native support for PEFT Lora models (#762)	2023-08-03 17:22:45 +02:00
convert.py	fit for baichuan models (#981)	2023-09-08 16:51:34 +02:00
dist.py	feat: add cuda memory fraction (#659)	2023-07-24 11:43:58 +02:00
flash_attn.py	fix: max_past default value must be -1, not 0 (#1348)	2023-12-15 01:18:39 +01:00
hub.py	fix: fix offline (#1341) (#1347)	2023-12-18 10:20:08 +01:00
import_utils.py	Add RoCm support (#1243)	2023-11-27 14:08:12 +01:00
layers.py	feat: add quant to mixtral (#1337)	2023-12-12 17:55:03 +01:00
logits_process.py	fix(server): avoid errors for very small top_p values (#544)	2023-07-04 20:11:33 +02:00
medusa.py	chore: formatting	2023-12-11 14:49:52 +01:00
paged_attention.py	chore: formatting	2023-12-11 14:49:52 +01:00
peft.py	chore: formatting	2023-12-11 14:49:52 +01:00
speculate.py	chore: formatting	2023-12-11 14:49:52 +01:00
tokens.py	fix: only keep stop sequence buffer if we have some	2023-12-14 17:04:58 +01:00
watermark.py	Fixing watermark. (#851)	2023-08-16 07:17:26 +02:00
weights.py	fix: fix gpt-q with groupsize = -1 (#1358)	2023-12-18 16:07:05 +01:00