| .. |
|
custom_modeling
|
feat(server): Using `quantize_config.json` instead of GPTQ_BITS env variables. (#671)
|
2023-07-25 13:00:27 +02:00 |
|
__init__.py
|
feat(server): flash attention v2 (#624)
|
2023-07-18 16:21:18 +02:00 |
|
bloom.py
|
feat(server): Using `quantize_config.json` instead of GPTQ_BITS env variables. (#671)
|
2023-07-25 13:00:27 +02:00 |
|
causal_lm.py
|
feat: Add the option to force another dtype than `f16`. (#513)
|
2023-06-30 20:30:09 +02:00 |
|
flash_causal_lm.py
|
feat: add cuda memory fraction (#659)
|
2023-07-24 11:43:58 +02:00 |
|
flash_llama.py
|
feat(server): Using `quantize_config.json` instead of GPTQ_BITS env variables. (#671)
|
2023-07-25 13:00:27 +02:00 |
|
flash_neox.py
|
feat(server): Using `quantize_config.json` instead of GPTQ_BITS env variables. (#671)
|
2023-07-25 13:00:27 +02:00 |
|
flash_rw.py
|
fix(server): fix quantization python requirements (#708)
|
2023-07-27 12:28:10 +02:00 |
|
flash_santacoder.py
|
feat(server): Using `quantize_config.json` instead of GPTQ_BITS env variables. (#671)
|
2023-07-25 13:00:27 +02:00 |
|
galactica.py
|
feat(server): Using `quantize_config.json` instead of GPTQ_BITS env variables. (#671)
|
2023-07-25 13:00:27 +02:00 |
|
gpt_neox.py
|
feat(server): Using `quantize_config.json` instead of GPTQ_BITS env variables. (#671)
|
2023-07-25 13:00:27 +02:00 |
|
model.py
|
feat: add cuda memory fraction (#659)
|
2023-07-24 11:43:58 +02:00 |
|
mpt.py
|
feat(server): Using `quantize_config.json` instead of GPTQ_BITS env variables. (#671)
|
2023-07-25 13:00:27 +02:00 |
|
opt.py
|
feat(server): Using `quantize_config.json` instead of GPTQ_BITS env variables. (#671)
|
2023-07-25 13:00:27 +02:00 |
|
rw.py
|
feat: Add the option to force another dtype than `f16`. (#513)
|
2023-06-30 20:30:09 +02:00 |
|
santacoder.py
|
Directly load GPTBigCode to specified device (#618)
|
2023-07-21 11:27:31 +02:00 |
|
seq2seq_lm.py
|
feat: Add the option to force another dtype than `f16`. (#513)
|
2023-06-30 20:30:09 +02:00 |
|
t5.py
|
fix(server): T5 weights names. (#582)
|
2023-07-12 10:01:42 +02:00 |
|
types.py
|
feat(server): support vectorized warpers in flash causal lm (#317)
|
2023-05-26 12:30:27 +02:00 |
8bd0adb135