zspo bd3088748e add FastLinear import (#750) ... # What does this PR do? Fixes #749 ## Who can review? Anyone in the community is free to review the PR once the tests have passed. Feel free to tag members/contributors who may be interested in your PR. <!-- Your PR will be replied to more quickly if you can figure out the right person to tag with @ @OlivierDehaene OR @Narsil --> Co-authored-by: p_spozzhang <p_spozzhang@tencent.com>		2023-08-02 20:04:46 +02:00
..
custom_modeling	add FastLinear import (#750)	2023-08-02 20:04:46 +02:00
__init__.py	feat(server): support new falcon config (#712)	2023-07-27 18:38:57 +02:00
bloom.py	feat(server): Using `quantize_config.json` instead of GPTQ_BITS env variables. (#671)	2023-07-25 13:00:27 +02:00
causal_lm.py	feat: Add the option to force another dtype than `f16`. (#513)	2023-06-30 20:30:09 +02:00
flash_causal_lm.py	feat: add cuda memory fraction (#659)	2023-07-24 11:43:58 +02:00
flash_llama.py	feat(server): Using `quantize_config.json` instead of GPTQ_BITS env variables. (#671)	2023-07-25 13:00:27 +02:00
flash_neox.py	feat(server): Using `quantize_config.json` instead of GPTQ_BITS env variables. (#671)	2023-07-25 13:00:27 +02:00
flash_rw.py	fix(server): fix quantization python requirements (#708)	2023-07-27 12:28:10 +02:00
flash_santacoder.py	feat(server): Using `quantize_config.json` instead of GPTQ_BITS env variables. (#671)	2023-07-25 13:00:27 +02:00
galactica.py	feat(server): Using `quantize_config.json` instead of GPTQ_BITS env variables. (#671)	2023-07-25 13:00:27 +02:00
gpt_neox.py	feat(server): Using `quantize_config.json` instead of GPTQ_BITS env variables. (#671)	2023-07-25 13:00:27 +02:00
model.py	Fix typing in `Model.generate_token` (#733)	2023-07-31 14:35:14 +02:00
mpt.py	feat(server): Using `quantize_config.json` instead of GPTQ_BITS env variables. (#671)	2023-07-25 13:00:27 +02:00
opt.py	feat(server): Using `quantize_config.json` instead of GPTQ_BITS env variables. (#671)	2023-07-25 13:00:27 +02:00
rw.py	feat: Add the option to force another dtype than `f16`. (#513)	2023-06-30 20:30:09 +02:00
santacoder.py	Directly load GPTBigCode to specified device (#618)	2023-07-21 11:27:31 +02:00
seq2seq_lm.py	feat: Add the option to force another dtype than `f16`. (#513)	2023-06-30 20:30:09 +02:00
t5.py	fix(server): T5 weights names. (#582)	2023-07-12 10:01:42 +02:00
types.py	feat(server): support vectorized warpers in flash causal lm (#317)	2023-05-26 12:30:27 +02:00