Michael Feil 972e9a7f7c update causal batch for ct2 and fix nf4 (#17) ... * update causal batch for ct2 and fix nf4 * bump the ctranslate2 version --------- Co-authored-by: Michael Feil <michael.feil@michaelfeil.eu>		2024-02-09 11:07:14 -08:00
..
__init__.py	feat(server): flash santacoder (#153)	2023-04-03 19:06:42 +02:00
bloom_modeling.py	Don't enable custom kernels if CUDA is not available (#6)	2023-08-02 09:51:54 -07:00
flash_llama_modeling.py	update causal batch for ct2 and fix nf4 (#17)	2024-02-09 11:07:14 -08:00
flash_neox_modeling.py	feat(server): flash attention v2 (#624)	2023-07-18 16:21:18 +02:00
flash_rw_modeling.py	feat(server): support new falcon config (#712)	2023-07-27 18:38:57 +02:00
flash_santacoder_modeling.py	feat(server): Using `quantize_config.json` instead of GPTQ_BITS env variables. (#671)	2023-07-25 13:00:27 +02:00
mpt_modeling.py	feat: better errors for warmup and TP (#575)	2023-07-10 14:47:15 +02:00
neox_modeling.py	feat: better errors for warmup and TP (#575)	2023-07-10 14:47:15 +02:00
opt_modeling.py	feat(server): Using `quantize_config.json` instead of GPTQ_BITS env variables. (#671)	2023-07-25 13:00:27 +02:00
t5_modeling.py	fix(server): Adding logger import to t5_modeling.py (#585)	2023-07-12 10:40:32 +02:00