OlivierDehaene 73a4d65d26 feat: add cuda memory fraction (#659) ... Close #673		2023-07-24 11:43:58 +02:00
..
models	feat: add cuda memory fraction (#659)	2023-07-24 11:43:58 +02:00
conftest.py	feat(server): Add exllama GPTQ CUDA kernel support #553 (#666)	2023-07-21 10:59:00 +02:00
pytest.ini	feat(server): Rework model loading (#344)	2023-06-08 14:51:52 +02:00
requirements.txt	feat(server): only compute prefill logprobs when asked (#406)	2023-06-02 17:12:30 +02:00