Cyberes aba2e5b9c0 don't use db pooling, add LLM-ST-Errors header to disable formatted errors		2023-09-26 23:59:22 -06:00
..
__init__.py	port to mysql, use vllm tokenizer endpoint	2023-09-20 20:30:31 -06:00
generate.py	convert to gunicorn	2023-09-26 13:32:33 -06:00
info.py	adjust vllm info	2023-09-21 20:13:29 -06:00
tokenize.py	don't use db pooling, add LLM-ST-Errors header to disable formatted errors	2023-09-26 23:59:22 -06:00
vllm_backend.py	fix background log not doing anything	2023-09-25 18:18:29 -06:00