Cyberes 81452ec643 adjust vllm info		2023-09-21 20:13:29 -06:00
..
oobabooga	port to mysql, use vllm tokenizer endpoint	2023-09-20 20:30:31 -06:00
vllm	adjust vllm info	2023-09-21 20:13:29 -06:00
__init__.py	MVP	2023-08-21 21:28:52 -06:00
backend.py	port to mysql, use vllm tokenizer endpoint	2023-09-20 20:30:31 -06:00
generator.py	remove text-generation-inference backend	2023-09-12 13:09:47 -06:00
info.py	option to disable streaming, improve timeout on requests to backend, fix error handling. reduce duplicate code, misc other cleanup	2023-09-14 14:05:50 -06:00
llm_backend.py	port to mysql, use vllm tokenizer endpoint	2023-09-20 20:30:31 -06:00