This repository has been archived on 2024-10-27. You can view files and clone it, but cannot push or open issues or pull requests.

Cyberes 94141b8ecf fix processing not being decremented on streaming, fix confusion over queue, adjust stop sequences		2023-10-02 20:53:08 -06:00
..
__init__.py	port to mysql, use vllm tokenizer endpoint	2023-09-20 20:30:31 -06:00
generate.py	functional	2023-09-30 19:41:50 -06:00
info.py	functional	2023-09-30 19:41:50 -06:00
tokenize.py	fix processing not being decremented on streaming, fix confusion over queue, adjust stop sequences	2023-10-02 20:53:08 -06:00
vllm_backend.py	update openai endpoints	2023-10-01 14:15:01 -06:00