This repository has been archived on 2024-10-27. You can view files and clone it, but cannot push or open issues or pull requests.

Cyberes e7b57cad7b set up cluster config and basic background workers		2023-09-28 18:40:24 -06:00
..
__init__.py	port to mysql, use vllm tokenizer endpoint	2023-09-20 20:30:31 -06:00
generate.py	set up cluster config and basic background workers	2023-09-28 18:40:24 -06:00
info.py	adjust vllm info	2023-09-21 20:13:29 -06:00
tokenize.py	avoid sending to backend to tokenize if it's greater than our specified context size	2023-09-28 03:54:20 -06:00
vllm_backend.py	fix background log not doing anything	2023-09-25 18:18:29 -06:00