This repository has been archived on 2024-10-27. You can view files and clone it, but cannot push or open issues or pull requests.
local-llm-server/llm_server/database
Cyberes e0af2ea9c5 convert to gunicorn 2023-09-26 13:32:33 -06:00
..
__init__.py port to mysql, use vllm tokenizer endpoint 2023-09-20 20:30:31 -06:00
conn.py rewrite tokenizer, restructure validation 2023-09-24 13:02:30 -06:00
create.py update database, tokenizer handle null prompt, convert top_p to vllm on openai, actually validate prompt on streaming, 2023-09-25 22:32:48 -06:00
database.py convert to gunicorn 2023-09-26 13:32:33 -06:00