local-llm-server/requirements.txt

flask~=2.3.3
pyyaml~=6.0.1
Flask-Caching==2.0.2
requests~=2.31.0
tiktoken~=0.5.0
gevent~=23.9.0.post1
simplejson~=3.19.1
websockets~=11.0.3
basicauth~=1.0.0
openai~=0.28.0
flask-sock==0.6.0
gunicorn==21.2.0
redis==5.0.1
ujson==5.8.0
vllm==0.2.7
coloredlogs~=15.0.1
git+https://git.evulid.cc/cyberes/bison.git
pydantic
psycopg2-binary==2.9.9
port to mysql, use vllm tokenizer endpoint 2023-09-20 20:30:31 -06:00			`flask~=2.3.3`
			`pyyaml~=6.0.1`
Merge cluster to master (#3) Co-authored-by: Cyberes <cyberes@evulid.cc> Reviewed-on: https://git.evulid.cc/cyberes/local-llm-server/pulls/3 2023-10-27 19:19:22 -06:00			`Flask-Caching==2.0.2`
port to mysql, use vllm tokenizer endpoint 2023-09-20 20:30:31 -06:00			`requests~=2.31.0`
			`tiktoken~=0.5.0`
more work on openai endpoint 2023-09-26 22:09:11 -06:00			`gevent~=23.9.0.post1`
minor changes, add admin token auth system, add route to get backend info 2023-09-24 15:54:35 -06:00			`simplejson~=3.19.1`
			`websockets~=11.0.3`
update requirements.txt 2023-09-24 21:46:48 -06:00			`basicauth~=1.0.0`
more work on openai endpoint 2023-09-26 22:09:11 -06:00			`openai~=0.28.0`
Merge cluster to master (#3) Co-authored-by: Cyberes <cyberes@evulid.cc> Reviewed-on: https://git.evulid.cc/cyberes/local-llm-server/pulls/3 2023-10-27 19:19:22 -06:00			`flask-sock==0.6.0`
			`gunicorn==21.2.0`
			`redis==5.0.1`
			`ujson==5.8.0`
clean some stuff up, bump VLLM version 2024-01-10 15:01:26 -07:00			`vllm==0.2.7`
ready for public release 2024-03-18 12:42:44 -06:00			`coloredlogs~=15.0.1`
redo config 2024-05-07 12:20:53 -06:00			`git+https://git.evulid.cc/cyberes/bison.git`
			`pydantic`
refactor a lot of things, major cleanup, use postgresql 2024-05-07 17:03:41 -06:00			`psycopg2-binary==2.9.9`