local-llm-server/requirements.txt

flask~=2.3.3
flask_cors
pyyaml~=6.0.1
flask_caching
requests~=2.31.0
tiktoken~=0.5.0
gunicorn
gevent~=23.9.0.post1
async-timeout
flask-sock
uvicorn~=0.23.2
fastapi~=0.103.1
torch~=2.0.1
PyMySQL~=1.1.0
DBUtils~=3.0.3
simplejson~=3.19.1
websockets~=11.0.3
basicauth~=1.0.0
openai~=0.28.0
urllib3~=2.0.4
celery[redis]
port to mysql, use vllm tokenizer endpoint 2023-09-20 20:30:31 -06:00			`flask~=2.3.3`
MVP 2023-08-21 21:28:52 -06:00			`flask_cors`
port to mysql, use vllm tokenizer endpoint 2023-09-20 20:30:31 -06:00			`pyyaml~=6.0.1`
MVP 2023-08-21 21:28:52 -06:00			`flask_caching`
port to mysql, use vllm tokenizer endpoint 2023-09-20 20:30:31 -06:00			`requests~=2.31.0`
			`tiktoken~=0.5.0`
concurrent gens setting, online status 2023-08-22 00:26:46 -06:00			`gunicorn`
more work on openai endpoint 2023-09-26 22:09:11 -06:00			`gevent~=23.9.0.post1`
implement streaming for hf-textgen 2023-08-29 17:56:12 -06:00			`async-timeout`
update requirements.txt 2023-08-29 17:57:06 -06:00			`flask-sock`
port to mysql, use vllm tokenizer endpoint 2023-09-20 20:30:31 -06:00			`uvicorn~=0.23.2`
			`fastapi~=0.103.1`
			`torch~=2.0.1`
			`PyMySQL~=1.1.0`
			`DBUtils~=3.0.3`
minor changes, add admin token auth system, add route to get backend info 2023-09-24 15:54:35 -06:00			`simplejson~=3.19.1`
			`websockets~=11.0.3`
update requirements.txt 2023-09-24 21:46:48 -06:00			`basicauth~=1.0.0`
more work on openai endpoint 2023-09-26 22:09:11 -06:00			`openai~=0.28.0`
			`urllib3~=2.0.4`
redo background processes, reorganize server.py 2023-09-27 23:36:44 -06:00			`celery[redis]`