Cyberes e79b206e1a rename average_tps to estimated_avg_tps		2023-09-14 01:35:25 -06:00
..
helpers	add openai-compatible backend	2023-09-12 16:40:09 -06:00
openai	show the openai system prompt	2023-09-13 20:25:56 -06:00
v1	rename average_tps to estimated_avg_tps	2023-09-14 01:35:25 -06:00
__init__.py	show total output tokens on stats	2023-08-24 20:43:11 -06:00
cache.py	get working with ooba again, give up on dockerfile	2023-09-11 09:51:01 -06:00
ooba_request_handler.py	shit code	2023-09-13 11:58:38 -06:00
openai_request_handler.py	didnt test anything	2023-09-13 11:51:46 -06:00
queue.py	implement vllm backend	2023-09-11 20:47:19 -06:00
request_handler.py	adjust logging, add more vllm stuff	2023-09-13 11:22:33 -06:00
server_error.py	fix invalid param error, add manual model name	2023-09-12 10:30:45 -06:00
stats.py	add openai-compatible backend	2023-09-12 16:40:09 -06:00