This repository has been archived on 2024-10-27. You can view files and clone it, but cannot push or open issues or pull requests.

Cyberes 43299b32ad clean up background threads		2023-09-27 19:39:04 -06:00
..
helpers	set inference workers to daemon, add finally to inference worker, hide estimated avg tps	2023-09-27 18:36:51 -06:00
openai	unify error message handling	2023-09-27 14:48:47 -06:00
v1	clean up background threads	2023-09-27 19:39:04 -06:00
__init__.py	show total output tokens on stats	2023-08-24 20:43:11 -06:00
auth.py	more work on openai endpoint	2023-09-26 22:09:11 -06:00
cache.py	clean up background threads	2023-09-27 19:39:04 -06:00
ooba_request_handler.py	clean up background threads	2023-09-27 19:39:04 -06:00
openai_request_handler.py	unify error message handling	2023-09-27 14:48:47 -06:00
queue.py	clean up background threads	2023-09-27 19:39:04 -06:00
request_handler.py	clean up background threads	2023-09-27 19:39:04 -06:00
server_error.py	fix invalid param error, add manual model name	2023-09-12 10:30:45 -06:00
stats.py	clean up background threads	2023-09-27 19:39:04 -06:00