local-llm-server/llm_server/routes/helpers
Cyberes 35e9847b27 set inference workers to daemon, add finally to inference worker, hide estimated avg tps 2023-09-27 18:36:51 -06:00
..
__init__.py MVP 2023-08-21 21:28:52 -06:00
client.py minor changes, add admin token auth system, add route to get backend info 2023-09-24 15:54:35 -06:00
http.py set inference workers to daemon, add finally to inference worker, hide estimated avg tps 2023-09-27 18:36:51 -06:00