local-llm-server/llm_server/workers
Cyberes fd09c783d3 refactor a lot of things, major cleanup, use postgresql 2024-05-07 17:03:41 -06:00
..
__init__.py add ratelimiting to websocket streaming endpoint, fix queue not decrementing IP requests, add console printer 2023-09-27 21:15:54 -06:00
cleaner.py redo database connection, add pooling, minor logging changes, other clean up 2024-05-07 09:48:51 -06:00
inferencer.py refactor a lot of things, major cleanup, use postgresql 2024-05-07 17:03:41 -06:00
logger.py redo database connection, add pooling, minor logging changes, other clean up 2024-05-07 09:48:51 -06:00
mainer.py refactor a lot of things, major cleanup, use postgresql 2024-05-07 17:03:41 -06:00
moderator.py redo config 2024-05-07 12:20:53 -06:00
printer.py Merge cluster to master (#3) 2023-10-27 19:19:22 -06:00
recenter.py Merge cluster to master (#3) 2023-10-27 19:19:22 -06:00
threader.py refactor a lot of things, major cleanup, use postgresql 2024-05-07 17:03:41 -06:00