This repository has been archived on 2024-10-27. You can view files and clone it, but cannot push or open issues or pull requests.
local-llm-server/llm_server
Cyberes f88e2362c5 remove some debug prints 2023-10-03 20:01:28 -06:00
..
cluster do default model rather than default backend, adjust moderation endpoint logic and add timeout, exclude system tokens from recent proompters, calculate number of moderators from endpoint concurrent gens, adjust homepage 2023-10-03 13:40:08 -06:00
config fix exception 2023-10-03 13:47:18 -06:00
database fix 2023-10-03 13:49:00 -06:00
llm remove some debug prints 2023-10-03 20:01:28 -06:00
pages update current model when we generate_stats() 2023-08-24 21:10:00 -06:00
routes clean up streaming 2023-10-03 14:10:50 -06:00
workers remove some debug prints 2023-10-03 20:01:28 -06:00
__init__.py MVP 2023-08-21 21:28:52 -06:00
custom_redis.py functional 2023-09-30 19:41:50 -06:00
helpers.py mvp 2023-09-29 00:09:44 -06:00
netdata.py option to disable streaming, improve timeout on requests to backend, fix error handling. reduce duplicate code, misc other cleanup 2023-09-14 14:05:50 -06:00
opts.py do default model rather than default backend, adjust moderation endpoint logic and add timeout, exclude system tokens from recent proompters, calculate number of moderators from endpoint concurrent gens, adjust homepage 2023-10-03 13:40:08 -06:00
pre_fork.py functional 2023-09-30 19:41:50 -06:00
sock.py mvp 2023-09-29 00:09:44 -06:00