This repository has been archived on 2024-10-27. You can view files and clone it, but cannot push or open issues or pull requests.
local-llm-server/llm_server
Cyberes e16f415749 fix 2023-10-03 13:49:00 -06:00
..
cluster do default model rather than default backend, adjust moderation endpoint logic and add timeout, exclude system tokens from recent proompters, calculate number of moderators from endpoint concurrent gens, adjust homepage 2023-10-03 13:40:08 -06:00
config fix exception 2023-10-03 13:47:18 -06:00
database fix 2023-10-03 13:49:00 -06:00
llm fix exception 2023-10-03 13:47:18 -06:00
pages update current model when we generate_stats() 2023-08-24 21:10:00 -06:00
routes fix 2023-10-03 13:49:00 -06:00
workers do default model rather than default backend, adjust moderation endpoint logic and add timeout, exclude system tokens from recent proompters, calculate number of moderators from endpoint concurrent gens, adjust homepage 2023-10-03 13:40:08 -06:00
__init__.py MVP 2023-08-21 21:28:52 -06:00
custom_redis.py functional 2023-09-30 19:41:50 -06:00
helpers.py mvp 2023-09-29 00:09:44 -06:00
netdata.py option to disable streaming, improve timeout on requests to backend, fix error handling. reduce duplicate code, misc other cleanup 2023-09-14 14:05:50 -06:00
opts.py do default model rather than default backend, adjust moderation endpoint logic and add timeout, exclude system tokens from recent proompters, calculate number of moderators from endpoint concurrent gens, adjust homepage 2023-10-03 13:40:08 -06:00
pre_fork.py functional 2023-09-30 19:41:50 -06:00
sock.py mvp 2023-09-29 00:09:44 -06:00