An HTTP API to serve local LLM Models.
This repository has been archived on 2024-10-27. You can view files and clone it, but cannot push or open issues or pull requests.
Go to file
Cyberes 6589b8ac07 fix config 2023-08-23 16:00:54 -06:00
config fix config 2023-08-23 16:00:54 -06:00
llm_server update config 2023-08-23 15:23:06 -06:00
other fix stats for real 2023-08-23 01:14:19 -06:00
.gitignore
LICENSE
README.md
requirements.txt fix stats for real 2023-08-23 01:14:19 -06:00
server.py fix proompters_1_min, other minor changes 2023-08-22 22:32:29 -06:00

README.md

local-llm-server

A HTTP API to serve local LLM Models.

sudo apt install redis