Cyberes 11a0b6541f | ||
---|---|---|
config | ||
llm_server | ||
other | ||
.gitignore | ||
LICENSE | ||
README.md | ||
requirements.txt | ||
server.py |
README.md
local-llm-server
A HTTP API to serve local LLM Models.
sudo apt install redis