An HTTP API to serve local LLM Models.
Go to file
Cyberes 48f4e0c7dd adjust caching 2023-08-23 23:14:18 -06:00
config add home template 2023-08-23 23:11:12 -06:00
llm_server add home template 2023-08-23 23:11:12 -06:00
other fix stats for real 2023-08-23 01:14:19 -06:00
templates add home template 2023-08-23 23:11:12 -06:00
.gitignore MVP 2023-08-21 21:28:52 -06:00
LICENSE Initial commit 2023-08-21 14:40:46 -06:00
README.md use redis caching 2023-08-21 23:59:50 -06:00
requirements.txt fix stats for real 2023-08-23 01:14:19 -06:00
server.py adjust caching 2023-08-23 23:14:18 -06:00

README.md

local-llm-server

A HTTP API to serve local LLM Models.

sudo apt install redis