cyberes
/
local-llm-server
1
1
Fork 0
Code Issues Pull Requests Packages Projects Releases 1 Wiki Activity
An HTTP API to serve local LLM Models.
19 Commits 2 Branches 2 Tags 793 KiB
Python 92.2%
Shell 3.7%
HTML 3%
Dockerfile 0.7%
Jupyter Notebook 0.4%
Go to file
Cyberes 3d6ba923bf stats: track proompters over last minute rather than average 2023-08-22 21:55:03 -06:00
config prototype hf-textgen and adjust logging 2023-08-22 19:58:31 -06:00
llm_server stats: track proompters over last minute rather than average 2023-08-22 21:55:03 -06:00
other add systemctl service 2023-08-21 23:25:53 -06:00
.gitignore MVP 2023-08-21 21:28:52 -06:00
LICENSE Initial commit 2023-08-21 14:40:46 -06:00
README.md use redis caching 2023-08-21 23:59:50 -06:00
requirements.txt concurrent gens setting, online status 2023-08-22 00:26:46 -06:00
server.py rename, more stats 2023-08-22 20:42:38 -06:00

README.md

local-llm-server

A HTTP API to serve local LLM Models.

sudo apt install redis