cyberes
/
local-llm-server
Archived
1
1
Fork 0
Code Issues Pull Requests Packages Projects Releases 1 Wiki Activity
An HTTP API to serve local LLM Models.
This repository has been archived on 2024-10-27. You can view files and clone it, but cannot push or open issues or pull requests.
46 Commits 2 Branches 2 Tags 795 KiB
Python 92.3%
Shell 3.6%
HTML 3%
Dockerfile 0.7%
Jupyter Notebook 0.4%
Go to file
Cyberes 4ffee69b1d oops 2023-08-23 22:21:59 -06:00
config allow hiding of more variables 2023-08-23 22:08:10 -06:00
llm_server log gen time to DB, also keep generation_elapsed under 3 min 2023-08-23 22:20:39 -06:00
other fix stats for real 2023-08-23 01:14:19 -06:00
.gitignore MVP 2023-08-21 21:28:52 -06:00
LICENSE Initial commit 2023-08-21 14:40:46 -06:00
README.md use redis caching 2023-08-21 23:59:50 -06:00
requirements.txt fix stats for real 2023-08-23 01:14:19 -06:00
server.py oops 2023-08-23 22:21:59 -06:00

README.md

local-llm-server

A HTTP API to serve local LLM Models.

sudo apt install redis