cyberes
/
local-llm-server
Archived
1
1
Fork 0
Code Issues Pull Requests Packages Projects Releases 1 Wiki Activity

use redis caching

This commit is contained in:
Cyberes 2023-08-21 23:59:50 -06:00
parent 90f1381f4f
commit 7d23f95d26
2 changed files with 4 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
README.md
View File

@ -1,3 +1,5 @@
# local-llm-server
_A HTTP API to serve local LLM Models._
`sudo apt install redis`

2
llm_server/routes/cache.py
View File

@ -1,3 +1,3 @@
from flask_caching import Cache
cache = Cache(config={'CACHE_TYPE': 'simple'})
cache = Cache(config={'CACHE_TYPE': 'redis', 'CACHE_REDIS_URL': 'redis://localhost:6379/0'})