local-llm-server/llm_server/cluster/stores.py

from llm_server.custom_redis import RedisCustom

"""
Global variables for accessing Redis stores.
"""

redis_running_models = RedisCustom('running_models')
Merge cluster to master (#3) Co-authored-by: Cyberes <cyberes@evulid.cc> Reviewed-on: https://git.evulid.cc/cyberes/local-llm-server/pulls/3 2023-10-27 19:19:22 -06:00			`from llm_server.custom_redis import RedisCustom`

clean some stuff up, bump VLLM version 2024-01-10 15:01:26 -07:00			`"""`
			`Global variables for accessing Redis stores.`
			`"""`

Merge cluster to master (#3) Co-authored-by: Cyberes <cyberes@evulid.cc> Reviewed-on: https://git.evulid.cc/cyberes/local-llm-server/pulls/3 2023-10-27 19:19:22 -06:00			`redis_running_models = RedisCustom('running_models')`