This repository has been archived on 2024-10-27. You can view files and clone it, but cannot push or open issues or pull requests.

Cyberes e7b57cad7b set up cluster config and basic background workers		2023-09-28 18:40:24 -06:00
..
oobabooga	set up cluster config and basic background workers	2023-09-28 18:40:24 -06:00
openai	set up cluster config and basic background workers	2023-09-28 18:40:24 -06:00
vllm	set up cluster config and basic background workers	2023-09-28 18:40:24 -06:00
__init__.py	set up cluster config and basic background workers	2023-09-28 18:40:24 -06:00
generator.py	add ratelimiting to websocket streaming endpoint, fix queue not decrementing IP requests, add console printer	2023-09-27 21:15:54 -06:00
info.py	set up cluster config and basic background workers	2023-09-28 18:40:24 -06:00
llm_backend.py	set up cluster config and basic background workers	2023-09-28 18:40:24 -06:00