This repository has been archived on 2024-10-27. You can view files and clone it, but cannot push or open issues or pull requests.

Cyberes 76a1428ba0 implement streaming for vllm		2023-09-23 17:57:23 -06:00
..
vllm	port to mysql, use vllm tokenizer endpoint	2023-09-20 20:30:31 -06:00
api-example-stream.py	implement streaming for vllm	2023-09-23 17:57:23 -06:00
local-llm.service	fix stats for real	2023-08-23 01:14:19 -06:00