6 Commits

Author	SHA1	Message	Date
Cyberes	4c9d543eab	implement vllm backend	2023-09-11 20:47:19 -06:00
Cyberes	2816c01902	refactor generation route	2023-08-30 18:53:26 -06:00
Cyberes	9fc674878d	allow disabling ssl verification	2023-08-23 16:11:32 -06:00
Cyberes	0d32db2dbd	prototype hf-textgen and adjust logging	2023-08-22 19:58:31 -06:00
Cyberes	a59dcea2da	more proxy stats	2023-08-22 16:50:49 -06:00
Cyberes	8cbf643fd3	MVP	2023-08-21 21:28:52 -06:00