21 Commits

Author	SHA1	Message	Date
Cyberes	95d781725e	t	2023-10-04 12:42:18 -06:00
Cyberes	f88e2362c5	remove some debug prints	2023-10-03 20:01:28 -06:00
Cyberes	32ad97e57c	do default model rather than default backend, adjust moderation endpoint logic and add timeout, exclude system tokens from recent proompters, calculate number of moderators from endpoint concurrent gens, adjust homepage	2023-10-03 13:40:08 -06:00
Cyberes	ca1baa4870	test	2023-10-03 00:15:16 -06:00
Cyberes	70126acdf2	test	2023-10-03 00:12:13 -06:00
Cyberes	94141b8ecf	fix processing not being decremented on streaming, fix confusion over queue, adjust stop sequences	2023-10-02 20:53:08 -06:00
Cyberes	4f226ae38e	handle requests to offline backends	2023-10-02 11:11:48 -06:00
Cyberes	f7e9687527	finish openai endpoints	2023-10-01 16:04:53 -06:00
Cyberes	25ec56a5ef	get streaming working, remove /v2/	2023-10-01 00:20:00 -06:00
Cyberes	b10d22ca0d	cache the home page in the background	2023-09-30 23:03:42 -06:00
Cyberes	e0f86d053a	reorganize to api v2	2023-09-30 19:42:41 -06:00
Cyberes	114f36e709	functional	2023-09-30 19:41:50 -06:00
Cyberes	624ca74ce5	mvp	2023-09-29 00:09:44 -06:00
Cyberes	e7b57cad7b	set up cluster config and basic background workers	2023-09-28 18:40:24 -06:00
Cyberes	e42f2b6819	fix negative queue on stats	2023-09-28 08:47:39 -06:00
Cyberes	467b804ad7	raise printer interval	2023-09-28 03:47:27 -06:00
Cyberes	59f2aac8ad	rewrite redis usage	2023-09-28 03:44:30 -06:00
Cyberes	ecdf819088	fix try/finally with continue, fix wrong subclass signature	2023-09-28 00:11:34 -06:00
Cyberes	e86a5182eb	redo background processes, reorganize server.py	2023-09-27 23:36:44 -06:00
Cyberes	097d614a35	fix duplicate logging from console printer thread	2023-09-27 21:28:25 -06:00
Cyberes	e5fbc9545d	add ratelimiting to websocket streaming endpoint, fix queue not decrementing IP requests, add console printer	2023-09-27 21:15:54 -06:00