23 Commits

Author	SHA1	Message	Date
Cyberes	e86a5182eb	redo background processes, reorganize server.py	2023-09-27 23:36:44 -06:00
Cyberes	43299b32ad	clean up background threads	2023-09-27 19:39:04 -06:00
Cyberes	d9bbcc42e6	more work on openai endpoint	2023-09-26 22:09:11 -06:00
Cyberes	52e6965b5e	don't count SYSTEM tokens for recent prompters, fix sql exclude for SYSTEM tokens	2023-09-25 13:00:39 -06:00
Cyberes	f9a80f3028	change proompters 1 min to 5 min	2023-09-20 21:21:22 -06:00
Cyberes	eb3179cfff	fix recent proompters to work with gunicorn	2023-09-17 19:06:53 -06:00
Cyberes	9740df07c7	add openai-compatible backend	2023-09-12 16:40:09 -06:00
Cyberes	21174750ea	update readme	2023-08-24 12:19:59 -06:00
Cyberes	e52acb03a4	log gen time to DB, also keep generation_elapsed under 3 min	2023-08-23 22:20:39 -06:00
Cyberes	11a0b6541f	fix some stuff related to gunicorn workers	2023-08-23 22:01:06 -06:00
Cyberes	de19af900f	add estimated wait time and other time tracking stats	2023-08-23 21:33:52 -06:00
Cyberes	0aa52863bc	forgot to start workers	2023-08-23 20:33:49 -06:00
Cyberes	33190e3cfe	fix stats for real	2023-08-23 01:14:19 -06:00
Cyberes	3bb27d6900	track IPs for last min proompters	2023-08-22 23:37:39 -06:00
Cyberes	36b793e8a2	fix proompters_1_min again	2023-08-22 23:01:09 -06:00
Cyberes	b051f8dd6b	remove caching on stats route	2023-08-22 22:42:40 -06:00
Cyberes	9f14b166dd	fix proompters_1_min, other minor changes	2023-08-22 22:32:29 -06:00
Cyberes	3d6ba923bf	stats: track proompters over last minute rather than average	2023-08-22 21:55:03 -06:00
Cyberes	ad9a91f1b5	concurrent gens setting, online status	2023-08-22 00:26:46 -06:00
Cyberes	90f1381f4f	fix again	2023-08-21 23:50:41 -06:00
Cyberes	9977182047	fix	2023-08-21 23:49:55 -06:00
Cyberes	f767e4b076	stats: prompters 1 min	2023-08-21 23:48:06 -06:00
Cyberes	8cbf643fd3	MVP	2023-08-21 21:28:52 -06:00