Commit Graph

24 Commits

Author SHA1 Message Date
Cyberes 0059e7956c Merge cluster to master (#3)
Co-authored-by: Cyberes <cyberes@evulid.cc>
Reviewed-on: #3
2023-10-27 19:19:22 -06:00
Cyberes e86a5182eb redo background processes, reorganize server.py 2023-09-27 23:36:44 -06:00
Cyberes 43299b32ad clean up background threads 2023-09-27 19:39:04 -06:00
Cyberes d9bbcc42e6 more work on openai endpoint 2023-09-26 22:09:11 -06:00
Cyberes 52e6965b5e don't count SYSTEM tokens for recent prompters, fix sql exclude for SYSTEM tokens 2023-09-25 13:00:39 -06:00
Cyberes f9a80f3028 change proompters 1 min to 5 min 2023-09-20 21:21:22 -06:00
Cyberes eb3179cfff fix recent proompters to work with gunicorn 2023-09-17 19:06:53 -06:00
Cyberes 9740df07c7 add openai-compatible backend 2023-09-12 16:40:09 -06:00
Cyberes 21174750ea update readme 2023-08-24 12:19:59 -06:00
Cyberes e52acb03a4 log gen time to DB, also keep generation_elapsed under 3 min 2023-08-23 22:20:39 -06:00
Cyberes 11a0b6541f fix some stuff related to gunicorn workers 2023-08-23 22:01:06 -06:00
Cyberes de19af900f add estimated wait time and other time tracking stats 2023-08-23 21:33:52 -06:00
Cyberes 0aa52863bc forgot to start workers 2023-08-23 20:33:49 -06:00
Cyberes 33190e3cfe fix stats for real 2023-08-23 01:14:19 -06:00
Cyberes 3bb27d6900 track IPs for last min proompters 2023-08-22 23:37:39 -06:00
Cyberes 36b793e8a2 fix proompters_1_min again 2023-08-22 23:01:09 -06:00
Cyberes b051f8dd6b remove caching on stats route 2023-08-22 22:42:40 -06:00
Cyberes 9f14b166dd fix proompters_1_min, other minor changes 2023-08-22 22:32:29 -06:00
Cyberes 3d6ba923bf stats: track proompters over last minute rather than average 2023-08-22 21:55:03 -06:00
Cyberes ad9a91f1b5 concurrent gens setting, online status 2023-08-22 00:26:46 -06:00
Cyberes 90f1381f4f fix again 2023-08-21 23:50:41 -06:00
Cyberes 9977182047 fix 2023-08-21 23:49:55 -06:00
Cyberes f767e4b076 stats: prompters 1 min 2023-08-21 23:48:06 -06:00
Cyberes 8cbf643fd3 MVP 2023-08-21 21:28:52 -06:00