Commit Graph

95 Commits

Author SHA1 Message Date
Cyberes e52acb03a4 log gen time to DB, also keep generation_elapsed under 3 min 2023-08-23 22:20:39 -06:00
Cyberes 3317bd5f1a allow hiding of more variables 2023-08-23 22:08:10 -06:00
Cyberes 11a0b6541f fix some stuff related to gunicorn workers 2023-08-23 22:01:06 -06:00
Cyberes 02c07bbd53 pycarm deeleted import 2023-08-23 21:34:27 -06:00
Cyberes de19af900f add estimated wait time and other time tracking stats 2023-08-23 21:33:52 -06:00
Cyberes 0aa52863bc forgot to start workers 2023-08-23 20:33:49 -06:00
Cyberes 6f8b70df54 add a queue system 2023-08-23 20:12:38 -06:00
Cyberes a79d67adbb do caching ourself on /model 2023-08-23 16:40:20 -06:00
Cyberes 64e1b1654f more cloudflare finicky stuff 2023-08-23 16:32:13 -06:00
Cyberes f76d7bbc5d more caching stuff 2023-08-23 16:23:24 -06:00
Cyberes ff8bb0f7c6 shut up 2023-08-23 16:14:13 -06:00
Cyberes 7eb930fafd crap 2023-08-23 16:12:25 -06:00
Cyberes 9fc674878d allow disabling ssl verification 2023-08-23 16:11:32 -06:00
Cyberes a6b0bb0183 actually we want 500 2023-08-23 16:09:36 -06:00
Cyberes fd5796ed07 oops 2023-08-23 16:08:52 -06:00
Cyberes 508089ce11 model info timeout and additional info 2023-08-23 16:07:43 -06:00
Cyberes 1f5e2da637 print fetch model error message 2023-08-23 16:02:57 -06:00
Cyberes 6589b8ac07 fix config 2023-08-23 16:00:54 -06:00
Cyberes 806073ee4c update config 2023-08-23 15:23:06 -06:00
Cyberes ba063f7f1b caching 2023-08-23 12:40:13 -06:00
Cyberes 33190e3cfe fix stats for real 2023-08-23 01:14:19 -06:00
Cyberes 3bb27d6900 track IPs for last min proompters 2023-08-22 23:37:39 -06:00
Cyberes 61b9e313d2 cache again 2023-08-22 23:14:56 -06:00
Cyberes 36b793e8a2 fix proompters_1_min again 2023-08-22 23:01:09 -06:00
Cyberes b051f8dd6b remove caching on stats route 2023-08-22 22:42:40 -06:00
Cyberes 9f14b166dd fix proompters_1_min, other minor changes 2023-08-22 22:32:29 -06:00
Cyberes 3d6ba923bf stats: track proompters over last minute rather than average 2023-08-22 21:55:03 -06:00
Cyberes 06ae8adf0d add backend name to error messages 2023-08-22 21:14:12 -06:00
Cyberes a525093c75 rename, more stats 2023-08-22 20:42:38 -06:00
Cyberes a9b7a7a2c7 display error messages in sillytavern 2023-08-22 20:28:41 -06:00
Cyberes 0d32db2dbd prototype hf-textgen and adjust logging 2023-08-22 19:58:31 -06:00
Cyberes a59dcea2da more proxy stats 2023-08-22 16:50:49 -06:00
Cyberes d8d5514aea add mode to stats 2023-08-22 16:41:55 -06:00
Cyberes bd85b2a4f9 fix freeze on startup 2023-08-22 08:36:59 -06:00
Cyberes ad9a91f1b5 concurrent gens setting, online status 2023-08-22 00:26:46 -06:00
Cyberes d250ba6484 fix redis 2023-08-22 00:01:32 -06:00
Cyberes 7d23f95d26 use redis caching 2023-08-21 23:59:50 -06:00
Cyberes 90f1381f4f fix again 2023-08-21 23:50:41 -06:00
Cyberes 9977182047 fix 2023-08-21 23:49:55 -06:00
Cyberes f767e4b076 stats: prompters 1 min 2023-08-21 23:48:06 -06:00
Cyberes cb2ba1455d add systemctl service 2023-08-21 23:25:53 -06:00
Cyberes 6e3ddab42e fix relative paths for db path 2023-08-21 23:07:12 -06:00
Cyberes e04d6a8a13 minor adjustments 2023-08-21 22:49:44 -06:00
Cyberes 8cbf643fd3 MVP 2023-08-21 21:28:52 -06:00
Cyberes db0dfad83d Initial commit 2023-08-21 14:40:46 -06:00