Commit Graph

242 Commits

Author SHA1 Message Date
Cyberes 6e74ce7c28 fix old code in completions 2023-10-19 17:59:27 -06:00
Cyberes b9566e9db7 docs and stuff 2023-10-18 09:23:54 -06:00
Cyberes 56a2ca464b change print 2023-10-18 09:12:30 -06:00
Cyberes 50377eca22 track lag on get_ip_request_count() 2023-10-18 09:09:22 -06:00
Cyberes 92e4ecd8a1 refer to queue for tracking IP count rather than seperate value 2023-10-18 09:03:10 -06:00
Cyberes 90adffaec8 test 2023-10-17 12:32:41 -06:00
Cyberes 4c2c164ce1 test 2023-10-17 12:29:12 -06:00
Cyberes 2fed87d340 remove timed-out items from queue 2023-10-17 11:46:39 -06:00
Cyberes 9e3cbc9d2e fix streaming slowdown? 2023-10-16 23:36:25 -06:00
Cyberes c3c053e071 test 2023-10-16 23:29:17 -06:00
Cyberes 806e522d16 don't pickle streaming 2023-10-16 18:35:10 -06:00
Cyberes 1e68e10b62 fix GeneratorExit 2023-10-16 18:04:49 -06:00
Cyberes 2c7773cc4f get streaming working again 2023-10-16 16:22:52 -06:00
Cyberes 151b3e4769 begin streaming rewrite 2023-10-16 00:18:05 -06:00
Cyberes 24aab3cd93 fix streaming disabled 2023-10-15 20:59:11 -06:00
Cyberes 381bdb950f remove debug print 2023-10-15 20:46:32 -06:00
Cyberes 31ab4188f1 fix issues with queue and streaming 2023-10-15 20:45:01 -06:00
Cyberes 3ec9b2347f fix wrong datatype 2023-10-15 17:24:18 -06:00
Cyberes b3f0c4b28f remove debug print 2023-10-15 15:14:32 -06:00
Cyberes 83f3ba8919 trying to fix workers still processing after backend goes offline 2023-10-15 15:11:37 -06:00
Cyberes 4e3985e156 fix wrong status code on openai streaming 2023-10-11 18:17:02 -06:00
Cyberes 74cf8f309b clean up 2023-10-11 18:04:15 -06:00
Cyberes 69b8c1e35c fix openai confusion 2023-10-11 12:50:20 -06:00
Cyberes 78114771b0 fix oai exception 2023-10-11 09:20:00 -06:00
Cyberes 18e37a72ae add model selection to openai endpoint 2023-10-09 23:51:26 -06:00
Cyberes 5f7bf4faca misc changes 2023-10-09 18:12:12 -06:00
Cyberes ae4d4e5ca9 fix exception 2023-10-09 10:31:35 -06:00
Cyberes 467e1893ea fix issue with null data on openai 2023-10-08 19:36:12 -06:00
Cyberes 3e5feb9c97 fix stat 2023-10-05 21:43:49 -06:00
Cyberes e8964fcfd2 fix the queue?? 2023-10-05 21:37:18 -06:00
Cyberes e9f6fdf65e fix streaming? 2023-10-05 20:14:28 -06:00
Cyberes 67173f30dd t 2023-10-05 19:35:12 -06:00
Cyberes 5540112607 t 2023-10-05 19:09:25 -06:00
Cyberes 50992116f5 fix 2023-10-05 18:59:19 -06:00
Cyberes a37b12a221 t 2023-10-05 18:51:56 -06:00
Cyberes 46d44f95ac t 2023-10-05 18:50:10 -06:00
Cyberes 0718f10eb9 t 2023-10-05 18:36:02 -06:00
Cyberes fb8bc05b4c t 2023-10-05 18:30:54 -06:00
Cyberes 19e62be3e8 t 2023-10-05 17:41:01 -06:00
Cyberes 27e461c76b test 2023-10-05 17:00:35 -06:00
Cyberes 08df52a4fd fix exception when not valid model 2023-10-05 12:28:00 -06:00
Cyberes acf409abfc fix background logger, add gradio chat example 2023-10-04 19:24:47 -06:00
Cyberes 1670594908 fix import error 2023-10-04 16:29:19 -06:00
Cyberes 6723dd79dc fix exceptoin 2023-10-04 16:04:03 -06:00
Cyberes 09fa69e031 fix 2023-10-04 13:37:39 -06:00
Cyberes d78ef652fc c 2023-10-04 13:21:43 -06:00
Cyberes 5e90fa54d4 handle model offline 2023-10-04 13:18:47 -06:00
Cyberes 77db34a6a7 g 2023-10-04 12:59:19 -06:00
Cyberes 364b795268 fix 2023-10-04 12:57:11 -06:00
Cyberes 7cb624c5f5 f 2023-10-04 12:47:59 -06:00